Methods and system for detecting unmanaged resources in cloud-based data warehousing system

Patent metadata

Field	Value
Publication number	US-12019648-B2
Application number	US-202217964259-A
Country	US
Kind code	B2
Filing date	Oct 12, 2022
Priority date	Jun 10, 2022
Publication date	Jun 25, 2024
Grant date	Jun 25, 2024

Abstract

Methods, systems, devices, and computer-readable media used by a cloud data management system for collecting data from accounts hosted by a cloud-based data warehousing system on different cloud platforms or in different cloud regions of a cloud platform. Collection of data in the multi-cloud platform and/or multi-cloud region environments may be facilitated by the on-demand creation of one or more data collection accounts. Based on the collected data, one or more data warehouse resources not managed by the cloud data management system may be discovered, configured, and onboarded to the cloud data management system.

First claim

What is claimed is:

1. A method comprising:
identifying, by a first computing device associated with a data manager account of a cloud-based data warehouse system, a plurality of client accounts associated with a first client of the cloud-based data warehouse system;
determining, by the first computing device, that the plurality of client accounts associated with the first client are hosted in a plurality of cloud regions of the cloud-based data warehouse system;
for a first client account of the plurality of client accounts associated with the first client:
sending, by the first computing device and to a second computing device associated with the first client account, a first request, wherein, when the first client account is hosted in a same cloud region as the data manager account, the first request comprises a request for the first client account to share, with the data manager account, data indicating warehouse resources associated with the first client account, and wherein, when the first client account is hosted in a different cloud region from the data manager account, the first request comprises a request for the first client account to share, with a second data manager account hosted in the different cloud region, the data indicating the warehouse resources associated with the first client account,
sending, by the first computing device and to a third computing device associated with the second data manager account, when the first client account is hosted in the different cloud region, a second request to replicate, to the data manager account, the data shared from the first client account;
receiving, by the first computing device, an indication that the data is available for access;
accessing, by the first computing device and via the data manager account, the data; and
storing, by the first computing device and in a database associated with the data manager account, the accessed data;

determining, by the first computing device and based on the stored data, one or more new warehouse resources included in the data since a previous request to access the data;
outputting, by the first computing device, a listing comprising the one or more new warehouse resources from one or more of the plurality of client accounts associated with the first client;
receiving, by the first computing device, a first selection of a warehouse resource from the listing comprising the one or more new warehouse resources;
in response to the first selection, generating, by the first computing device and based on a type of the selected warehouse resource, a set of operating parameters to be associated with the selected warehouse resource; and
configuring, by the first computing device, the selected warehouse resource to utilize, during operation, the set of operating parameters.

2. The method of claim 1 , further comprising:
updating information indicating managed resources to indicate the selected warehouse resource.

3. The method of claim 1 , wherein the warehouse resources comprise one or more of: a data warehouse, a database, a schema, a table, a column, a view, a stored procedure, a function, a user, a role, a stage, or a policy.

4. The method of claim 1 , further comprising:
receiving a second selection of a warehouse resource from the listing comprising the one or more new warehouse resources;
based on determining that the selected warehouse resource is a data warehouse, generating a default schedule for operating the data warehouse; and
configuring the data warehouse to operate in accordance with the generated default schedule.

5. The method of claim 4 , wherein the default schedule sets operating parameters for the data warehouse for one or more periods of time.

6. The method of claim 1 , further comprising:
analyzing the data to determine one or more recommended adjustments to operating parameters associated with one or more of the one or more new warehouses resources;
causing output of the recommended adjustments;
based on receiving a second selection of a first recommended adjustment, of the recommended adjustments, adjusting one or more operating parameters associated with a corresponding new warehouse resource in accordance with the first recommended adjustment.

7. The method of claim 1 , further comprising:
receiving a second selection of a warehouse resource from the listing comprising the one or more new warehouse resources;
monitoring, during a period of time, computing resource usage associated with the selected warehouse resource; and
sending, based on detecting that the computing resource usage exceeds a threshold, a notification.

8. A first computing device associated with a data manager account of a cloud-based data warehouse system, wherein the first computing device comprises:
one or more processors; and
memory storing computer-executable instructions that, when executed by the one or more processors, cause the first computing device to:
identify a plurality of client accounts associated with a first client of the cloud-based data warehouse system;
determine that the plurality of client accounts associated with the first client are hosted in a plurality of cloud regions of the cloud-based data warehouse system;
for a first client account of the plurality of client accounts associated with the first client:
send, to a second computing device associated with the first client account, a first request, wherein, when the client account is hosted in a same cloud region as the data manager account, the first request comprises a request for the first client account to share, with the data manager account, data indicating warehouse resources associated with the first client account, and wherein, when the first client account is hosted in a different cloud region from the data manager account, the first request comprises a request for the first client account to share, with a second data manager account hosted in the different cloud region, the data indicating the warehouse resources associated with the first client account,
send, to a third computing device associated with the second data manager account, when the first client account is hosted in the different cloud region, a second request to replicate, to the data manager account, the data shared from the first client account;
receive an indication that the data is available for access;
access, via the data manager account, the data; and
store, in a database associated with the data manager account, the accessed data;

determine, based on the stored data, one or more new warehouse resources included in the data since a previous request to access the data;
output a listing comprising the one or more new warehouse resources from one or more of the plurality of client accounts associated with the first client;
receive a first selection of a warehouse resource from the listing comprising the one or more new warehouse resources;
in response to the first selection, generate, based on a type of the selected warehouse resource, a set of operating parameters to be associated with the selected warehouse resource; and
configure the selected warehouse resource to utilize, during operation, the set of operating parameters.

9. The first computing device of claim 8 , wherein the instruction, when executed by the one or more processors, further cause the first computing device to:
update information indicating managed resources to indicate the selected warehouse resource.

10. The first computing device of claim 8 , wherein the warehouse resources comprise one or more of: a data warehouse, a database, a schema, a table, a column, a view, a stored procedure, a function, a user, a role, a stage, or a policy.

11.

Assignees

• Capital One Services Llc

Inventors

• Shah Hiren
• Bharathan Ganesh
• Maramreddy Sridhar
• Vadakattu Naga Venkata Sriram
• Kilaru Naveen Kumar
• Ellis David
• Li Felix
• Batra Yudhish
• Kolanu Kishore
• Mehmood Syed Siraj
• Markley Nicole

Classifications

• G06F11/3055

  Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available (error or fault processing without redundancy G06F11/0703; error detection or correction by redundancy in data representation G06F11/08; error detection or correction of the data by redundancy in operations G06F11/14; error detection or correction by redundancy in hardware G06F11/16) · CPC title

• G06F11/3006

  where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems (multiprogramming arrangements G06F9/46; allocation of resources G06F9/50) · CPC title

• G06F3/0653

  Monitoring storage devices or systems · CPC title

• G06F3/0658

  Controller construction arrangements · CPC title

• G06F3/0604

  Improving or facilitating administration, e.g. storage management · CPC title