Methods and system for detecting unmanaged resources in cloud-based data warehousing system

Patent metadata

Field	Value
Publication number	US-12430352-B2
Application number	US-202418654777-A
Country	US
Kind code	B2
Filing date	May 3, 2024
Priority date	Jun 10, 2022
Publication date	Sep 30, 2025
Grant date	Sep 30, 2025

Abstract

Methods, systems, devices, and computer-readable media used by a cloud data management system for collecting data from accounts hosted by a cloud-based data warehousing system on different cloud platforms or in different cloud regions of a cloud platform. Collection of data in the multi-cloud platform and/or multi-cloud region environments may be facilitated by the on-demand creation of one or more data collection accounts. Based on the collected data, one or more data warehouse resources not managed by the cloud data management system may be discovered, configured, and onboarded to the cloud data management system.

First claim

What is claimed is:

1. A method comprising:
determining, by a first computing device associated with a data manager account hosted in a first cloud region, that a plurality of client accounts associated with a first client are hosted in a plurality of cloud regions of a cloud-based data warehouse system;
for a first client account of the plurality of client accounts associated with the first client:
determining, by the first computing device, that the first client account is hosted in a second cloud region;
sending, by the first computing device and to a second computing device associated with the first client account, a first request for the first client account to share, with a second data manager account hosted in the second cloud region, data indicating warehouse resources associated with the first client account;
replicating, from the second data manager account to the data manager account, the data shared from the first client account;
and
storing, by the first computing device and in a database associated with the data manager account, the replicated data;

determining, by the first computing device and based on the stored data, one or more new warehouse resources included in the data since a previous request to access the data;
receiving, by the first computing device, a first selection of a warehouse resource from a listing comprising the one or more new warehouse resources;
in response to the first selection, generating, based on a type of the selected warehouse resource, a set of operating parameters to be associated with the selected warehouse resource; and
configuring, by the first computing device, the selected warehouse resource to utilize, during operation, the set of operating parameters.

2. The method of claim 1 , further comprising:
sending, by the first computing device and to a third computing device associated with the second data manager account, a second request to replicate, to the data manager account, the data shared from the first client account.

3. The method of claim 1 , further comprising:
prior to replicating the data, receiving, by the first computing device, an indication that the data is available for access; and
accessing, by the first computing device and via the data manager account, the data.

4. The method of claim 1 , further comprising:
outputting, by the first computing device, the listing comprising the one or more new warehouse resources from one or more of the plurality of client accounts associated with the first client.

5. The method of claim 1 , further comprising:
updating information indicating managed resources to indicate the selected warehouse resource.

6. The method of claim 1 , wherein the warehouse resources comprise one or more of: a data warehouse, a database, a schema, a table, a column, a view, a stored procedure, a function, a user, a role, a stage, or a policy.

7. The method of claim 1 , further comprising:
receiving a second selection of a warehouse resource from the listing comprising the one or more new warehouse resources;
based on determining that the selected warehouse resource is a data warehouse, generating a default schedule for operating the data warehouse; and
configuring the data warehouse to operate in accordance with the generated default schedule.

8. The method of claim 7 , wherein the default schedule sets operating parameters for the data warehouse for one or more periods of time.

9. The method of claim 1 , further comprising:
analyzing usage data to determine one or more recommended adjustments to operating parameters associated with one or more of the one or more new warehouses resources;
causing output of the recommended adjustments; and
based on receiving a second selection of a first recommended adjustment, of the recommended adjustments, adjusting one or more operating parameters associated with a corresponding new warehouse resource in accordance with the first recommended adjustment.

10. The method of claim 1 , further comprising:
receiving a second selection of a warehouse resource from the listing comprising the one or more new warehouse resources;
monitoring, during a period of time, computing resource usage associated with the selected warehouse resource; and
sending, based on detecting that the computing resource usage exceeds a threshold, a notification.

11. A first computing device associated with a data manager account hosted in a first cloud region of a cloud-based data warehouse system, wherein the first computing device comprises:
one or more processors; and
memory storing computer-executable instructions that, when executed by the one or more processors, cause the first computing device to:
determine that a plurality of client accounts associated with a first client are hosted in a plurality of cloud regions of the cloud-based data warehouse system;
for a first client account of the plurality of client accounts associated with the first client:
determine that the first client account is hosted in a second cloud region;
send, to a second computing device associated with the first client account, a first request for the first client account to share, with a second data manager account hosted in the second cloud region, data indicating warehouse resources associated with the first client account,
replicate, from the second data manager account to the data manager account, the data shared from the first client account;
and
storing, in a database associated with the data manager account, the replicated data;

determine, based on the stored data, one or more new warehouse resources included in the data since a previous request to access the data;
receive a first selection of a warehouse resource from a listing comprising the one or more new warehouse resources;
in response to the first selection, generate, based on a type of the selected warehouse resource, a set of operating parameters to be associated with the selected warehouse resource; and
configure the selected warehouse resource to utilize, during operation, the set of operating parameters.

12. The first computing device of claim 11 , wherein the instruction, when executed by the one or more processors, further cause the first computing device to:
send, to a third computing device associated with the second data manager account, a second request to replicate, to the data manager account, the data shared from the first client account.

13. The first computing device of claim 11 , wherein the instruction, when executed by the one or more processors, further cause the first computing device to:
output the listing comprising the one or more new warehouse resources from one or more of the plurality of client accounts associated with the first client.

14. A cloud data management system comprising:
a first computing device associated with a data manager account hosted in a first cloud region of a cloud-based data warehouse system; and
a second computing device associated with a first client account of a plurality of client accounts associated with a first client of the cloud-based data warehouse system, wherein the second computing device is configured to receive a request to share data,
wherein the first computing device is configured to:
determine that the plurality of client accounts associated with the first client are hosted in a plurality of cloud regions of the cloud-based data warehouse system;
for the first client account of the plurality of client accounts associated with the first client:
determine that the first client account is hosted in a second cloud region;
send, to the second computing device associated with t

Assignees

• Capital One Services Llc

Inventors

• Shah Hiren
• Bharathan Ganesh
• Maramreddy Sridhar
• Vadakattu Naga Venkata Sriram
• Kilaru Naveen Kumar
• Ellis David
• Li Felix
• Batra Yudhish
• Kolanu Kishore
• Mehmood Fnu Syed Siraj
• Luo Nicole Ann

Classifications

• G06F11/3055

  Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available (error or fault processing without redundancy G06F11/0703; error detection or correction by redundancy in data representation G06F11/08; error detection or correction of the data by redundancy in operations G06F11/14; error detection or correction by redundancy in hardware G06F11/16) · CPC title

• G06F3/0653

  Monitoring storage devices or systems · CPC title

• G06F3/0658

  Controller construction arrangements · CPC title

• G06F3/0604

  Improving or facilitating administration, e.g. storage management · CPC title

• H04L67/1095

  Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes · CPC title