Reduced memory utilization for data analytics procedures

Patent metadata

Field	Value
Publication number	US-12254352-B2
Application number	US-202117513028-A
Country	US
Kind code	B2
Filing date	Oct 28, 2021
Priority date	Oct 28, 2021
Publication date	Mar 18, 2025
Grant date	Mar 18, 2025

Abstract

An example embodiment may involve a main database; a main memory; and one or more processors configured to: retrieve, by a data collector application, records from the main database, wherein the data collector application includes an embedded database; aggregate, by the data collector application, values in the records relating to a key performance indicator (KPI) to form partial KPI data stored in one or more blocks of the main memory; determine, by the data collector application, that utilization of the main memory exceeds a pre-defined threshold; in response to the utilization of the main memory exceeding the pre-defined threshold, write, by the data collector application, the partial KPI data to a row of the embedded database; and release, by the data collector application, the one or more blocks of the main memory used to store the partial KPI data.

First claim

What is claimed is:

1. A system comprising:
a main database;
a main memory; and
one or more processors configured to:
retrieve, by a data collector application, records from the main database into the main memory, wherein the data collector application includes an embedded database, wherein the embedded database is separate from the main database, wherein the main memory is volatile storage, wherein the embedded database is in non-volatile storage;
aggregate, by the data collector application, values in the records relating to a key performance indicator (KPI) to form partial KPI data stored in one or more blocks of the main memory;
determine, by the data collector application, that utilization of the main memory exceeds a pre-defined threshold;
in response to the utilization of the main memory exceeding the pre-defined threshold, write, by the data collector application, the partial KPI data to a row of the embedded database, wherein writing the partial KPI data to the row of the embedded database comprises combining the partial KPI data with other partial KPI data already stored in the row of the embedded database;
determine that an end of the records has been reached;
in response to determining that the end of the records has been reached, write values from the row of the embedded database to the main database as final KPI data;
delete the row of the embedded database relating to the KPI; and
release, by the data collector application, the one or more blocks of the main memory used to store the partial KPI data.

2. The system of claim 1 , wherein the non-volatile storage includes a hard disk drive or a solid state drive, and wherein the volatile storage is random access memory (RAM).

3. The system of claim 1 , wherein determining that the utilization of the main memory exceeds the pre-defined threshold comprises determining that the data collector application is using more than a pre-defined amount of the main memory.

4. The system of claim 1 , wherein the partial KPI data is related to a plurality of KPIs, and wherein determining that the utilization of the main memory exceeds the pre-defined threshold comprises determining that a number of KPIs represented in the partial KPI data exceeds a pre-defined amount.

5. The system of claim 1 , wherein determining that the utilization of the main memory exceeds the pre-defined threshold comprises determining that a number of the records used to form the partial KPI data exceeds a pre-defined amount.

6. The system of claim 1 , wherein the one or more processors are further configured to:
retrieve further records from the main database;
aggregate further values in the further records relating to the KPI to form further partial KPI data stored in one or more further blocks of the main memory;
determine that further utilization of the main memory exceeds the pre-defined threshold;
in response to the further utilization of the main memory exceeding the pre- defined threshold, aggregate the further partial KPI data with the partial KPI data in the row of the embedded database; and
release, by the data collector application, the one or more further blocks of the main memory used to store the further partial KPI data.

7. The system of claim 1 , wherein the one or more processors are further configured to:
aggregate the values in the records relating to a further KPI to form further partial KPI data stored in one or more further blocks of the main memory;
in response to the utilization of the main memory exceeding the pre-defined threshold, write the further partial KPI data to a further row of the embedded database; and
release the one or more further blocks of the main memory used to store the further partial KPI data.

8. The system of claim 1 , wherein aggregating the values in the records relating to the KPI to form partial KPI data comprises summing or averaging the values.

9. A computer-implemented method comprising:
retrieving, by a data collector application, records from a main database into a main memory, wherein the data collector application includes an embedded database, wherein the embedded database is separate from the main database, wherein the main memory is volatile storage, wherein the embedded database is in non-volatile storage;
aggregating, by the data collector application, values in the records relating to a key performance indicator (KPI) to form partial KPI data stored in one or more blocks of the main memory;
determining, by the data collector application, that utilization of the main memory exceeds a pre-defined threshold;
in response to the utilization of the main memory exceeding the pre-defined threshold, writing, by the data collector application, the partial KPI data to a row of the embedded database, wherein writing the partial KPI data to the row of the embedded database comprises combining the partial KPI data with other partial KPI data already stored in the row of the embedded database;
determining that an end of the records has been reached;
in response to determining that the end of the records has been reached, writing values from the row of the embedded database to the main database as final KPI data;
deleting the row of the embedded database relating to the KPI; and
releasing, by the data collector application, the one or more blocks of the main memory used to store the partial KPI data.

10. The computer-implemented method of claim 9 , wherein determining that the utilization of the main memory exceeds the pre-defined threshold comprises determining that the data collector application is using more than a pre-defined amount of the main memory.

11. The computer-implemented method of claim 9 , wherein the partial KPI data is related to a plurality of KPIs, and wherein determining that the utilization of the main memory exceeds the pre-defined threshold comprises determining that a number of KPIs represented in the partial KPI data exceeds a pre-defined amount.

12. The computer-implemented method of claim 9 , wherein determining that the utilization of the main memory exceeds the pre-defined threshold comprises determining that a number of the records used to form the partial KPI data exceeds a pre-defined amount.

13. The computer-implemented method of claim 9 , further comprising:
retrieving further records from the main database;
aggregating further values in the further records relating to the KPI to form further partial KPI data stored in one or more further blocks of the main memory;
determining that further utilization of the main memory exceeds the pre-defined threshold;
in response to the further utilization of the main memory exceeding the pre- defined threshold, aggregating the further partial KPI data with the partial KPI data in the row of the embedded database; and
releasing, by the data collector application, the one or more further blocks of the main memory used to store the further partial KPI data.

14. The computer-implemented method of claim 9 , further comprising:
aggregating the values in the records relating to a further KPI to form further partial KPI data stored in one or more further blocks of the main memory;
in response to the utilization of the main memory exceeding the pre-defined threshold, writing the further partial KPI data to a further row of the embedded database; and
releasing the one or more further blocks of the main memory used to store the further partial KPI data.

15. An article of manufacture including a non-transitory computer-readable medium, having stored thereon program instructions that, upon execution by a computing system, cause the computing system

Assignees

• Servicenow Inc

Inventors

• Ramamurthy Vignesh Salem
• Kamarajugadda Gayatri
• Jaitak Lav
• Sandhireddy Vamshi
• Barron-Kraus Kyle
• Aiswarya
• Khandelwal Radhika
• Borkar Rahul
• Nagarajan Abhijith
• Fiorelli Benedetto
• Racharla Aravind

Classifications

• G06F9/5016 Primary

  the resource being the memory · CPC title

• G06Q10/06 Primary

  Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling · CPC title