Systems and methods for enforcing a recovery point objective (RPO) for a production database without generating secondary copies of the production database

Patent metadata

Field	Value
Publication number	US-12056018-B2
Application number	US-202217843750-A
Country	US
Kind code	B2
Filing date	Jun 17, 2022
Priority date	Jun 17, 2022
Publication date	Aug 6, 2024
Grant date	Aug 6, 2024

Abstract

A disclosed framework enables virtually any aggressive Recovery Point Objective (RPO) to be enforced for a production database, without limitation on type of database management system (DBMS) or size of the production database. The framework overcomes technological barriers of the prior art, such as bottlenecks presented by a storage manager computer that traditionally managed database backups. To avoid the bottlenecks, an illustrative data storage management system does not engage the storage manager computer in storage operations that could impact the database RPO. Certain components are added and enhanced to autonomously capture database transaction logs, which are stored securely and persistently away from the DBMS. In a separate and less frequent operation, and with involvement of the storage manager computer, the illustrative system generates secondary copies in their final form. Meanwhile, temporary backup files can be used in restore operations without first being converted into secondary copies.

First claim

What is claimed is:

1. A computer-implemented method performed by one or more hardware processors, the method comprising:
activating a first data agent at a first computing device, wherein the first computing device hosts a database management system that comprises a first database, wherein the first data agent is associated with the database management system;
by the first data agent, converting a first set of transaction logs generated by the database management system into a first set of temporary backup files, wherein the first set of temporary backup files are in a backup format that comprises encryption;
based on a time interval of a recovery point objective (RPO) associated with the first database, transmitting the first set of temporary backup files over a persistent data pipeline connection to a second computing device;
by the second computing device, storing the first set of temporary backup files persistently at a data repository of the second computing device;
based on a second time interval that is greater than the time interval of the RPO, determining by the second computing device whether the data repository comprises any temporary backup files;
based on the second computing device determining that the data repository comprises at least one temporary backup file, performing a data storage job that converts the at least one temporary backup file into one or more secondary copies and storing the one or more secondary copies at a secondary storage that is distinct from the data repository,
wherein the data storage job comprises indexing the one or more secondary copies in an index maintained at the second computing device, and wherein the data storage job further comprises reporting information about the data storage job to a storage manager that executes on a third computing device, which is distinct from the first computing device and from the second computing device.

2. The method of claim 1 , wherein the first data agent generates the first set of temporary backup files without receiving one or more instructions to do so from the storage manager.

3. The method of claim 1 , wherein the first data agent receives the RPO from the storage manager after the first data agent is activated, and subsequently the first data agent does not receive one or more instructions from the storage manager to generate the first set of temporary backup files.

4. The method of claim 1 , wherein the first data agent is configured to determine, based on the time interval of the RPO, that the first data agent should initiate the transmitting of the first set of temporary backup files over the persistent data pipeline connection to the second computing device.

5. The method of claim 1 , wherein the storage manager is configured to transmit the RPO to the first data agent, and is further configured to subsequently not cause the first data agent to generate the first set of temporary backup files.

6. The method of claim 1 , wherein the storage manager is configured not to initiate the data storage job, and wherein the second computing device is configured to initiate the data storage job based on the second time interval.

7. The method of claim 1 , wherein the second computing device is configured to determine, based on the second time interval, that the second computing device should initiate the data storage job by requesting a job identifier from the storage manager.

8. The method of claim 1 , wherein the second computing device is configured to initiate the data storage job, based on the second time interval, wherein initiating the data storage job comprises requesting a job identifier for the data storage job from the storage manager; and further comprising:
based on receiving the job identifier from the storage manager, performing the data storage job by a media agent and a second data agent that execute at the second computing device.

9. The method of claim 8 , wherein the data repository comprises one or more of a data storage volume and a folder configured at the second computing device, and wherein the second data agent is associated with a file system that comprises the one or more of the data storage volume and the folder.

10. The method of claim 1 , wherein the time interval of the RPO is substantially more frequent than the second time interval.

11. The method of claim 1 , further comprising:
by the storage manager, receiving a request to restore data to the first database;
by the second computing device, determining whether the data repository comprises a second set of temporary backup files that comprise the data to be restored to the first database;
initiating, by the storage manager, a restore job at the second computing device, wherein the restore job is based on the second set of temporary backup files;
by the second computing device, transmitting the second set of temporary backup files over the persistent data pipeline connection to the first data agent at the first computing device;
by the first data agent, converting the second set of temporary backup files into a second set of transaction logs, wherein the second set of transaction logs are in a format that is native to the database management system.

12. The method of claim 1 , wherein the time interval of the RPO is substantially more frequent than the second time interval, and further comprising:
by the storage manager, maintaining in a management database that is distinct from the first database, the RPO and the second time interval, and wherein the storage manager stores the information about the data storage job received from the second computing device into the management database.

13. A system comprising:
a second computing device comprising one or more hardware processors, wherein the second computing device is communicatively coupled to a first computing device via a persistent data pipeline connection to a first data agent that executes at the first computing device, and wherein the first computing device additionally executes a database management system that comprises a first database, which is associated with a recovery point objective (RPO); and
a third computing device comprising one or more hardware processors, wherein the third computing device executes a storage manager;
wherein the first computing device executing the first data agent is configured to:
convert a first set of transaction logs generated by the database management system into a first set of temporary backup files, wherein the first set of temporary backup files are in a backup format that comprises encryption, and
based on a time frequency of the RPO, transmit the first set of temporary backup files over the persistent data pipeline connection to the second computing device;

wherein the second computing device is configured to:
store the first set of temporary backup files persistently at a data repository that comprises one or more of a data storage volume and a folder configured at the second computing device, and
based on a second time frequency that is greater than the time frequency of the RPO, determine whether the data repository comprises any temporary backup files, and
based on determining that the data repository comprises at least one temporary backup file, perform a data storage job that:
converts the at least one temporary backup file into one or more secondary copies,
stores the one or more secondary copies at a secondary storage, which is distinct from the data repository,
indexes the one or more secondary copies in an index maintained at the second computing device, and
reports information about the data storage job to the storage manager at the third computing device; an

Assignees

• Commvault Systems Inc

Inventors

• Sharma Chandresh
• Agrawal Saurabh
• Vallabhaneni Brahmaiah
• Kapadia Hetal
• Vijayan Manoj Kumar

Classifications

• G06F11/1469

  Backup restoration techniques · CPC title

• G06F11/1451 Primary

  by selection of backup contents · CPC title

• G06F2201/80

  Database-specific techniques · CPC title

• G06F2201/84

  Using snapshots, i.e. a logical point-in-time copy of the data · CPC title

• G06F2201/835

  Timestamp · CPC title