Dynamic parallelism

Patent metadata

Field	Value
Publication number	US-10185500-B1
Application number	US-201514752397-A
Country	US
Kind code	B1
Filing date	Jun 26, 2015
Priority date	Jun 26, 2015
Publication date	Jan 22, 2019
Grant date	Jan 22, 2019

Abstract

Techniques to optimize use of the available capacity of a backup target storage device are disclosed. In various embodiments, a current capacity of a target system to which backup data is to be streamed to handle additional streams is determined dynamically, at or near a time at which a backup operation is to be performed. One or more backup parameters of the backup operation is/are set dynamically, based at least in part on the dynamically determined current capacity of the target system.

First claim

What is claimed is:

1. A method of protecting data, comprising:
determining dynamically, at or near a time at which a backup operation is to be performed, a current capacity of a target system to which backup data is to be streamed to handle additional streams, wherein the current capacity of the target system is determined at least in part by polling the target system;
comparing the polled current capacity of the target system to one or more capabilities of a source system, wherein the one or more capabilities of the source system include a maximum number of concurrent backup write streams, wherein the polled current capacity of the target system indicates a current number of additional backup write streams that the target system is capable of receiving;
determining a number of concurrent backup streams for the backup operation based on the maximum number of concurrent backup write streams of the source system and the current number of additional backup write streams that the target system is capable of receiving;
dynamically setting one or more backup parameters of the backup operation, based at least in part on the determined number of concurrent backup streams for the backup operation, wherein the one or more backup parameters includes a number of databases included in the backup data and a corresponding number of stripes for each database of the backup data; and
backing up to the target system the backup data based on the one or more backup parameters.

2. The method of claim 1 , further comprising receiving an indication to perform the backup operation; and initiating at least in part in response to the indication said step of determining dynamically the current capacity of the target system.

3. The method of claim 1 , wherein dynamically setting one or more backup parameters of the backup operation includes allocating among two or more data sets said current capacity of the target system.

4. The method of claim 1 , wherein dynamically setting one or more backup parameters of the backup operation includes allocating among two or more data movers said current capacity of the target system.

5. The method of claim 1 , wherein the current capacity of the target system is determined by a calibrator module, appliance, or system with which the backup operation is associated.

6. The method of claim 1 , wherein the current capacity of the target system is determined at least in part by invoking an application programming interface (API) of the target system.

7. The method of claim 1 , wherein the one or more backup parameters of the backup operation are set based at least in part on a capability of a source system on which a source data to be backed up in the backup operation is stored.

8. The method of claim 1 , wherein the one or more backup parameters of the backup operation are set based at least in part on an attribute of a source data to be backed up in the backup operation is stored.

9. The method of claim 1 , further comprising monitoring the target system while the backup operation is being performed to detect a change in said current capacity of the target system.

10. The method of claim 9 , further comprising adjusting said one or more backup parameters during the course of the backup operation based at least in part on a determination that the current capacity of the target system has been detected to have changed.

11. A system to protect data, comprising:
a communication interface; and
a processor coupled to the communication interface and configured to:
determine dynamically, at least in part through a communication sent via the communication interface at or near a time at which a backup operation is to be performed, a current capacity of a target system to which backup data is to be streamed to handle additional streams, wherein the current capacity of the target system is determined at least in part by polling the target system;
compare the polled current capacity of the target system to one or more capabilities of a source system, wherein the one or more capabilities of the source system include a maximum number of concurrent backup write streams, wherein the polled current capacity of the target system indicates a current number of additional backup write streams that the target system is capable of receiving;
determine a number of concurrent backup streams for the backup operation based on the maximum number of concurrent backup write streams of the source system and the current number of additional backup write streams that the target system is capable of receiving;
dynamically set one or more backup parameters of the backup operation, based at least in part on the determined number of concurrent backup streams for the backup operation, wherein the one or more backup parameters includes a number of databases to be included in the backup data and a corresponding number of stripes for each database of the backup data; and
back up to the target system the backup data based on the one or more backup parameters.

12. The system of claim 11 , wherein the processor is further configured to receive an indication to perform the backup operation; and to determine dynamically the current capacity of the target system at least in part in response to the indication.

13. The system of claim 11 , wherein dynamically setting one or more backup parameters of the backup operation includes allocating among two or more data sets said current capacity of the target system.

14. The system of claim 11 , wherein dynamically setting one or more backup parameters of the backup operation includes allocating among two or more data movers said current capacity of the target system.

15. The system of claim 11 , wherein the current capacity of the target system is determined at least in part by invoking an application programming interface (API) of the target system.

16. The system of claim 11 , wherein the one or more backup parameters of the backup operation are set based at least in part on a capability of a source system on which a source data to be backed up in the backup operation is stored.

17. A computer program product to protect data, the computer program product being embodied in a non-transitory computer readable medium and comprising computer instructions for:
determining dynamically, at or near a time at which a backup operation is to be performed, a current capacity of a target system to which backup data is to be streamed to handle additional streams, wherein the current capacity of the target system is determined at least in part by polling the target system;
comparing the polled current capacity of the target system to one or more capabilities of a source system, wherein the one or more capabilities of the source system include a maximum number of concurrent backup write streams, wherein the polled current capacity of the target system indicates a current number of additional backup write streams that the target system is capable of receiving;
determining a number of concurrent backup streams for the backup operation based on the maximum number of concurrent backup write streams of the source system and the current number of additional backup write streams that the target system is capable of receiving;
dynamically setting one or more backup parameters of the backup operation, based at least in part on the determined number of concurrent backup streams for the backup operation, wherein the one or more backup parameters includes a number of databases included in the backup data and a corresponding number of stripes for each database of the backup data; and
backing up to

Assignees

• Emc Ip Holding Co Llc

Inventors

• Chopra Shelesh
• Palkhade Rajkumar

Classifications

• G06F3/065

  Replication mechanisms · CPC title

• G06F11/1464

  for networked environments · CPC title

• G06F3/0619

  in relation to data integrity, e.g. data losses, bit errors · CPC title

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title

• G06F3/0613 Primary

  in relation to throughput · CPC title