Load balancing across multiple data paths

Patent metadata

Field	Value
Publication number	US-2020356446-A1
Application number	US-202016936424-A
Country	US
Kind code	A1
Filing date	Jul 23, 2020
Priority date	May 9, 2014
Publication date	Nov 12, 2020
Grant date	—

Abstract

Multiple data paths may be available to a data management system for transferring data between a primary storage device and a secondary storage device. The data management system may be able to gain operational advantages by performing load balancing across the multiple data paths. The system may use application layer characteristics of the data for transferring from a primary storage to a backup storage during data backup operation, and correspondingly from a secondary or backup storage system to a primary storage system during restoration.

First claim

1 - 20 . (canceled)

21 . At least one non-transitory computer-readable medium carrying instructions, which when executed by at least one data processor, perform operations relative to copying or transferring data from primary storage to secondary storage, the operations comprising:
identifying two data sets among the data based on one or more application-level characteristics of the data; allocating a job for transferring the data from the primary storage to the secondary storage; and identifying multiple streams of the job for transferring the data from the primary storage to the secondary storage,
wherein each stream is allocated a data path for carrying one or more of the data sets of the data, and
wherein each data path is associated with different storage locations of the secondary data storage.

22 . The at least one non-transitory computer-readable medium of claim 21 , wherein each data set is associated with one or more tags indicative of application-level characteristics.

23 . The at least one non-transitory computer-readable medium of claim 21 , wherein at least two different streams among the multiple streams comprise a first stream configured to transfer data over a first host bus adapter and a second stream configured to transfer data over a second host bus adapter that uses a different bus technology than the first host bus adapter.

24 . The at least one non-transitory computer-readable medium of claim 21 , wherein one type of data to be transferred is generated by a user or an application, wherein the one type of data is to be accessed more frequently or is more critical as compared to another type of data that is to be accessed less frequently or is more tolerant of errors, and wherein the other type of data is database data, wherein the one type of data includes log files and index tables for the database data, wherein the log files and index tables are copied to a first data storage device that is faster, more accurate or provides a greater number of read/write cycles over its lifetime as compared to a second data storage device, while the database data is copied to the second data storage device.

25 . The at least one non-transitory computer-readable medium of claim 21 , wherein one type of data to be transferred is generated by a user or an application, wherein the one type of data is to be accessed more frequently or is more critical as compared to another type of data that is to be accessed less frequently or is more tolerant of errors, and wherein the one type of data includes encrypted data or financial data that is more sensitive to individual bit errors, and the other type of data includes bulk media files, wherein the one type of data is copied using a first host bus adapter and first storage drive having a lower probability of read/write errors or a longer shelf life as compared to a second host bus adapter and a second storage drive for copying the bulk media files.

26 . The at least one non-transitory computer-readable medium of claim 21 , wherein one type of data to be transferred is generated by a user or an application, and wherein the one type of data is to be accessed more frequently or is more critical as compared to another type of data that is to be accessed less frequently or is more tolerant of errors.

27 . The at least one non-transitory computer-readable medium of claim 21 , wherein the operations further comprise:
providing, to a media agent, information identifying a primary data storage location in the primary storage and a destination storage location in the secondary storage.

28 . The at least one non-transitory computer-readable medium of claim 21 , wherein the operations further comprise:
receiving, for the job, a storage policy that specifies a rule for assigning a media agent and a destination storage location; and allocating resources to the job according to the storage policy, wherein the storage policy further specifies a de-duplication rule for the job, wherein the rule specifies a directory to be used for de-duplication or a hash function to be used for de-duplication.

29 . The at least one non-transitory computer-readable medium of claim 21 , wherein the operations further comprise:
receiving, for the job, a storage policy that specifies a rule for assigning a media agent and a destination storage location; and allocating resources to the job according to the storage policy.

30 . The at least one non-transitory computer-readable medium of claim 21 , wherein the operations further comprise:
receiving, from a media agent, information identifying at least one primary data storage location and a corresponding destination data storage location.

31 . The at least one non-transitory computer-readable medium of claim 21 , wherein the operations further comprise:
maintaining, for the primary storage, information identifying a first data set and a first group of destination storage locations at which units making up the first data set are stored, and a second data set and a second group of destination storage locations at which units making up the second data set are stored.

32 . The at least one non-transitory computer-readable medium of claim 21 , wherein the operations further comprise:
assigning data paths for restoring multiple subsets of the data stored at the secondary storage; and restoring the multiple subsets of data,
wherein at least two subsets of the data are restored using two different data paths.

33 . A computer-executable method, which when executed by at least one data processor, performs a method relative to copying or transferring data from primary storage to target data storage, the method comprising:
reserving system resources for performing load balancing transfer operations across multiple data paths; and causing the load balancing transfer operations to be performed for the data from the primary storage to different storage locations of the target data storage.

34 . The method of claim 33 , wherein the load balancing transfer operations provide balanced use of system resources, including host bus adapters and data storage devices having different characteristics such as read/write speeds, read/write life cycles and error tolerances.

35 . The method of claim 33 , wherein the load balancing transfer operations allow a backup storage system to use at least one application level characteristic associated with data in data backup and data restoration operations with respect to different data storage devices within the system.

36 . The method of claim 33 , wherein one type of data to be copied is generated by a user or an application, wherein the one type of data is to be accessed more frequently or is more critical as compared to another type of data that is to be accessed less frequently or is more tolerant of errors, and wherein the other type of data is database data, wherein the one type of data includes log files and index tables for the database data, wherein the log files and index tables are copied to a first data storage device that is faster, more accurate or provides a greater number of read/write cycles over its lifetime as compared to a second data storage device, while the database data is copied to the second data storage device.

37 . The method of claim 33 , wherein one type of data to be copied is generated by a user or an application, wherein the one type of data is to be accessed more frequently or is more critical as compared to another type of data that is to be accessed less frequently or is more tolerant of errors, and wherein the one t

Assignees

• Commvault Systems Inc

Inventors

• Kochunni Jaidev O
• Liu Chong
• Vijayan Manoj Kumar
• Kottomtharayil Rajiv

Classifications

• G06F11/1435

  using file system or storage system metadata · CPC title

• G06F11/1461

  Backup scheduling policy · CPC title

• G06F11/1453

  using de-duplication of the data · CPC title

• G06F11/3433

  for load management (allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029) · CPC title

• G06F11/1464 Primary

  for networked environments · CPC title