Systems and methods for doing agentless backup in scale-out fashion

Patent metadata

Field	Value
Publication number	US-9690670-B1
Application number	US-201414319977-A
Country	US
Kind code	B1
Filing date	Jun 30, 2014
Priority date	Jun 30, 2014
Publication date	Jun 27, 2017
Grant date	Jun 27, 2017

Abstract

Various systems, methods and apparatuses for intelligently and dynamically allocating proxy backup clients to back up and restore vast amounts of data distributed across a network are presented. One method involves identify distributed data stored in a computer system, requesting the data, and performing a backup or restore operation on the data. Other aspects include intelligently dynamically allocating proxy backup clients to perform backup and restore operations on data distributed across a network, and intelligently and dynamically balancing, or re-balancing or otherwise managing the workload among the proxy backup clients.

First claim

What is claimed is:

1. A computer-implemented method of backing up data, the method comprising:
identifying data stored in a plurality of computer systems, wherein
the plurality of computer systems comprises a plurality of data nodes,
the data is stored at one or more data nodes of the plurality of data nodes, and
the identifying identifies at least one of the one or more data nodes;

requesting the data, wherein
the requesting is performed by a proxy backup client of a plurality of proxy backup clients; and

performing a backup operation on the data, wherein
the backup operation is performed by at least two proxy backup clients of the plurality of proxy backup clients,
the backup operation is distributed among the at least two proxy backup clients based on two or more criteria among a plurality of criteria, wherein the criteria comprises at least two of
available bandwidth,
available processing power, or
proximity to one or more of the data nodes, and

the performing comprises
receiving at least a portion of the data at each of the at least two proxy backup clients, and
storing the portion of the data in a memory in each of the at least two proxy backup clients.

2. The method of claim 1 , wherein the identifying further comprises:
requesting information about a location of the data, wherein
the information identifies at least one of the data nodes.

3. The method of claim 2 , wherein
the requesting the information further comprises
the data is stored at a plurality of the data nodes in a cluster,
a first data node among the plurality of data nodes comprises a first operating system,
a second data node among the plurality of data nodes comprises a second operating system, and
the information identifies the first data node and the second data node; and

the requesting the data further comprises
requesting data substantially simultaneously from the first data node and the second data node.

4. The method of claim 1 , further comprising:
invoking the plurality of proxy backup clients, wherein
the plurality of proxy backup clients are associated with a cluster, and
the cluster comprises a storage management system and the one or more data nodes.

5. The method of claim 4 , wherein the invoking further comprises:
determining a number of proxy backup clients to invoke, wherein
the data comprises a plurality of data blocks; and
the determining is based on at least one of
a volume of the data, and
a number of data nodes upon which at least one of the data blocks is stored.

6. The method of claim 1 , wherein the requesting the data further comprises:
the data comprises a plurality of data blocks, and
at least two of the plurality of proxy backup clients each request at least one of the data blocks at substantially the same time.

7. The method of claim 1 , wherein the performing the backup operation further comprises:
the data comprises a plurality of data blocks, and
the data blocks are de-duplicated prior to storing the data in the memory.

8. A system comprising
one or more processors;
a memory coupled to the one or more processors, wherein the memory stores program instructions executable by the one or more processors to:
identify data stored in a plurality of computer systems, wherein
the plurality of computer systems comprises a plurality of data nodes,
the data is stored at one or more data nodes of the plurality of data nodes, and
at least one of the one or more data nodes are identified;

request the data, wherein
the request is performed by a proxy backup client of a plurality of proxy backup clients; and

perform a backup operation on the data, wherein
the backup operation is performed by at least two proxy backup clients of the plurality of proxy backup clients,
the backup operation is distributed among the at least two proxy backup clients based on two or more criteria among a plurality of criteria, wherein the criteria comprises at least two of
available bandwidth,
available processing power, or
proximity to one or more of the data nodes, and

the backup operation performed comprises
receiving at least a portion of the data at each of the at least two proxy backup clients, and
storing the portion of the data in a memory in each of the at least two proxy backup clients.

9. The system of claim 8 , wherein identifying the data comprises:
request information about a location of the data, wherein the information identifies at least one of the data nodes.

10. The system of claim 8 , further comprising:
invoke the plurality of proxy backup clients, wherein
the plurality of proxy backup clients are associated with a cluster, and
the cluster comprises a storage management system and the one or more data nodes.

11. The system of claim 10 , wherein invoking the plurality of proxy backup clients comprises:
determine a number of proxy backup clients to invoke, wherein
the data comprises a plurality of data blocks; and
the number of proxy backup clients to invoke is determined based on at least one of
a volume of the data, and
a number of data nodes upon which at least one of the data blocks is stored.

12. The system of claim 8 , wherein the request further comprises:
the data comprises a plurality of data blocks, and
at least two of the plurality of proxy backup clients each request at least one of the data blocks at substantially the same time.

13. The system of claim 9 , wherein
the request of the information further comprises
the data is stored at a plurality of the data nodes in a cluster,
a first data node among the plurality of data nodes comprises a first operating system,
a second data node among the plurality of data nodes comprises a second operating system, and
the information identifies the first data node and the second data node; and

the request of the data further comprises
request data substantially simultaneously from a first data node and a second data node.

14. A non-transitory computer-readable storage medium storing programming instructions executable to
identify data stored in a plurality of computer systems, wherein
the plurality of computer systems comprises a plurality of data nodes,
the data is stored at one or more data nodes of the plurality of data nodes, and
at least one of the one or more data nodes are identified;

request the data, wherein
the request is performed by a proxy backup client of a plurality of proxy backup clients; and

perform a backup operation on the data, wherein
the backup operation is performed by at least two proxy backup clients of the plurality of proxy backup clients,
the backup operation is distributed among the at least two proxy backup clients based on two or more criteria among a plurality of criteria, wherein the criteria comprises at least two of
available bandwidth,
available processing power, or
proximity to one or more of the data nodes, and

the backup operation performed comprises
receiving at least a portion of the data at each of the at least two proxy backup clients, and
storing the portion of the data in a memory in each of the at least two proxy backup clients.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the programming instructions are further configured to:
request information about a location of the data, wherein the information identifies at least one of the data nodes.

16. The non-transitory computer-readable storage medium of claim 14 , wherein the programming instructions are further configured to:
invoke the plurality of prox

Assignees

• Veritas Technologies Llc

Inventors

• Paulzagade Sudhakar W
• Kulkarni Pradip M
• Jain Saurabh
• Karandikar Siddharth S

Classifications

• G06F17/30017

  Physics · mapped topic

• G06F11/1464 Primary

  for networked environments · CPC title

• G06F11/1453

  using de-duplication of the data · CPC title

• G06F11/1458

  Management of the backup or restore process · CPC title

• G06F16/40

  of multimedia data, e.g. slideshows comprising image and additional audio data (retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70) · CPC title