Auto adaptive deduplication to cloud based storage

Patent metadata

Field	Value
Publication number	US-9384205-B1
Application number	US-201314133212-A
Country	US
Kind code	B1
Filing date	Dec 18, 2013
Priority date	Dec 18, 2013
Publication date	Jul 5, 2016
Grant date	Jul 5, 2016

Abstract

A computer-implemented method for managing an inline deduplication module is described. Congestion information is collected about a level of congestion on a network that communicates with an inline deduplication module. An instruction is sent to the inline deduplication module to adjust a deduplication rate based at least in part on the congestion information.

First claim

What is claimed is:

1. A computer-implemented method for managing an inline deduplication module, comprising:
collecting congestion information about a level of congestion experienced by one or more external computing devices when sending data on a network, wherein the network communicates with the inline deduplication module;
determining from the collected congestion information a wait time before the inline deduplication module is able to send deduplicated data over the network due to the level of congestion on the network experienced by the one or more external computing devices;
sending an instruction to the inline deduplication module to adjust a deduplication rate based at least in part on the determined wait time;
wherein the instruction includes a command for the inline deduplication module to increase a search time of an existing process to look for a data segment signature when the determined wait time indicates a delay; and
wherein the instruction includes a command for the inline deduplication module to decrease a search time of the existing process to look for a data segment signature when the determined wait time indicates no delay.

2. The method of claim 1 , wherein the instruction includes a command for the inline deduplication module to decrease a number of transaction counts associated with looking for a data segment signature.

3. The method of claim 1 , wherein the instruction includes a command for the inline deduplication module to increase a number of transaction counts associated with looking for a data segment signature.

4. The method of claim 1 , wherein collecting the congestion information about the level of congestion comprises:
collecting the congestion information from on-premise devices that are sending data through the inline deduplication module over a communication channel.

5. The method of claim 4 , wherein the communication channel is independent of the network.

6. The method of claim 1 , wherein the network is a cloud based storage network.

7. The method of claim 1 , wherein the congestion information includes at least one of a count of on-premise devices utilizing the network, classifications of on-premise devices using the network, priorities, types of transfers, and types of resources used.

8. A computing device configured for managing an inline deduplication module, comprising:
a processor;
memory in electronic communication with the processor; and
instructions stored in the memory, the instructions being executable by the processor to:
collect congestion information about a level of congestion experienced by one or more external computing devices when sending data on a network, wherein the network communicates with the inline deduplication module;
determine from the collected congestion information a wait time before the inline deduplication module is able to send deduplicated data over the network due to the level of congestion on the network experienced by the one or more external computing devices;
send an instruction to the inline deduplication module to adjust a deduplication rate based at least in part on the determined wait time;
wherein the instruction includes a command for the inline deduplication module to increase a search time of an existing process to look for a data segment signature when the determined wait time indicates a delay; and
wherein the instruction includes a command for the inline deduplication module to decrease a search time of the existing process to look for a data segment signature when the determined wait time indicates no delay.

9. The computing device of claim 8 , wherein the instruction includes a command for the inline deduplication module to adjust a number of transaction counts associated with looking for a data segment signature.

10. The computing device of claim 8 , wherein the instructions are further executable by the processor to collect the congestion information from on-premise devices that are sending data through the inline deduplication module over a communication channel.

11. The computing device of claim 10 , wherein the communication channel is independent of the network.

12. The computing device of claim 8 , wherein the network is a cloud based storage network.

13. The computing device of claim 8 , wherein the congestion information includes at least one of a count of on-premise devices utilizing the network, classifications of on-premise devices using the network, priorities, types of transfers, and types of resources used.

14. A computer-program product for managing an inline deduplication module, the computer-program product comprising a non-transitory computer-readable medium having instructions thereon, the instructions being executable by a processor to:
collect congestion information about a level of congestion experienced by one or more external computing devices when sending data on a network, wherein the network communicates with the inline deduplication module;
determine from the collected congestion information a wait time before the inline deduplication module is able to send deduplicated data over the network due to the level of congestion on the network experienced by the one or more external computing devices;
send an instruction to the inline deduplication module to adjust a deduplication rate based at least in part on the determined wait time;
wherein the instruction includes a command for the inline deduplication module to increase a search time of an existing process to look for a data segment signature when the determined wait time indicates a delay; and
wherein the instruction includes a command for the inline deduplication module to decrease a search time of the existing process to look for a data segment signature when the determined wait time indicates no delay.

15. The computer-program product of claim 14 , wherein the instruction includes a command for the inline deduplication module to adjust a number of transaction counts associated with looking for a data segment signature.

Assignees

• Veritas Technologies Llc

Inventors

• Gipp Stephan
• Wartnick Jeremy

Classifications

• G06F16/1748 Primary

  De-duplication implemented within the file system, e.g. based on file segments (de-duplication techniques in storage systems for the management of data blocks G06F3/0641) · CPC title

• G06F16/152

  using file content signatures, e.g. hash values · CPC title

• G06F16/174

  Redundancy elimination performed by the file system (error detection or correction of the data by redundancy in operations G06F11/14) · CPC title

• G06F16/1752

  based on file chunks · CPC title

• G06F16/245

  Query processing · CPC title