Techniques for dynamically allocating resources in a storage cluster system

Patent metadata

Field	Value
Publication number	US-11075852-B2
Application number	US-201916716798-A
Country	US
Kind code	B2
Filing date	Dec 17, 2019
Priority date	Feb 27, 2015
Publication date	Jul 27, 2021
Grant date	Jul 27, 2021

Abstract

Various embodiments are directed to techniques for dynamically adjusting a maximum rate of throughput for accessing data stored within a volume of storage space of a storage cluster system based on the amount of that data that is stored within that volume. An apparatus includes an access component to monitor an amount of client data stored within a volume defined within a storage device coupled to a first node, and to perform a data access command received from a client device via a network to alter the client data stored within the volume; and a policy component to limit a rate of throughput at which at least the client data within the volume is exchanged as part of performance of the data access command to a maximum rate of throughput, and to calculate the maximum rate of throughput based on the stored amount.

First claim

The invention claimed is:

1. A method, comprising:
monitoring an amount of client data, stored within a volume maintained within a storage device by a node, in relation to a storage limit of storage capacity specified for the volume;
performing deduplication upon the volume to reduce duplicate portions of the client data within the volume; and
temporarily expanding a size of the volume by increasing the storage limit of storage capacity specified for the volume to create an increased storage limit for the volume to enable storage of an instance of client data within the volume beyond the storage limit.

2. The method of claim 1 , wherein the storage device comprises a sync cache, and wherein the method comprises:
deduplicating metadata within the sync cache.

3. The method of claim 1 , wherein the storage device comprises a sync cache, and wherein the method comprises:
synchronizing the sync cache of the node with a second sync cache of a second node.

4. The method of claim 1 , comprising:
maintaining a block table indicating what blocks of client data are identical.

5. The method of claim 1 , comprising:
maintaining a block table indicating that a block of client data corresponds to multiple identical blocks of the client data.

6. The method of claim 5 , comprising:
utilizing the block table to retrieve the block in response to a request to retrieve one of the multiple identical blocks from the volume.

7. The method of claim 1 , comprising:
creating an indication that client data stored within the volume exceeds the storage limit of storage capacity specified within configuration data for the volume.

8. A non-transitory machine-readable storage medium comprising instructions that when executed by a machine, cause the machine to:
monitor an amount of client data, stored within a volume maintained by a node, in relation to a storage limit of storage capacity specified for the volume within configuration data for the volume;
perform deduplication upon the volume to reduce duplicate portions of the client data within the volume to enable storage of client data within the volume beyond the storage limit; and
in response to the deduplication reducing duplicate portions of the client data, increase the storage limit to temporarily expand a size of the volume to accommodate a specified amount of extra storage space for processing an incoming command.

9. The non-transitory machine-readable storage medium of claim 8 , wherein the instructions cause the machine to:
replicate data from the volume to a second volume.

10. The non-transitory machine-readable storage medium of claim 9 , wherein the instructions cause the machine to:
identify a replication error based upon the volume and the second volume comprising differing amounts of data.

11. The non-transitory machine-readable storage medium of claim 8 , wherein the instructions cause the machine to:
expand the size of the volume in response to determining that performance of a command would increase client data within the volume beyond the storage limit of storage capacity.

12. The non-transitory machine-readable storage medium of claim 11 , wherein the volume is expanded subsequent performing the deduplication.

13. The non-transitory machine-readable storage medium of claim 8 , wherein the instructions cause the machine to:
limit client data exchange between the client and the node based upon a quality of service parameter.

14. The non-transitory machine-readable storage medium of claim 8 , wherein the instructions cause the machine to:
limit client data exchange between the client and the node based upon a component parameter.

15. A computing device comprising:
a memory comprising instructions for performing a method; and
a processor coupled to the memory, the processor configured to execute the instructions to cause the processor to:
monitor an amount of client data, stored within a volume maintained by a node, in relation to a storage limit of storage capacity specified for the volume;
perform deduplication upon the volume to reduce duplicate portions of the client data within the volume to enable storage of client data within the volume beyond the storage limit;
expand a size of the volume, subsequent the deduplication, in response to a determination that execution of a command would increase client data within the volume beyond the storage limit of storage capacity;
replicate data from the volume to a second volume; and
identify a replication error based upon the volume and the second volume comprising differing amounts of data.

16. The computing device of claim 15 , wherein the instructions cause the processor to:
maintain a block table indicating what blocks of client data are identical.

17. The computing device of claim 16 , wherein the instructions cause the processor to:
maintain a block table indicating that a block of client data corresponds to multiple identical blocks of the client data.

18. The computing device of claim 15 , wherein the instructions cause the processor to:
limit client data exchange between the client and the node based upon a quality of service parameter.

19. The computing device of claim 15 , wherein the instructions cause the processor to:
limit client data exchange between the client and the node based upon a component parameter.

20. The computing device of claim 15 , wherein the instructions cause the processor to:
limit client data exchange between the client and the node based upon an application parameter.

Assignees

• Netapp Inc

Inventors

• Miller Evan

Classifications

• H04L67/565

  Conversion or adaptation of application format or content (adding application control or application functional data H04L67/561) · CPC title

• H04L47/805 Primary

  QOS or priority aware · CPC title

• H04L67/1008

  based on parameters of servers, e.g. available memory or workload (monitoring of computer activity G06F11/30) · CPC title

• H04L67/1097

  for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS] · CPC title

• H04L47/225

  Determination of shaping rate, e.g. using a moving window · CPC title