Migration of encoded data slices in a dispersed storage network

Patent metadata

Field	Value
Publication number	US-10037140-B2
Application number	US-201414452483-A
Country	US
Kind code	B2
Filing date	Aug 5, 2014
Priority date	Oct 3, 2013
Publication date	Jul 31, 2018
Grant date	Jul 31, 2018

Abstract

A method includes a processing module of a storage unit of a dispersed storage network (DSN) monitoring input/output (IO) rates of a plurality of disk drives, where access requests for encoded data slices occur at varying rates. The method continues with the processing module determining that the IO rate of a disk drive is exceeding a desired maximum IO rate and identifying a pending access request for an encoded data slice stored in the disk drive. The method continues with the processing module evaluating disk drive processing rates of other storage units that are storing other encoded data slices of a set of encoded data slices that includes the encoded data slice to determine whether the encoded data slice is needed to satisfy the pending access request. When the encoded data slice is needed, the method continues with the processing module migrating the encoded data slice to another disk drive.

First claim

What is claimed is:

1. A method for execution by one or more processing modules of a storage unit of a dispersed storage network (DSN), the method comprises:
monitoring input/output (IO) rates of a plurality of disk drives, wherein the storage unit stores a plurality of encoded data slices from a plurality of sets of encoded data slices in at least some of the plurality of disk drives, and wherein access requests for encoded data slices of the plurality of encoded data slices occur at varying rates;
determining that the IO rate of a first disk drive of the plurality of disk drives is exceeding a desired maximum IO rate;
identifying a pending access request for a first encoded data slice of the plurality of encoded data slices stored in the first disk drive, wherein the first encoded data slice is of a first set of encoded data slices of the plurality of sets of encoded data slices, and wherein a decode threshold number of encoded data slices of the first set of encoded data slices is needed to reconstruct a data segment;
evaluating disk drive processing rates of other storage units that are storing other encoded data slices of the first set of encoded data slices to determine whether the first encoded data slice is needed to satisfy the pending access request, wherein the evaluating the disk drive processing rates of the other storage units by:
receiving, from each of the other storage units, disk drive processing rates for each of a plurality of other disk drives;
identifying, for each of the other storage units, the disk drive processing rate of another disk drive of the plurality of other disk drives storing one of the other encoded data slices;
determining whether the decode threshold number of the plurality of other disk drives have an IO rate below the desired maximum IO rate;
when less than the decode threshold number of the plurality of other disk drives have an IO rate below the desired maximum IO rate, indicating that the first encoded data slice is needed; and
when the decode threshold number of the plurality of other disk drives have an IO rate below the desired maximum IO rate, indicating that the first encoded data slice is not needed; and

when the first encoded data slice is needed, migrating the first encoded data slice to another disk drive of the plurality of disk drives.

2. The method of claim 1 , wherein the identifying the pending access request comprises one or more of:
analyzing historical access request information regarding similar access requests to the pending access request; and
determining a likelihood of future similar access requests to the pending access request.

3. The method of claim 1 , wherein the identifying the pending access request comprises:
determining that multiple similar access requests to the pending access request are pending in an access request queue.

4. The method of claim 1 , wherein the evaluating the disk drive processing rates of the other storage units comprises:
sending requests for the disk drive processing rates to the other storage units, wherein one of the requests includes identity of the first encoded data slice or identity of one of the other encoded data slices.

5. The method of claim 1 further comprises:
when the first encoded data slice is not needed, deleting the pending access request for the first encoded data slice.

6. A computer readable non-transitory storage medium comprises:
at least one memory section that stores operational instructions that, when executed by one or more processing modules of a storage unit of a dispersed storage network (DSN), causes the storage unit to:
monitor input/output (IO) rates of a plurality of disk drives, wherein the storage unit stores a plurality of encoded data slices from a plurality of sets of encoded data slices in at least some of the plurality of disk drives, and wherein access requests for encoded data slices of the plurality of encoded data slices occur at varying rates;
determine that the IO rate of a first disk drive of the plurality of disk drives is exceeding a desired maximum IO rate;
identify a pending access request for a first encoded data slice of the plurality of data slices stored in the first disk drive, wherein the first encoded data slice is of a first set of encoded data slices of the plurality of sets of encoded data slices, and wherein a decode threshold number of encoded data slices of the first set of encoded data slices is needed to reconstruct a data segment;
evaluate disk drive processing rates of other storage units that are storing other encoded data slices of the first set of encoded data slices to determine whether the first encoded data slice is needed to satisfy the pending access request, wherein the disk drive processing rates of the other storage units are evaluated by:
receiving, from each of the other storage units, disk drive processing rates for each of a plurality of other disk drives;
identifying, for each of the other storage units, the disk drive processing rate of another disk drive of the plurality of other disk drives storing one of the other encoded data slices;
determining whether the decode threshold number of the plurality of other disk drives have an IO rate below the desired maximum IO rate;
when less than the decode threshold number of the plurality of other disk drives have an IO rate below the desired maximum IO rate, indicating that the first encoded data slice is needed; and
when the decode threshold number of the plurality of other disk drives have an IO rate below the desired maximum IO rate, indicating that the first encoded data slice is not needed; and

when the first encoded data slice is needed, migrate the first encoded data slice to another disk drive of the plurality of disk drives.

7. The computer readable non-transitory storage medium of claim 6 , wherein the one or more processing modules functions to execute the operational instructions stored by the at least one memory section to cause the one or more computing devices of the DSN to identify the pending access request by one or more of:
analyzing historical access request information regarding similar access requests to the pending access request; and
determining a likelihood of future similar access requests to the pending access request.

8. The computer readable non-transitory storage medium of claim 6 , wherein the one or more processing modules functions to execute the operational instructions stored by the at least one memory section to cause the one or more computing devices of the DSN to identify the pending access request by:
determining that multiple similar access requests to the pending access request are pending in an access request queue.

9. The computer readable non-transitory storage medium of claim 6 , wherein the one or more processing modules functions to execute the operational instructions stored by the at least one memory section to cause the one or more computing devices of the DSN to evaluate the disk drive processing rates of the other storage units by:
sending requests for the disk drive processing rates to the other storage units, wherein one of the requests includes identity of the first encoded data slice or identity of one of the other encoded data slices.

10. The computer readable non-transitory storage medium of claim 6 further comprises:
the at least one memory section stores further operational instructions that, when executed by the one or more processing modules, causes the one or more computing devices of the DSN to:
when the first encoded data slice is not needed, delete the pending access request for the first encoded data slice.

11. A storage unit of a dispersed storage network (DSN), th

Assignees

• Cleversafe Inc
• IBM

Inventors

• Baptist Andrew
• Kaczmarek Joseph Martin

Classifications

• G06F16/10

  File systems; File servers · CPC title

• G06F3/0619

  in relation to data integrity, e.g. data losses, bit errors · CPC title

• G06F3/064

  Management of blocks · CPC title

• G06F16/182

  Distributed file systems · CPC title

• G06F21/6272

  by registering files or documents with a third party · CPC title