Asymmetric storage data distribution

Patent metadata

Field	Value
Publication number	US-10983707-B2
Application number	US-201916666300-A
Country	US
Kind code	B2
Filing date	Oct 28, 2019
Priority date	Feb 8, 2016
Publication date	Apr 20, 2021
Grant date	Apr 20, 2021

Abstract

Aspects include defining a first percentage of storage areas in an array of multiple persistent storage elements as hot storage areas and a second percentage of storage areas as spare storage areas such that remaining storage areas define a third percentage as cold storage areas. Each of the storage areas are assigned to either the hot group, the spare group or the cold group, respectively. A hot and cold storage area each include a first storage block on two different storage elements, and the hot storage area and the cold storage area each include a corresponding second storage block on a storage element different to the storage element on which the first respective storage block is stored. The storage blocks are distributed across the storage elements such that blocks of storage areas with the highest write rate of all storage areas are placed on a hottest storage element.

First claim

What is claimed is:

1. A system comprising:
an array of multiple persistent storage devices that includes a General Parallel File System (GPFS) and includes storage areas for storing data, the storage areas distributed across all of the multiple persistent storage devices of the array, each of the storage devices having a plurality of storage stripes, wherein each of the plurality of storage stripes comprises a storage block and wherein each stripe inhabits each device of the array;
a memory device having computer readable instructions; and
a processor coupled with the memory device, the processor configured to execute the computer readable instructions to perform a method comprising:
defining a first percentage of said storage areas as hot storage areas and defining a second percentage of said storage areas as spare storage areas such that remaining storage areas define a third percentage as cold storage areas such that a hot group of hot storage areas, a spare group of spare storage areas and a cold group of cold storage areas are built;
assigning each of said storage areas to either said hot group, said spare group or said cold group, respectively, wherein a hot storage area and a cold storage area each comprise a first storage block on two different storage devices, and wherein said hot storage area and said cold storage area each comprise a corresponding second storage block on a storage device different to said storage device on which said first respective storage block is stored;
distributing said storage blocks across said storage devices such that blocks of storage areas with the highest write rate of all storage areas are placed on a hottest storage device;
defining at least one logical unit comprising a plurality of storage areas; and
providing access to said at least one logical unit to store data.

2. The system according to claim 1 , wherein said storage areas are organized as a redundant array of independent disks.

3. The system according to claim 1 , wherein said storage blocks are all of equal size.

4. The system according to claim 1 , wherein a total number of write accesses to at least one of each of said storage areas and each of said storage devices are tracked.

5. The system according to claim 4 , wherein the method further comprises:
upon determining that said total number of write accesses to a storage device exceeds a predefined threshold value, moving said blocks being stored on said storage device to blocks of said spare storage areas.

6. The system according to claim 4 , wherein the method further comprises:
upon determining that a storage area in which blocks are not located on said hottest storage device has a higher write rate than any of said blocks of storage areas located on said hottest storage device, moving one block of that storage area to said hottest storage device.

7. The system according to claim 6 , wherein the method further comprises:
prior to moving said one block of that storage area having a higher write rate than any of said blocks of storage areas located on said hottest storage device to said hottest storage device, moving a block of a storage area having a lowest write access rate of blocks on said hottest storage device to one of said spare storage areas.

8. The system according to claim 7 , wherein the method further comprises:
marking said one block that has been moved to said hottest storage device as belonging to said spare group.

9. The system according to claim 1 , wherein the method further comprises providing a notification to replace storage device determined to fail before an actual failure of the storage device occurs.

10. The system according to claim 1 , wherein the method further comprises receiving, from a system administrator of the system, a first percentage of said storage areas to be defined as hot storage areas and a second percentage of said storage areas to be defined as spare storage areas.

11. A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform a method for operating an array of multiple persistent storage devices, said method comprising:
storing, in the array, which includes a General Parallel File System (GPFS), data in storage areas that are distributed across said storage devices of the array, each of the storage devices having a plurality of storage stripes, wherein each of the plurality of storage stripes comprises a storage block and wherein each stripe inhabits each device of the array;
defining a first percentage of said storage areas as hot storage areas and defining a second percentage of said storage areas as spare storage areas such that remaining storage areas define a third percentage as cold storage areas such that a hot group of hot storage areas, a spare group of spare storage areas and a cold group of cold storage areas are built;
assigning each of said storage areas to either said hot group, said spare group or said cold group, respectively, wherein a hot storage area and a cold storage area each comprise a first storage block on two different storage devices, and wherein said hot storage area and said cold storage area each comprise a corresponding second storage block on a storage device different to said storage device on which said first respective storage block is stored;
distributing said storage blocks across said storage devices such that blocks of storage areas with the highest write rate of all storage areas are placed on a hottest storage device;
defining at least one logical unit comprising a plurality of storage areas; and
providing access to said at least one logical unit to store data.

12. The computer program product according to claim 11 , wherein said storage areas are organized as a redundant array of independent disks.

13. The computer program product according to claim 11 , wherein said storage blocks are all of equal size.

14. The computer program product of claim 11 , wherein a total number of write accesses to at least one of each of said storage areas and each of said storage devices are tracked.

15. A method for operating an array of multiple persistent storage devices, said method comprising:
storing, in the array, which includes a General Parallel File System (GPFS), data in storage areas that are distributed across said storage devices of the array, each of the storage devices having a plurality of storage stripes, wherein each of the plurality of storage stripes comprises a storage block and wherein each stripe inhabits each device of the array;
defining a first percentage of said storage areas as hot storage areas and defining a second percentage of said storage areas as spare storage areas such that remaining storage areas define a third percentage as cold storage areas such that a hot group of hot storage areas, a spare group of spare storage areas and a cold group of cold storage areas are built;
assigning each of said storage areas to either said hot group, said spare group or said cold group, respectively, wherein a hot storage area and a cold storage area each comprise a first storage block on two different storage devices, and wherein said hot storage area and said cold storage area each comprise a corresponding second storage block on a storage device different to said storage device on which said first respective storage block is stored;
distributing said storage blocks across said storage devices such that blocks of storage areas with the highest write rate of all storage areas are placed on a hottest storage devi

Assignees

• IBM

Inventors

• Kraemer Marco
• Otte Carsten
• Raisch Christoph

Classifications

• G06F3/0649 Primary

  Lifecycle management · CPC title

• G06F3/0689

  Disk arrays, e.g. RAID, JBOD · CPC title

• G06F3/0614

  Improving the reliability of storage systems · CPC title

• G06F3/061

  Improving I/O performance · CPC title

• G06F3/0619 Primary

  in relation to data integrity, e.g. data losses, bit errors · CPC title