Method, electronic device and computer readable storage medium of storage management

Patent metadata

Field	Value
Publication number	US-11210022-B2
Application number	US-201916582630-A
Country	US
Kind code	B2
Filing date	Sep 25, 2019
Priority date	Oct 31, 2018
Publication date	Dec 28, 2021
Grant date	Dec 28, 2021

Abstract

Techniques involve: determining processing power of a plurality of storage devices in a plurality of storage pools, the storage devices in each of the storage pools having a same device type; dividing the plurality of storage devices into a plurality of sets based on the processing power, a difference in the processing power between the storage devices in each of the sets being below a predetermined threshold; and redistributing, among the plurality of sets, data stored in the plurality of storage devices based on workloads of the storage devices in the sets. Accordingly, load balancing of storage devices in the plurality of storage pools can be implemented, response speed of the storage system can be enhanced and storage resources in the plurality of storage pools can be exploited more sufficiently.

First claim

We claim:

1. A method of storage management, comprising:
determining processing power of a plurality of storage devices in a plurality of storage pools, the storage devices in each of the storage pools having a same device type;
dividing the plurality of storage devices into a plurality of sets based on the processing power, a difference in the processing power between the storage devices in each of the sets being below a predetermined threshold;
redistributing, among the plurality of sets, data stored in the plurality of storage devices based on workloads of the storage devices in the sets; and
determining the workload for a given storage device by:
acquiring a historical workload of the given storage device;
determining the highest processing power of the storage devices in the plurality of sets; and
obtaining the workload by calibrating the historical workload based on the highest processing power, the processing power of the given storage device, and a device type of the given storage device.

2. The method of claim 1 , wherein determining the processing power comprises:
acquiring the device type of the storage devices;
acquiring a data type of data in the storage devices; and
determining the processing power of the storage devices based on the data type and the device type.

3. The method of claim 1 , wherein acquiring the historical workload of the given storage device comprises determining the historical workload of the given storage device based on at least one of:
the number of data access requests for the given storage device;
the number of data related to access to the given storage device; and
a response time of the given storage device.

4. The method of claim 1 , wherein redistributing the data comprises:
selecting, from the plurality of sets, a first set of storage devices having a workload above an upper threshold;
selecting, from the plurality of sets, a second set of storage devices having a workload below a lower threshold; and
moving partial data stored in the first set of storage devices to the second set of storage devices.

5. The method of claim 1 , further comprising:
for storage devices in at least one set of the plurality of sets:
determining an average value of workloads of the storage devices; and
in response to a first storage device in the at least one set having a workload that is higher than the average value by an amount exceeding a fifth threshold, moving partial data in the first storage device to a second storage device in the at least one set having a workload that is lower than the average value by an amount exceeding a sixth threshold.

6. A method of storage management, comprising:
determining processing power of a plurality of storage devices in a plurality of storage pools, the storage devices in each of the storage pools having a same device type;
dividing the plurality of storage devices into a plurality of sets based on the processing power, a difference in the processing power between the storage devices in each of the sets being below a predetermined threshold; and
redistributing, among the plurality of sets, data stored in the plurality of storage devices based on workloads of the storage devices in the sets;
wherein redistributing the data comprises:
selecting, from the plurality of sets, a first set of storage devices having a workload above an upper threshold;
selecting, from the plurality of sets, a second set of storage devices having a workload below a lower threshold; and
moving partial data stored in the first set of storage devices to the second set of storage devices; and
wherein moving the data comprises:
determining a first average value of workloads of the first set of storage devices;
selecting, from the first set of storage devices, a first subset of storage devices having a workload that is higher than the first average value by an amount exceeding a first threshold;
determining a second average value of workloads of the second set of storage devices;
selecting, from the second set of storage devices, a second subset of storage devices having a workload that is lower than the second average value by an amount exceeding a second threshold; and
moving partial data stored in the first subset to the second subset.

7. The method of claim 6 , wherein moving the data comprises:
determining first processing power and second processing power corresponding to storage devices in the first subset and in the second subset, respectively;
selecting source data from stripe data related to the first subset based on the first processing power and the second processing power; and
moving the source data to the second subset.

8. The method of claim 7 , wherein selecting the source data comprises:
determining a third average value of workloads of storage extents corresponding to the stripe data related to the first subset;
in response to the first processing power being higher than the second processing power, selecting first stripe data from the stripe data as the source data, the storage extents corresponding to the first stripe data having a workload that is lower than the third average value by an amount exceeding a third threshold; and
in response to the first processing power being lower than the second processing power, selecting second stripe data from the stripe data as the source data, the storage extents corresponding to the second stripe data having a workload that is higher than the third average value by an amount exceeding a fourth threshold.

9. The method of claim 7 , further comprising:
in response to a lack of storage extents available for the source data in the second subset, determining, from remaining storage devices in the second set of storage devices, a third storage device having the lowest workload among the remaining storage devices; and
moving the source data to the third storage device.

10. An electronic device, comprising:
at least one processor;
a memory coupled to the at least one processor and having instructions stored thereon, the instructions, when executed by the at least one processor, causing the device to perform acts comprising:
determining processing power of a plurality of storage devices in a plurality of storage pools, the storage devices in each of the storage pools having a same device type;
dividing the plurality of storage devices into a plurality of sets based on the processing power, a difference in the processing power between the storage devices in each of the sets being below a predetermined threshold;
redistributing, among the plurality of sets, data stored in the plurality of storage devices based on workloads of the storage devices in the sets; and
determining the workload for a given storage device by:
acquiring a historical workload of the given storage device;
determining the highest processing power of the storage devices in the plurality of sets; and
obtaining the workload by calibrating the historical workload based on the highest processing power, the processing power of the given storage device, and a device type of the given storage device.

11. The device of claim 10 , wherein determining the processing power comprises:
acquiring the device type of the storage devices;
acquiring a data type of data in the storage devices; and
determining the processing power of the storage devices based on the data type and the device type.

12. The device of claim 10 , wherein acquiring the historical workload of the given storage device comprises determining the historical workload of the given storage device based on at least one of:
the number of data access requests for the given storage device;
the nu

Assignees

• Emc Ip Holding Co Llc

Inventors

• Ma Chun
• Gong Shaoqin
• Han Geng
• Gao Jian
• Xu Xinlei

Classifications

• G06F3/0673

  Single storage device · CPC title

• G06F3/0613

  in relation to throughput · CPC title

• G06F3/061 Primary

  Improving I/O performance · CPC title

• G06F3/0634

  by changing the state or mode of one or more devices · CPC title

• G06F3/0647

  Migration mechanisms · CPC title