Method, device, and computer program product for storage management

Patent metadata

Field	Value
Publication number	US-11287993-B2
Application number	US-202016748300-A
Country	US
Kind code	B2
Filing date	Jan 21, 2020
Priority date	Oct 21, 2019
Publication date	Mar 29, 2022
Grant date	Mar 29, 2022

Abstract

Techniques involve: determining corresponding valid metadata rates of a plurality of metadata blocks stored in a metadata storage area of a storage system, the valid metadata rate of each metadata block indicating a ratio of valid metadata in the metadata block to all metadata in the metadata block; selecting a predetermined number of metadata blocks having a valid metadata rate lower than a first valid metadata rate threshold from the plurality of metadata blocks; storing valid metadata in the predetermined number of metadata blocks into at least one metadata block following the plurality of metadata blocks in the metadata storage area; and making the valid metadata in the predetermined number of metadata blocks invalid. Accordingly, such techniques can improve the efficiency of the storage system.

First claim

The invention claimed is:

1. A method for storage management, comprising:
determining corresponding valid metadata rates of a plurality of metadata blocks stored in a metadata storage area of a storage system, the valid metadata rate of each metadata block indicating a ratio of valid metadata in the metadata block to all metadata in the metadata block;
selecting a predetermined number of metadata blocks having a valid metadata rate lower than a first valid metadata rate threshold from the plurality of metadata blocks;
storing valid metadata in the predetermined number of metadata blocks into at least one metadata block following the plurality of metadata blocks in the metadata storage area; and
making the valid metadata in the predetermined number of metadata blocks invalid;

wherein storing valid metadata in the predetermined number of metadata blocks into the at least one metadata block comprises:
comparing the total amount of the valid metadata in the predetermined number of metadata blocks with a metadata amount threshold;
generating, according to the total amount of the valid metadata being lower than the metadata amount threshold, at least one merged metadata block based on the valid metadata in the predetermined number of metadata blocks, the number of the at least one merged metadata block being less than the predetermined number; and
storing the at least one merged metadata block into at least one metadata block following the plurality of metadata blocks.

2. The method of claim 1 , wherein determining the corresponding valid metadata rates comprises:
determining a utilization rate of the metadata storage area, the utilization rate indicating a ratio of a space in which metadata blocks are stored in the metadata storage area to the total space in the metadata storage area; and
determining the corresponding valid metadata rates according to determining that the utilization rate exceeds a utilization rate threshold.

3. The method of claim 1 , wherein the storage system comprises a plurality of storage strips providing redundant storage, metadata for the plurality of storage strips being stored in a memory in association with the storage system as a plurality of entries, each of the plurality of entries being written into at least one of the plurality of metadata blocks by at least one transaction, wherein determining the corresponding valid metadata rates comprises:
for a given metadata block in the plurality of metadata blocks,
determining at least one entry included in the given metadata block;
identifying, according to determining that the transaction for writing the at least one entry into the given metadata block is the latest transaction for the at least one entry, the at least one entry as valid metadata of the given metadata block; and
determining a ratio of the valid metadata to all metadata in the metadata block as a valid metadata rate of the given metadata block.

4. The method of claim 1 , wherein storing valid metadata in the predetermined number of metadata blocks into the at least one metadata block further comprises:
copying, according to determining that the total amount of the valid metadata exceeds the metadata amount threshold, the predetermined number of metadata blocks to a position following the plurality of metadata blocks.

5. The method of claim 1 , further comprising:
after storing valid metadata in the predetermined number of metadata blocks into the at least one metadata block,
determining a starting metadata block, of which the valid metadata rate exceeds a second valid metadata rate threshold, stored in the metadata storage area;
updating a header address pointing to the metadata storage area in address information for indexing the metadata storage area to an address of the starting metadata block;
determining an ending metadata block stored in the metadata storage area; and
updating a tail address pointing to the metadata storage area in the address information to an address of the ending metadata block.

6. The method of claim 1 , wherein selecting the predetermined number of metadata blocks includes:
after the valid metadata rates have been determined, selecting metadata blocks having the lowest valid metadata rates until the predetermined number of metadata blocks has been selected.

7. The method of claim 6 , further comprising:
after the valid metadata rates have been determined and prior to selecting the predetermined number of metadata blocks, sorting at least some of the valid metadata rates.

8. A device for storage management, comprising:
at least one processing unit; and
at least one memory coupled to the at least one processing unit and storing instructions to be executed by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the device to perform an action, the action comprising:
determining corresponding valid metadata rates of a plurality of metadata blocks stored in a metadata storage area of a storage system, the valid metadata rate of each metadata block indicating a ratio of valid metadata in the metadata block to all metadata in the metadata block;
selecting a predetermined number of metadata blocks having a valid metadata rate lower than a first valid metadata rate threshold from the plurality of metadata blocks;
storing valid metadata in the predetermined number of metadata blocks into at least one metadata block following the plurality of metadata blocks in the metadata storage area; and
making the valid metadata in the predetermined number of metadata blocks invalid;

wherein storing valid metadata in the predetermined number of metadata blocks into the at least one metadata block comprises:
comparing the total amount of the valid metadata in the predetermined number of metadata blocks with a metadata amount threshold;
generating, according to the total amount of the valid metadata being lower than the metadata amount threshold, at least one merged metadata block based on the valid metadata in the predetermined number of metadata blocks, the number of the at least one merged metadata block being less than the predetermined number; and
storing the at least one merged metadata block into at least one metadata block following the plurality of metadata blocks.

9. The device of claim 8 , wherein determining the corresponding valid metadata rates comprises:
determining a utilization rate of the metadata storage area, the utilization rate indicating a ratio of a space in which metadata blocks are stored in the metadata storage area to the total space in the metadata storage area; and
determining the corresponding valid metadata rates according to determining that the utilization rate exceeds a utilization rate threshold.

10. The device of claim 8 , wherein the storage system comprises a plurality of storage strips providing redundant storage, metadata for the plurality of storage strips being stored in a memory in association with the storage system as a plurality of entries, each of the plurality of entries being written into at least one of the plurality of metadata blocks by at least one transaction, wherein determining the corresponding valid metadata rates comprises:
for a given metadata block in the plurality of metadata blocks,
determining at least one entry included in the given metadata block;
identifying, according to determining that the transaction for writing the at least one entry into the given metadata block is the latest transaction for the at least one entry, the at least one entry as valid metadata of the given metadata block; and
determining a ratio of the valid metadata to all metadata in the metadata block as a valid metadat

Assignees

• Emc Ip Holding Co Llc

Inventors

• Gong Shaoqin
• Dong Jibing
• Gao Hongpo
• Kang Jianbin
• Zhuo Baote

Classifications

• G06F3/0638

  Organizing or formatting or addressing of data · CPC title

• G06F3/0653

  Monitoring storage devices or systems · CPC title

• G06F3/0671

  In-line storage system · CPC title

• G06F3/0619

  in relation to data integrity, e.g. data losses, bit errors · CPC title

• G06F3/064 Primary

  Management of blocks · CPC title