Method, apparatus and computer program product for managing metadata migration

Patent metadata

Field	Value
Publication number	US-11226778-B2
Application number	US-202016821404-A
Country	US
Kind code	B2
Filing date	Mar 17, 2020
Priority date	Apr 30, 2019
Publication date	Jan 18, 2022
Grant date	Jan 18, 2022

Abstract

Techniques manage metadata. Such techniques involve: in response to receiving a request for accessing metadata in a first page, determining, from a plurality of storage units including pages for storing metadata, a storage unit where the first page is located, the plurality of storage units including a first storage unit and a second storage unit, an access speed of the second storage unit exceeding an access speed of the first storage unit; accessing, from the determined storage unit, the first page for metadata; in response to the first page being accessed from the first storage unit, determining whether hotness of the first page exceeds a threshold level; and in response to the hotness of the first page exceeding the threshold level, transferring the first page from the first storage unit to the second storage unit. Accordingly, such techniques can improve the efficiency for accessing the metadata.

First claim

We claim:

1. A method of managing metadata, comprising:
in response to receiving a request for accessing metadata in a first page, determining, from a plurality of storage units including pages for storing metadata, a storage unit where the first page is located, the plurality of storage units comprising a first storage unit and a second storage unit, an access speed of the second storage unit exceeding an access speed of the first storage unit;
accessing, from the determined storage unit, the first page for metadata;
in response to the first page being accessed from the first storage unit, determining that hotness of the first page exceeds a threshold level; and
in response to the hotness of the first page exceeding the threshold level, transferring the first page from the first storage unit to the second storage unit,
wherein determining that the hotness of the first page exceeds the threshold level comprises:
counting, within a time window of duration W, a number of times the first page is accessed from the first storage unit; and
resetting the counting to zero in response the first page being accessed two consecutive times separated by more than W.

2. The method of claim 1 , wherein determining the storage unit where the first page is located comprises:
acquiring a first index structure for recording index information of pages in the second storage unit;
determining, from the request, first index information of the first page; and
in response to determining that the first index information is recorded in the first index structure, determining that the first page is located in the second storage unit.

3. The method of claim 2 , further comprising:
in response to determining that the first index information is absent in the first index structure, determining that the first page is located in the first storage unit.

4. The method of claim 1 , wherein accessing the first page from the determined storage unit comprises:
in response to determining that the first page is located in the second storage unit, accessing the first page from the second storage unit; and
in response to determining that the first page is located in the first storage unit, accessing the first page from the first storage unit.

5. The method of claim 1 , wherein determining that the hotness of the first page exceeds the threshold level further comprises:
in response to a count produced by the counting exceeding a first threshold number, determining that the hotness of the first page exceeds the threshold level.

6. The method of claim 2 , wherein transferring the first page from the first storage unit to the second storage unit comprises:
acquiring a second index structure for recording index information of pages to be transferred from the first storage unit to the second storage unit;
determining that the first index information is not recorded in the second index structure; and
in response to determining that the first index information is absent in the second index structure, recording the first index information in the second index structure.

7. The method of claim 6 , further comprising:
in response to determining that the second index structure includes index information of at least one page to be transferred, transferring the at least one page from the first storage unit to the second storage unit; and
transferring the index information of the at least one page from the second index structure to the first index structure.

8. The method of claim 1 , wherein the second storage unit includes a set of pages, and the method further comprises:
in response to the number of the set of pages exceeding a second threshold number, determining, from the set of pages, a second page to be transferred from the second storage unit to the first storage unit; and
transferring the second page from the second storage unit to the first storage unit.

9. The method of claim 8 , wherein determining the second page comprises:
selecting, from the set of pages, a least recently accessed page as the second page.

10. An apparatus for managing metadata, comprising:
at least one processing unit; and
at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the apparatus to perform acts comprising:
in response to receiving a request for accessing metadata in a first page, determining, from a plurality of storage units including pages for storing metadata, a storage unit where the first page is located, the plurality of storage units comprising a first storage unit and a second storage unit, an access speed of the second storage unit exceeding an access speed of the first storage unit;
accessing, from the determined storage unit, the first page for metadata;
in response to the first page being accessed from the first storage unit, determining whether hotness of the first page exceeds a threshold level; and
in response to the hotness of the first page exceeding the threshold level, transferring the first page from the first storage unit to the second storage unit,
wherein determining whether the hotness of the first page exceeds the threshold level comprises:
counting, within a time window of duration W, a number of times the first page is accessed from the first storage unit; and
resetting the counting to zero in response the first page being accessed two consecutive times separated by more than W.

11. The apparatus of claim 10 , wherein determining the storage unit where the first page is located comprises:
acquiring a first index structure for recording index information of pages in the second storage unit;
determining, from the request, first index information of the first page; and
in response to determining that the first index information is recorded in the first index structure, determining that the first page is located in the second storage unit.

12. The apparatus of claim 11 , wherein the acts further comprise:
in response to determining that the first index information is absent in the first index structure, determining that the first page is located in the first storage unit.

13. The apparatus of claim 10 , wherein accessing the first page from the determined storage unit comprises:
in response to determining that the first page is located in the second storage unit, accessing the first page from the second storage unit; and
in response to determining that the first page is located in the first storage unit, accessing the first page from the first storage unit.

14. The apparatus of claim 10 , wherein determining whether the hotness of the first page exceeds the threshold level further comprises:
in response to a count produced by the counting exceeding a first threshold number, determining that the hotness of the first page exceeds the threshold level.

15. The apparatus of claim 11 , wherein transferring the first page from the first storage unit to the second storage unit comprises:
acquiring a second index structure for recording index information of pages to be transferred from the first storage unit to the second storage unit;
determining whether the first index information is recorded in the second index structure; and
in response to determining that the first index information is absent in the second index structure, recording the first index information in the second index structure.

16. The apparatus of claim 15 , wherein the acts further comprise:
in response to determining that the second index structure incl

Assignees

• Emc Ip Holding Co Llc

Inventors

• Zhao Zhenhua
• Xia Sihang
• Feng Changyu
• Xu Xinlei

Classifications

• G06F3/0689

  Disk arrays, e.g. RAID, JBOD · CPC title

• G06F16/164 Primary

  File meta data generation · CPC title

• G06F3/0649

  Lifecycle management · CPC title

• G06F3/061

  Improving I/O performance · CPC title

• G06F3/0611 Primary

  in relation to response time · CPC title