Data processing method and related apparatus

Patent metadata

Field	Value
Publication number	US-12530126-B2
Application number	US-202418647440-A
Country	US
Kind code	B2
Filing date	Apr 26, 2024
Priority date	Oct 29, 2021
Publication date	Jan 20, 2026
Grant date	Jan 20, 2026

Abstract

A task processing method comprising obtaining a first identifier (ID) sequence from a logical unit number (LUN) mapping table based on logical addresses of first data, where IDs in the first ID sequence are allocated based on a sequence of physical addresses, where the LUN mapping table includes mapping relationships between the logical addresses and the IDs; obtaining first physical addresses from an ID mapping table based on one ID in the first ID sequence when the IDs in the first ID sequence are consecutive, where the ID mapping table includes a mapping relationship between an ID and a physical address and the first physical addresses are a plurality of physical addresses corresponding to the first ID sequence; and reading the first data based on the first physical addresses.

First claim

What is claimed is:

1 . A method, comprising:
obtaining a first identifier (ID) sequence comprising first IDs from a logical unit number (LUN) mapping table based on logical addresses of first data, wherein the first IDs are allocated based on a sequence of physical addresses, and wherein the LUN mapping table comprises mapping relationships between the logical addresses and the first IDs; obtaining first physical addresses from an ID mapping table based on one ID in the first ID sequence when the first IDs are consecutive, wherein the ID mapping table comprises a mapping relationship between the first IDs and the first physical addresses, and wherein the first physical addresses correspond to the first ID sequence; and reading the first data based on the first physical addresses.

2 . The method of claim 1 , further comprising:
receiving second data that is to be stored in batches; and allocating second IDs to the second data and second physical addresses of the sequence of physical addresses to the second data when first fingerprints of the second data do not duplicate second fingerprints in a fingerprint (FP) mapping table, wherein the second IDs are consecutive, wherein the second physical addresses are consecutive, and wherein the FP mapping table comprises a mapping relationship between each fingerprint of the second fingerprints and the first IDs.

3 . The method of claim 2 , further comprising allocating the second IDs and the second physical addresses to the second data when the first fingerprints duplicate the second fingerprints, and the first fingerprints do not duplicate third fingerprints in the ID mapping table.

4 . The method of claim 2 , wherein the second fingerprints are a part of a complete fingerprint, and wherein third fingerprints in the ID mapping table are complete fingerprints.

5 . The method of claim 2 , wherein after allocating the second IDs and the second physical addresses to the second data, the data processing method further comprises:
storing the second data in the second physical addresses; adding first mapping relationships between the second IDs, the first fingerprints, and the second physical addresses to the ID mapping table; and adding second mapping relationships between part of the first fingerprints and the second IDs to the FP mapping table.

6 . The method of claim 2 , further comprising:
performing a duplication check in the FP mapping table based on a part of the first fingerprints; and loading, to an internal memory, entries corresponding to a plurality of third IDs near a second ID corresponding to a duplicated fingerprint when duplicating a third fingerprint of the second fingerprints in the FP mapping table to obtain the duplicated fingerprint.

7 . The method of claim 1 , further comprising reserving one or more of the first IDs in ID segments for data of different attributes in the ID mapping table, wherein the one or more of the first IDs that comprises a same attribute and that is input discontinuously are consecutive.

8 . The method of claim 1 , further comprising deleting at least one of the first IDs that does not exist in the LUN mapping table from the ID mapping table when at least one of the first IDs in the LUN mapping table is overwritten.

9 . A computer device, comprising:
a memory configured to store instructions; and a processor coupled to the memory and configured to execute the instructions, that when executed by the processor, cause the computer device to:
obtain a first identifier (ID) sequence comprising first IDs from a logical unit number (LUN) mapping table based on logical addresses of first data, wherein the first IDs are allocated based on a sequence of physical addresses, and wherein the LUN mapping table comprises mapping relationships between the logical addresses and the first IDs;
obtain first physical addresses from an ID mapping table based on one ID in the first ID sequence when the first IDs are consecutive, wherein the ID mapping table comprises a mapping relationship between the first IDs and the first physical addresses, and wherein the first physical addresses correspond to the first ID sequence; and
reading the first data based on the first physical addresses.

10 . The computer device of claim 9 , wherein the instructions that when executed by the processor further cause the computer device to:
receive second data that is to be stored in batches; and allocate second IDs to the second data and second physical addresses of the sequence of physical addresses to the second data when first fingerprints of the second data are not duplicate second fingerprints in a fingerprint (FP) mapping table, wherein the second data comprises the first fingerprints, wherein the FP mapping table comprises the second fingerprints, and wherein the FP mapping table comprises a mapping relationship between each fingerprint of the second fingerprints and the first IDs.

11 . The computer device of claim 10 , wherein the instructions that when executed by the processor further cause the computer device to allocate the second IDs and the second physical addresses to the second data when the first fingerprints duplicate the second fingerprints, and the first fingerprints do not duplicate third fingerprints in the ID mapping table.

12 . The computer device of claim 10 , wherein the second fingerprints are a part of a complete fingerprint, and wherein third fingerprints in the ID mapping table are complete fingerprints.

13 . The computer device of claim 10 , wherein after allocating the second IDs and the second physical addresses to the second data, the instructions that when executed by the processor further cause the computer device to:
store the second data in the second physical addresses; add first mapping relationships between the second IDs, the first fingerprints, and the second physical addresses to the ID mapping table; and add mapping relationships between part of the first fingerprints and the second IDs to the FP mapping table.

14 . The computer device of claim 10 , wherein the instructions that when executed by the processor further cause the computer device to:
perform a duplication check in the FP mapping table based on a part of the first fingerprints; and load, to an internal memory, entries corresponding to a plurality of third IDs near a second ID corresponding to a duplicated fingerprint when duplicating a third fingerprint of the second fingerprints in the FP mapping table to obtain the duplicated fingerprint.

15 . The computer device of claim 9 , wherein the instructions that when executed by the processor further cause the computer device to reserve one or more of the first IDs in ID segments for data of different attributes in the ID mapping table, wherein the one or more of the first IDs that comprises a same attribute and that is input discontinuously are consecutive.

16 . The computer device of claim 9 , wherein the instructions that when executed by the processor further cause the computer device to delete at least one of the first IDs that does not exist in the LUN mapping table from the ID mapping table when at least one of the first IDs in the LUN mapping table is overwritten.

17 . A computer program product comprising computer-executable instructions that are stored on a that are stored on a non-transitory computer-readable storage medium and that, when executed by a processor cause a computer device to:
obtain a first identifier (ID) sequence comprising first IDs from a logical unit number (LUN) mapping table based on logical addres

Assignees

• Huawei Tech Co Ltd

Inventors

• Gao Yuan
• Xue Qiang
• Wu Jinkang
• Zhang Zhenbo
• Shen Jianqiang

Classifications

• G06F12/1009

  using page tables, e.g. page table structures · CPC title

• G06F3/0673

  Single storage device · CPC title

• G06F3/0659

  Command handling arrangements, e.g. command buffers, queues, command scheduling · CPC title

• G06F3/0608

  Saving storage space on storage systems · CPC title

• G06F3/0641

  De-duplication techniques · CPC title