Copying data based on overwritten probabilities

Patent metadata

Field	Value
Publication number	US-11662937-B2
Application number	US-202117518976-A
Country	US
Kind code	B2
Filing date	Nov 4, 2021
Priority date	Apr 20, 2021
Publication date	May 30, 2023
Grant date	May 30, 2023

Abstract

Techniques for replicating data involve: determining overwritten probabilities of a plurality of data blocks of a source storage device. The techniques further involve: classifying the plurality of data blocks as cold data blocks or hot data blocks based on the overwritten probabilities in the plurality of data blocks. The techniques further involve: replicating at least a portion of the cold data blocks to a target storage device prior to the hot data blocks. Accordingly, transmission resources used to re-replicate overwritten data during an initial replication period can be reduced, thereby achieving efficient data replication.

First claim

The invention claimed is:

1. A method for replicating data, comprising:
determining overwritten probabilities of a plurality of data blocks in a source storage device, each respective data block including an overwritten probability, of the overwritten probabilities, indicating a probability of the respective data block being overwritten in the source storage device before the plurality of data blocks are all replicated to a target storage device;
classifying the plurality of data blocks as cold data blocks or hot data blocks based on the overwritten probabilities of the plurality of data blocks, overwritten probabilities of the hot data blocks being higher than overwritten probabilities of the cold data blocks; and
replicating at least a portion of the cold data blocks to the target storage device prior to the hot data blocks.

2. The method according to claim 1 , wherein replicating at least the portion of the cold data blocks to the target storage device prior to the hot data blocks comprises at least one of the following:
replicating the hot data blocks after replicating all of the cold data blocks to the target storage device; and
replicating the hot data blocks after replicating a portion of the cold data blocks to the target storage device.

3. The method according to claim 1 , wherein determining the overwritten probabilities comprises determining each of the overwritten probabilities based on at least one of the following:
a read and write history of a data block;
a type of data block; and
a overwritten probability of a neighboring data block.

4. The method according to claim 3 , wherein each of the plurality of data blocks comprises at least one data unit, and determining each of the overwritten probability of each data block probabilities comprises:
determining a possibility of the at least one data unit, of the respective data block, being overwritten before the plurality of data blocks are all replicated to the target storage device; and
determining the overwritten probability of the respective data block based at least on the possibility of the at least one data unit of the respective data block.

5. The method according to claim 4 , wherein determining the possibility of the at least one data unit of the respective data block comprises determining the possibility based on at least one of the following:
a read and write history of a data unit;
a type of data unit; and
a possibility of a neighboring data unit being overwritten.

6. The method according to claim 1 , further comprising:
when replicating the plurality of data blocks to the target storage device, re-replicating the plurality of data blocks in the source storage device, which are overwritten after being replicated to the target storage device, to the target storage device.

7. An electronic device, comprising:
a processor; and
a memory coupled to the processor, the memory having instructions stored therein, and the instructions, when executed by the processor, causing the device to execute actions comprising:
determining overwritten probabilities of a plurality of data blocks in a source storage device, each respective data block including an overwritten probability, of the overwritten probabilities, indicating a probability of the respective data block being overwritten in the source storage device before the plurality of data blocks are all replicated to a target storage device;
classifying the plurality of data blocks as cold data blocks or hot data blocks based on the overwritten probabilities of the plurality of data blocks, overwritten probabilities of the hot data blocks being higher than overwritten probabilities of the cold data blocks; and
replicating at least a portion of the cold data blocks to the target storage device prior to the hot data blocks.

8. The device according to claim 7 , wherein replicating at least the portion of the cold data blocks to the target storage device prior to the hot data blocks comprises at least one of the following:
replicating the hot data blocks after replicating all of the cold data blocks to the target storage device; and
replicating the hot data blocks after replicating a portion of the cold data blocks to the target storage device.

9. The device according to claim 7 , wherein determining the overwritten probabilities comprises determining each of the overwritten probabilities based on at least one of the following:
a read and write history of a data block;
a type of data block; and
a overwritten probability of a neighboring data block.

10. The device according to claim 9 , wherein each of the plurality of data blocks comprises at least one data unit, and determining each of the overwritten probability of each data block probabilities comprises:
determining a possibility of the at least one data unit, of the respective data block, being overwritten before the plurality of data blocks are all replicated to the target storage device; and
determining the overwritten probability of the respective data block based at least on the possibility of the at least one data unit of the respective data block.

11. The device according to claim 10 , wherein determining the possibility of the at least one data unit of the respective data block comprises determining the possibility based on at least one of the following:
a read and write history of a data unit;
a type of data unit; and
a possibility of a neighboring data unit being overwritten.

12. The device according to claim 7 , wherein the actions further comprise:
when replicating the plurality of data blocks to the target storage device, re-replicating the plurality of data blocks in the source storage device, which are overwritten after being replicated to the target storage device, to the target storage device.

13. A computer program product having a non-transitory computer readable medium which stores a set of instructions to replicate data; the set of instructions, when carried out by computerized circuitry, causing the computerized circuitry to perform a method of:
determining overwritten probabilities of a plurality of data blocks in a source storage device, each respective data block including an overwritten probability, of the overwritten probabilities, indicating a probability of the respective data block being overwritten in the source storage device before the plurality of data blocks are all replicated to a target storage device;
classifying the plurality of data blocks as cold data blocks or hot data blocks based on the overwritten probabilities of the plurality of data blocks, overwritten probabilities of the hot data blocks being higher than overwritten probabilities of the cold data blocks; and
replicating at least a portion of the cold data blocks to the target storage device prior to the hot data blocks.

Assignees

• Emc Ip Holding Co Llc
• EMC IP Holding Company LLP

Inventors

• Wu Yuanyang
• Lu Yifeng

Classifications

• G06F3/065 Primary

  Replication mechanisms · CPC title

• G06F3/0619

  in relation to data integrity, e.g. data losses, bit errors · CPC title

• G06F3/0671

  In-line storage system · CPC title

• G06F3/064

  Management of blocks · CPC title

• G06F3/0611

  in relation to response time · CPC title