Data recovery using bitmap data structure

Patent metadata

Field	Value
Publication number	US-11526399-B2
Application number	US-202117410963-A
Country	US
Kind code	B2
Filing date	Aug 24, 2021
Priority date	Sep 12, 2014
Publication date	Dec 13, 2022
Grant date	Dec 13, 2022

Abstract

Examples of the present disclosure describe implementing bitmap-based data replication when a primary form of data replication between a source device and a target device cannot be used. According to one example, a temporal identifier may be received from the target device. If the source device determines that the primary replication method is unable to be used to replicate data associated with the temporal identifier, a secondary replication method may be initiated. The secondary replication method may utilize a recovery bitmap identifying data blocks that have changed on the source device since a previous event.

First claim

What is claimed is:

1. A method comprising:
maintaining at a source device a plurality of target-specific hierarchical bitmap structures for a plurality of target devices, wherein each of the target-specific hierarchical bitmap structures comprises a recovery bitmap and an accumulating bitmap for one of the plurality of target devices, the accumulating bitmap corresponding to data records in a previous virtual log;
receiving a temporal identifier from a first target device of the plurality of target devices;
determining that a primary replication method is unable to be used to replicate data associated with the temporal identifier for the first target device; and
initiating replication of data for the first target device using a secondary replication method, wherein the secondary replication method utilizes a recovery bitmap for the first target device that identifies data blocks that have changed on the source device since a previous replication of data to the first target device through a transaction indicated by the temporal identifier.

2. The method according to claim 1 , further comprising:
switching back to the primary replication method for the first target device upon receiving an indication that the first target device is sufficiently synchronized with the source device.

3. The method according to claim 1 , wherein the initiating further comprises sending the recovery bitmap for the first target device to the first target device.

4. The method according to claim 3 , wherein the primary replication method is a log-based replication method and the temporal identifier is a log sequence number.

5. The method according to claim 1 , wherein creating the recovery bitmap comprises creating the recovery bitmap by propagating bitmap data throughout a target-specific hierarchical bitmap structure maintained for the first target device.

6. The method of claim 1 , wherein the each of the target-specific hierarchical bitmap structures further comprises a checkpoint bitmap, the checkpoint bitmap corresponding to data records in a current virtual log.

7. The method according to claim 6 , further comprising:
propagating data from the checkpoint bitmap to the accumulating bitmap when the current virtual log represented by the checkpoint bitmap is full.

8. The method according to claim 7 , further comprising:
propagating data from the accumulating bitmap to the recovery bitmap when it is determined that the primary replication method is unable to be used to replicate data associated with the temporal identifier.

9. The method according to claim 1 , wherein the recovery bitmap identifies a second temporal identifier corresponding to a most recent data change represented by the recovery bitmap for the first target device.

10. The method according to claim 1 , further comprising:
setting a new bit in the recovery bitmap for the first target device when a new update is made on a source device, wherein the new bit equates to a range of storage of the source device in which a change has occurred.

11. The method according to claim 1 , further comprising:
receiving a second temporal identifier from the first target device;
determining if the accumulating bitmap for the first target device is empty;
when the accumulating bitmap for the first target device is empty, providing replication to the first target device using the primary replication method; and
when the accumulating bitmap for the first target device is not empty, propagating data from the accumulating bitmap to the recovery bitmap and sending the recovery bitmap to the first target device.

12. The method of claim 1 comprising:
receiving a second temporal identifier from a second target device of the plurality of target devices;
determining that a primary replication method is unable to be used to replicate data associated with the second temporal identifier to the second target device; and
initiating replication of data to the second target device using a secondary replication method, wherein the secondary replication method utilizes a target-specific recovery bitmap for the second target device, wherein the target-specific recovery bitmap identifies data blocks that have changed since a previous replication of data to the second target device through a transaction indicated by the second temporal identifier.

13. A data replication system comprising:
a processor; and
memory storing computer readable instructions that when executed by the processor cause the system to:
maintain a plurality of target-specific hierarchical bitmap structures, wherein each of the plurality of target-specific hierarchical bitmap structures comprises a recovery bitmap and an accumulating bitmap for a target device, the accumulating bitmap corresponding to data records in a previous virtual log;
receive a first temporal identifier from a first target device;
determine that a primary replication method is unable to be used to replicate data associated with the first temporal identifier; and
initiate replication of data to the first target device using a secondary replication method, wherein the secondary replication method utilizes a recovery bitmap for the first target device that identifies data blocks that have changed since a previous replication of data to the first target device through a transaction indicated by the first temporal identifier.

14. The data replication system of claim 13 , wherein the computer readable instructions, when executed, further cause the system to:
based on the determination that the primary replication method is unable to be used to replicate data associated with the temporal identifier, propagate data from the accumulating bitmap to the recovery bitmap;
receive a second temporal identifier from the first target device;
determine if the accumulating bitmap for the first target device is empty;
when the accumulating bitmap for the first target device is empty, providing replication to the first target device using the primary replication method; and
when the accumulating bitmap for the first target device is not empty, propagating data from the accumulating bitmap to the recovery bitmap and sending the recovery bitmap to the target device.

15. The data replication system of claim 13 further comprising computer readable instructions stored on the memory that when executed by the processor cause the system to:
receive a second temporal identifier from a second target device;
determine that a primary replication method is unable to be used to replicate data associated with the second temporal identifier; and
initiate replication of data to the second target device using a secondary replication method, wherein the secondary replication method utilizes a recovery bitmap for the second target device that identifies data blocks that have changed since the second temporal identifier.

16. A method for data replication from a source device to a plurality of target devices, the method comprising:
maintaining at the source device a target-specific hierarchical bitmap structure for each of the plurality of target devices, wherein the plurality of target devices comprises a first target device and a second target device and each of the target-specific hierarchical bitmap structures comprises a checkpoint bitmap, an accumulating bitmap, and a recovery bitmap;
storing in the checkpoint bitmap for the first target device a compilation of disc blocks of the source device that have been affected by transactions represented in a current virtual log;
propagating data from the checkpoint bitmap to the accumulating bitmap for

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Battepati Roopesh
• Johnson Michael C
• Kadam Manoj
• Wang Raymond
• Prasad Ganesh
• Zhu Ziquan

Classifications

• G06F2201/855

  Details of asynchronous mirroring using a journal to transfer not-yet-mirrored changes · CPC title

• G06F11/2082 Primary

  Data synchronisation · CPC title

• G06F11/2074 Primary

  Asynchronous techniques · CPC title

• G06F11/1451

  by selection of backup contents · CPC title

• G06F2201/84

  Using snapshots, i.e. a logical point-in-time copy of the data · CPC title