Efficient replication of a dataset to the cloud

Patent metadata

Field	Value
Publication number	US-11616834-B2
Application number	US-202117234024-A
Country	US
Kind code	B2
Filing date	Apr 19, 2021
Priority date	Dec 8, 2015
Publication date	Mar 28, 2023
Grant date	Mar 28, 2023

Abstract

Synchronizing snapshots between storage systems, including: receiving, from a source storage system, an identification of a snapshot to be replicated to a destination storage system, wherein the source storage system and the destination storage system are of different types; identifying, from hint information stored on the destination storage system, a most recent version of the snapshot that is stored on the destination storage system; issuing, to the source storage system, a request for an identification of the differences between the snapshot to be replicated to the destination storage system and the most recent version of the snapshot that is stored on the destination storage system; receiving, from the source storage system, the identification of the differences; and issuing a request to transfer, from the source storage system to the destination storage system, data associated with the differences.

First claim

What is claimed is:

1. A method comprising:
issuing a request to store hint information to a target storage system that stores data transferred from a source storage system to the target storage system, wherein the hint information distinguishes a more recent version of a dataset from a previous version of the dataset;
based on the hint information stored at the target storage system, determining differences between a first version of the dataset to be replicated to the target storage system and a second version of the dataset that is stored on the target storage system; and
directing the target storage system to store the differences between the first version of the dataset to be replicated and the second version of the dataset that is stored on the target storage system.

2. The method of claim 1 wherein the dataset to be replicated is stored on a source storage system that adheres to a first storage architecture and wherein the target storage system adheres to a second storage architecture.

3. The method of claim 1 further comprising:
creating a new volume on the target storage system;
storing, in the new volume on the target storage system, the data associated with the differences;
creating, on the target storage system, a dataset of the new volume; and
deleting the new volume.

4. The method of claim 1 further comprising issuing, to the target storage system, a request to store hint information associated with the data transferred from a source storage system to the target storage system, wherein the hint information is stored within an identifier of the dataset at the target storage system.

5. The method of claim 1 further comprising issuing, to a source storage system that is storing the dataset to be replicated, a request to delete a stored dataset.

6. The method of claim 1 further comprising comparing the first version of the dataset to be replicated to the target storage system and the second version of the dataset that is stored on the target storage system.

7. The method of claim 1 wherein at least one of the source storage system or the target storage system is embodied as a cloud-based storage system.

8. The method of claim 1 , wherein determining the differences further comprises:
creating a first volume that includes data contained in the dataset to be replicated to the target storage system;
creating a second volume that includes data contained in the version of the dataset that is stored at the target storage system;
comparing the first volume to the second volume to identify address ranges within the first volume that correspond to first data that does not match second data contained in the same address ranges within the second volume.

9. An apparatus comprising a computer processor, a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of:
issuing a request to store hint information to a target storage system that stores data transferred from a source storage system to the target storage system, wherein the hint information distinguishes a more recent version of a dataset from a previous version of the dataset;
based on the hint information stored at the target storage system, determining differences between a first version of the dataset to be replicated to the target storage system and a second version of the dataset that is stored on the target storage system; and
directing the target storage system to store the differences between the first version of the dataset to be replicated and the second version of the dataset that is stored on the target storage system.

10. The apparatus of claim 9 wherein the dataset to be replicated is stored on a source storage system that adheres to a first storage architecture and wherein the target storage system adheres to a second storage architecture.

11. The apparatus of claim 9 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of:
creating a new volume on the target storage system;
storing, in the new volume on the target storage system, the data associated with the differences;
creating, on the target storage system, a dataset of the new volume; and
deleting the new volume.

12. The apparatus of claim 9 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the step of issuing, to the target storage system, a request to store hint information associated with the data transferred from a source storage system to the target storage system.

13. The apparatus of claim 9 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the step of issuing, to a source storage system that is storing the dataset to be replicated, a request to delete a stored dataset.

14. The apparatus of claim 9 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the step of comparing the dataset to be replicated to the target storage system and the version of the dataset that is stored on the target storage system.

15. The apparatus of claim 9 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the step of receiving a configuration file that includes information describing a source storage system, information describing the target storage system, and information describing a schedule for synchronizing datasets between the source storage system and the target storage system.

16. A computer program product disposed upon a computer readable medium, the computer program product comprising computer program instructions that, when executed, cause a computer to carry out the steps of:
issuing a request to store hint information to a target storage system that stores data transferred from a source storage system to the target storage system, wherein the hint information distinguishes a more recent version of a dataset from a previous version of the dataset;
based on the hint information stored at the target storage system, determining differences between a first version of the dataset to be replicated to the target storage system and a second version of the dataset that is stored on the target storage system; and
directing the target storage system to store the differences between the first version of the dataset to be replicated and the second version of the dataset that is stored on the target storage system.

17. The computer program product of claim 16 wherein the dataset to be replicated is stored on a source storage system that adheres to a first storage architecture and wherein the target storage system adheres to a second storage architecture.

18. The computer program product of claim 16 further comprising computer program instructions that, when executed, cause the computer to carry out the steps of:
creating a new volume on the target storage system;
storing, in the new volume on the target storage system, the data associated with the differences;
creating, on the target storage system, a dataset of the new volume; and
deleting the new volume.

19. The computer program product of claim 16 further comprising computer program instructions that, when executed, cause the computer to carry out the step of issuing, to the t

Assignees

• Pure Storage Inc

Inventors

• Perneti Vinay
• Chawla Deepak
• Colgrove John
• Noonan Terence
• Su Jikui

Classifications

• G06F3/065

  Replication mechanisms · CPC title

• G06F11/1451

  by selection of backup contents · CPC title

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title

• H04L67/1095 Primary

  Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes · CPC title

• G06F3/0659

  Command handling arrangements, e.g. command buffers, queues, command scheduling · CPC title