Recovering a storage volume associated with a snapshot lineage from cloud storage

Patent metadata

Field	Value
Publication number	US-11630736-B2
Application number	US-202016814471-A
Country	US
Kind code	B2
Filing date	Mar 10, 2020
Priority date	Mar 10, 2020
Publication date	Apr 18, 2023
Grant date	Apr 18, 2023

Abstract

An apparatus comprises a processing device configured to identify a snapshot lineage comprising snapshots of a given storage volume, the snapshot lineage comprising (i) a local snapshot lineage stored on a storage system and (ii) a cloud snapshot lineage stored on cloud storage of at least one cloud external to the storage system, the cloud snapshot lineage comprising at least a subset of the snapshots of the given storage volume. The processing device is also configured to determine whether the local snapshot lineage is associated with any current local storage volume of the storage system corresponding to the given storage volume and, responsive to determining that the storage system is not associated with any current local storage volume corresponding to the given storage volume, to select a snapshot from the cloud snapshot lineage and recover the selected snapshot to a new local storage volume on the storage system.

First claim

What is claimed is:

1. An apparatus comprising:
at least one processing device comprising a processor coupled to a memory;
the at least one processing device being configured:
to identify, utilizing virtualization software running on a storage system, a snapshot lineage comprising two or more snapshots of a given storage volume, the snapshot lineage comprising (i) a local snapshot lineage stored on at least one of one or more storage devices of the storage system and (ii) two or more cloud snapshot lineages stored on cloud storage of two or more different clouds external to the storage system, a first one of the two or more cloud snapshot lineages comprising a first subset of the two or more snapshots of the given storage volume stored on first cloud storage of a first cloud of the two or more different clouds external to the storage system, and a second one of the two or more cloud snapshot lineages comprising a second subset of the two or more snapshots of the given storage volume stored on second cloud storage of a second cloud of the two or more clouds external to the storage system;
to determine whether the local snapshot lineage is associated with any current local storage volume of the storage system corresponding to the given storage volume;
responsive to determining that the local snapshot lineage is not associated with any current local storage volume corresponding to the given storage volume, to query the virtualization software running on the storage system to identify the first and second subsets of the two or more snapshots of the given storage volume stored on the first and second cloud storage of the first and second clouds external to the storage system;
to select, via the virtualization software running on the storage system, at least one snapshot from the identified first and second subsets of the two or more snapshots of the given storage volume stored on the first and second cloud storage of the first and second clouds external to the storage system;
to obtain, via the virtualization software running on the storage system, configuration data for accessing the selected at least one snapshot, the configuration data comprising (i) a cloud identifier that points to a portion of the cloud storage of the two or more different clouds on which the selected at least one snapshot resides, (ii) credentials for accessing the portion of the cloud storage on which the selected at least one snapshot resides, and (iii) metadata describing at least one cloud volume associated with the selected at least one snapshot; and
to recover the selected at least one snapshot to a new local storage volume on at least one of the one or more storage devices of the storage system.

2. The apparatus of claim 1 wherein the new local storage volume comprises one of:
at least one of the one or more storage devices of the storage system;
a given logical unit provided by at least one of the one or more storage devices;
a consistency group comprising a set of two or more logical units provided by at least one of the one or more storage devices; and
an access-restricted storage group comprising a set of two or more logical units provided by at least one of the one or more storage devices where access to the storage group is limited to one or more designated host devices.

3. The apparatus of claim 1 wherein the given storage volume originated at the storage system.

4. The apparatus of claim 3 wherein determining that the local snapshot lineage is not associated with any current local storage volume corresponding to the given storage volume comprises determining that the given storage volume and all snapshots of the given storage volume in the local snapshot lineage have been removed from the storage system.

5. The apparatus of claim 4 wherein the storage system is not aware of existence of the snapshot lineage.

6. The apparatus of claim 1 wherein the given storage volume originated at an additional storage system, and wherein identifying the snapshot lineage comprises utilizing the virtualization software running on the storage system to obtain configuration data for the snapshot lineage from the additional storage system.

7. The apparatus of claim 1 wherein the configuration data further comprises:
encryption keys for decrypting the selected at least one snapshot lineage; and
an indication of one or more types of compression applied to the selected at least one snapshot lineage.

8. The apparatus of claim 1 wherein recovering the selected at least one snapshot comprises creating a recovery map, the recovery map linking the new local storage volume of the storage system to the cloud volume on which the selected at least one snapshot is stored.

9. The apparatus of claim 8 wherein recovering the selected at least one snapshot further comprises:
exposing the new local storage volume of the storage system as a virtual device;
mapping the virtual device to the cloud volume; and
writing data of the cloud volume to the virtual device.

10. The apparatus of claim 9 wherein recovering the selected at least one snapshot further comprises, responsive to successfully writing all data of the selected at least one snapshot to the virtual device:
un-mapping the cloud volume from the virtual device; and
removing the new local storage volume from the recovery map.

11. The apparatus of claim 1 wherein recovering the selected at least one snapshot comprises utilizing an application programming interface to generate a request to determine data stored on one of the first cloud storage and the second cloud storage to be copied to the new local storage volume of the storage system, the request comprising information identifying the selected at least one snapshot and a location of the selected at least one snapshot on said one of the first cloud storage and the second cloud storage of one of the first cloud and the second cloud external to the storage system.

12. The apparatus of claim 11 wherein recovering the selected at least one snapshot further comprises utilizing the application programming interface to receive a response to the request, the response comprising information characterizing a size of the selected at least one snapshot on said one of the first cloud storage and the second cloud storage of said one of the first cloud and the second cloud external to the storage system.

13. The apparatus of claim 12 wherein the application programming interface comprises a representational state transfer application programming interface with an endpoint uniform resource locator specifying a path parameter comprising a unique identifier of the storage system.

14. The apparatus of claim 1 wherein the at least one processing device is part of the storage system.

15. A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device to perform steps of:
identifying, utilizing virtualization software running on a storage system, a snapshot lineage comprising two or more snapshots of a given storage volume, the snapshot lineage comprising (i) a local snapshot lineage stored on at least one of one or more storage devices of the storage system and (ii) two or more cloud snapshot lineages stored on cloud storage of two or more different clouds external to the storage system, a first one of the two or more cloud snapshot lineages comprising a first subset of the two or more snapshots of the given storage volume stored on first cloud storage o

Assignees

• Emc Ip Holding Co Llc

Inventors

• Anthony Michael
• Bhatnagar Anurag
• Gunasekaran Shanmuga Anand
• Aldred Mark
• King David

Classifications

• G06F11/2094 Primary

  Redundant storage or storage space (G06F11/2056 takes precedence) · CPC title

• G06F11/1471

  involving logging of persistent data for recovery · CPC title

• G06F3/0604

  Improving or facilitating administration, e.g. storage management · CPC title

• G06F11/1469

  Backup restoration techniques · CPC title

• G06F9/547

  Remote procedure calls [RPC]; Web services · CPC title