Online data rehydration

Patent metadata

Field	Value
Publication number	US-11513717-B2
Application number	US-202117155912-A
Country	US
Kind code	B2
Filing date	Jan 22, 2021
Priority date	Jan 22, 2021
Publication date	Nov 29, 2022
Grant date	Nov 29, 2022

Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for online rehydration. One of the methods includes intercepting a request issued by a virtual computing instance to a primary storage system, wherein the request identifies first data stored in the primary storage system; determining whether the first data has been rehydrated by a rehydration system; and in response to determining that at least a first portion of the first data has not been rehydrated by the rehydration system: submitting, to the rehydration system, a rehydration request that identifies the first portion of the first data that has not been rehydrated; obtaining, from the rehydration system, a response that includes a copy of the first portion of the first data, wherein the rehydration system has obtained the copy from a backup storage system; and responding to the request using the copy of the first portion of the first data.

First claim

What is claimed is:

1. A system comprising:
a virtual computing instance that is configured to execute one or more workloads;
a primary storage system that is configured to store data for the one or more workloads;
a rehydration system that is configured to rehydrate data in the primary storage system using corresponding data stored in a backup storage system; and
a filter system that is configured to perform operations comprising:
intercepting a request issued by the virtual computing instance to the primary storage system, wherein the request identifies first data stored in the primary storage system;
determining whether the first data has been rehydrated by the rehydration system;
in response to determining that the first data has been entirely rehydrated by the rehydration system, forwarding the request to the primary storage system; and
in response to determining that at least a first portion of the first data has not been rehydrated by the rehydration system:
determining that the first portion of the first data is subject to an in-flight rehydration request executed by the rehydration system;
obtaining, from the rehydration system after completing the in-flight rehydration request, a response that includes a copy of the first portion of the first data, wherein the rehydration system has obtained the copy from the backup storage system; and
responding to the request using the copy of the first portion of the first data.

2. The system of claim 1 , wherein:
the request is a read request that comprises a request to read the first data; and
responding to the request comprises providing the first data to the virtual computing instance in response to the request, the first data including the copy of the first portion.

3. The system of claim 2 , wherein the filter system is further configured to perform operations comprising:
determining that a second portion of the first data has been rehydrated by the rehydration system; and
obtaining the second portion of the first data from the primary storage system.

4. The system of claim 1 , wherein:
the request is a write request that comprises a request to overwrite the first data; and
responding to the request comprises:
overwriting the copy of the first portion of the first data according to the write request; and
storing the overwritten copy of the first portion of the first data in the primary storage system.

5. The system of claim 4 , wherein:
the write request comprises a request to replace the first portion of the first data with replacement data; and
overwriting the copy of the first portion of the first data and storing the overwritten copy of the first portion of the first data in the primary storage system comprises:
discarding the copy of the first portion of the first data; and
storing the replacement data in the primary storage system in place of the first portion of the first data.

6. The system of claim 4 , wherein:
the write request comprises a request overwrite a strict subset of the first portion of the first data with new data; and
overwriting the copy of the first portion of the first data comprises overwriting, in the copy, the strict subset of the first portion using the new data.

7. The system of claim 4 , wherein the filter system is further configured to perform operations comprising:
determining that a third portion of the first data has been rehydrated by the rehydration system; and
overwriting the third portion of the first data in the primary storage system according to the write request.

8. The system of claim 1 , wherein the primary storage system is local to the virtual computing instance and the backup storage system is remote to the virtual computing instance.

9. The system of claim 1 , wherein the filter system is further configured to perform operations comprising:
maintaining first tracking data that identifies, for each extent in the primary storage system related to the virtual computing instance, whether the extent has been rehydrated by the primary storage system; and
in response to obtaining, from the rehydration system, a copy of the first portion of the first data, updating the first tracking data to identify that the first portion of the first data has been rehydrated.

10. The system of claim 1 , wherein the filter system is further configured to perform operations comprising:
maintaining second tracking data that identifies each pending request received from the virtual computing instance;
determining that one or more preceding pending requests submitted by the virtual computing instance reference at least a fourth portion of the first data; and
deferring completion of the read request until the one or more preceding pending requests have completed.

11. A computer-implemented method comprising:
intercepting a request issued by a virtual computing instance to a primary storage system, wherein the primary storage system is configured to store data for one or more workloads of the virtual computing instance and wherein the request identifies first data stored in the primary storage system;
determining whether the first data has been rehydrated by a rehydration system, wherein the rehydration system is configured to rehydrate data in the primary storage system using corresponding data stored in a backup storage system;
in response to determining that the first data has been entirely rehydrated by the rehydration system, forwarding the request to the primary storage system; and
in response to determining that at least a first portion of the first data has not been rehydrated by the rehydration system:
determining that the first portion of the first data is subject to an in-flight rehydration request executed by the rehydration system;
obtaining, from the rehydration system after completing the in-flight rehydration request, a response that includes a copy of the first portion of the first data, wherein the rehydration system has obtained the copy from the backup storage system; and
responding to the request using the copy of the first portion of the first data.

12. The method of claim 11 , wherein:
the request is a read request that comprises a request to read the first data; and
responding to the request comprises providing the first data to the virtual computing instance in response to the request, the first data including the copy of the first portion.

13. The method of claim 12 , further comprising:
determining that a second portion of the first data has been rehydrated by the rehydration system; and
obtaining the second portion of the first data from the primary storage system.

14. The method of claim 11 , wherein:
the request is a write request that comprises a request to overwrite the first data; and
responding to the request comprises:
overwriting the copy of the first portion of the first data according to the write request; and
storing the overwritten copy of the first portion of the first data in the primary storage system.

15. The method of claim 14 , wherein:
the write request comprises a request overwrite a strict subset of the first portion of the first data with new data; and
overwriting the copy of the first portion of the first data comprises overwriting, in the copy, the strict subset of the first portion using the new data.

16. The method of claim 14 , further comprising:
determining that a third portion of the first data has been rehydrated by the rehydration system; and
overwriting the third portion of the first data in the primary storage system according to the write request.

17. T

Assignees

• Vmware Inc

Inventors

• Friedman Dave
• Uluski Derek
• Zucca Michael

Classifications

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title

• G06F2009/45583

  Memory management, e.g. access or allocation · CPC title

• G06F3/065 Primary

  Replication mechanisms · CPC title

• G06F3/0664

  at device level, e.g. emulation of a storage device or system · CPC title

• G06F9/45558 Primary

  Hypervisor-specific management and integration aspects · CPC title