Tiered cloud storage for different availability and performance requirements

Patent metadata

Field	Value
Publication number	US-11734125-B2
Application number	US-202017019779-A
Country	US
Kind code	B2
Filing date	Sep 14, 2020
Priority date	Aug 18, 2016
Publication date	Aug 22, 2023
Grant date	Aug 22, 2023

Abstract

A system and method for a tiered cloud storage for different availability and performance requirements includes a gateway, a block store configured to cache data, and an object store configured to persistently store data. The gateway, the block store, and the object store are in a compute zone. The gateway may receive from a user application a file access call and process the file access call. The gateway may also send the file access call to the block store. Then, the gateway may determine to store data in the object store and flush the data from the block store to the object store.

First claim

The invention is claimed as follows:

1. A method comprising:
receiving, by a first gateway in a first compute zone, from a user application a file access call, wherein the first compute zone further includes a first block store and a first object store, wherein the file access call is a write access call to store first data;
determining, by the first gateway, that the first object store exceeds a predetermined threshold capacity;
responsive to determining that the first block store exceeds the predetermined threshold capacity, throttling, by the first gateway, a speed at which the first gateway processes the file access call to allow other data to be flushed from the first block store to the first object store, wherein the first object store has a flat and non-hierarchical structure,
replicating metadata used by the first gateway to a second gateway in a second compute zone, the metadata comprising information regarding which data is stored in the first block store and which data is flushed to the first object store and stored in the first object store, wherein the second compute zone further includes a second block store and a second object store, and
replicating a data cache in the first block store to the second block store, wherein the data cache stores data cached in the first block store.

2. The method of claim 1 , further comprising expanding, by the first gateway, a capacity of the first block store.

3. The method of claim 1 , wherein frequencies of the replication of the data cache and the metadata are determined heuristically.

4. The method of claim 1 , wherein both the data cache and the metadata are replicated synchronously.

5. The method of claim 1 , wherein only the metadata is replicated synchronously and the data cache is replicated asynchronously.

6. The method of claim 1 , wherein only the data cache is replicated synchronously and the metadata are replicated asynchronously.

7. The method of claim 1 , wherein both the data cache and the metadata are replicated asynchronously.

8. The method of claim 1 , further comprising:
determining, by the first gateway, whether an object in the first object store is modified, wherein the object is associated with a block in the first block store; and
responsive to determining that the object is modified, determining, by the first gateway, whether it is safe to retrieve the object from the first object store.

9. The method of claim 8 , further comprising: responsive to determining that it is not safe to retrieve the object from the first object store, delaying, by the first gateway, the retrieval of the object.

10. The method of claim 9 , wherein the retrieval of the object is delayed until the modification of the object is updated across compute zones.

11. A cloud storage system comprising:
a first gateway;
a first block store; and
a first object store, wherein the first gateway, the first block store, and the first object store are in a first compute zone,
wherein the first gateway is configured to:
receive from a user application a file access call, wherein the file access call is a write access call to store first data;
determine that the first object store exceeds a predetermined threshold capacity; and
responsive to determining that the first block store exceeds the predetermined threshold capacity, throttle a speed at which the first gateway processes the file access call to allow other data to be flushed from the first block store to the first object store, wherein the first object store has a flat and non-hierarchical structure,
wherein metadata used by the first gateway is replicated to a second gateway in a second compute zone, the metadata comprising information regarding which data is stored in the first block store and which data is flushed to the first object store and stored in the first object store, wherein the second compute zone further includes a second block store and a second object store, and
wherein a data cache in the first block store is replicated to the second block store, wherein the data cache stores data cached in the first block store.

12. The cloud storage system of claim 11 , wherein the first gateway is further configured to expand a capacity of the first block store.

13. The cloud storage system of claim 11 , wherein both the data cache and the metadata are replicated synchronously.

14. The cloud storage system of claim 11 , wherein only the metadata is replicated synchronously and the data cache is replicated asynchronously.

15. The cloud storage system of claim 11 , wherein only the data cache is replicated synchronously and the metadata are replicated asynchronously.

16. The cloud storage system of claim 11 , wherein both the data cache and the metadata are replicated asynchronously.

17. The cloud storage system of claim 11 , wherein the first gateway is further configured to:
determine whether an object in the first object store is modified, wherein the object is associated with a block in the first block store; and
responsive to determining that the object is modified, determine whether it is safe to retrieve the object from the first object store.

18. The cloud storage system of claim 17 , wherein the first gateway is further configured to: responsive to determining that it is not safe to retrieve the object from the first object store, delay the retrieval of the object.

19. The cloud storage system of claim 18 , wherein the retrieval of the object is delayed until the modification of the object is updated across compute zones.

20. A computer readable medium including instructions that, when executed by one or more processors in a cloud storage system, cause the cloud storage system to:
receive, by a first gateway in a first compute zone of the cloud storage system, from a user application a file access call, wherein the first compute zone further includes a first block store and a first object store, wherein the file access call is a write access call to store first data;
determine, by the first gateway, that the first object store exceeds a predetermined threshold capacity; and
responsive to determining that the first block store exceeds the predetermined threshold capacity, throttle, by the first gateway, a speed at which the first gateway processes the file access call to allow other data to be flushed from the first block store to the first object store, wherein the first object store has a flat and non-hierarchical structure,
wherein metadata used by the first gateway is replicated to a second gateway in a second compute zone, the metadata comprising information regarding which data is stored in the first block store and which data is flushed to the first object store and stored in the first object store, wherein the second compute zone further includes a second block store and a second object store, and
wherein a data cache in the first block store is replicated to the second block store, wherein the data cache stores data cached in the first block store.

Assignees

• Red Hat Inc

Inventors

• Chen Huamin
• Vyas Jay

Classifications

• G06F11/1464 Primary

  for networked environments · CPC title

• G06F16/182

  Distributed file systems · CPC title

• G06F16/215

  Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors · CPC title

• H04L67/025

  for remote control or remote monitoring of applications · CPC title

• H04L67/10

  in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) · CPC title