Data caching in provider network substrate extensions

Patent metadata

Field	Value
Publication number	US-11539552-B1
Application number	US-202117330350-A
Country	US
Kind code	B1
Filing date	May 25, 2021
Priority date	Jun 28, 2019
Publication date	Dec 27, 2022
Grant date	Dec 27, 2022

Abstract

One or more configuration parameters for an object gateway instance are received at an interface to a provider network, the parameters including an identifier of a first object store of the provider network for which to cache objects in a first object cache of the object gateway instance and an indication of a data transfer mode that controls when objects written to the first object cache are written to the first object store. The one or more configuration parameters are stored in a data store of the provider network and sent to the object gateway instance. A read request that includes the identifier of the first object store and a first object identifier is received from the object gateway instance, and a first object associated with the first object identifier and stored in the first object store is sent to the object gateway instance.

First claim

What is claimed is:

1. A computer-implemented method comprising:
receiving, from a cloud provider network via at least a third-party network, one or more configuration parameters for a storage gateway, wherein the one or more configuration parameters indicates a data transfer mode associated with the storage gateway, wherein the indicated data transfer mode is one of a first data transfer mode in which object data is written to and read from an object store of a storage service of the cloud provider network without caching the object data by the storage gateway, or a second data transfer mode in which object data written to a cache of the storage gateway is asynchronously sent to the cloud provider network for writing to the object store;
sending to the cloud provider network, a read request that includes an identifier of an object store, a credential, and a first object identifier, wherein the credential is associated with a first compute instance that requested a first object associated with the first object identifier and stored in the object store;
receiving, at the storage gateway, the first object; and
verifying the first compute instance is permitted to access the first object store based on the credential.

2. The computer-implemented method of claim 1 , wherein the one or more configuration parameters further indicate a cache size associated with the storage gateway.

3. The computer-implemented method of claim 1 , wherein the storage gateway caches data based on access frequency.

4. A computer-implemented method comprising:
receiving, from a provider network via at least a third-party network, one or more configuration parameters for a storage gateway, wherein the one or more configuration parameters indicates a data transfer mode associated with the storage gateway, wherein the indicated data transfer mode is one of a first data transfer mode or a second data transfer mode, and wherein each of the first and second data transfer modes indicates at least a caching mode for object data;
sending to the provider network, a read request that includes an identifier of an object store, a credential, and a first object identifier, wherein the credential is associated with a first compute instance that requested a first object associated with the first object identifier and stored in the object store;
receiving, at the storage gateway, the first object; and
verifying the first compute instance is permitted to access the first object store based on the credential.

5. The computer-implemented method of claim 4 , wherein object data is written to and/or read from an object store of a storage service of the cloud provider network without caching the object data by the storage gateway when using the first data transfer mode.

6. The computer implemented method of claim 4 , wherein object data written to a cache of the storage gateway is asynchronously sent to the cloud provider network for writing to the object store as a data transfer mode associated with the storage gateway when using the second data transfer mode.

7. The computer-implemented method of claim 4 , wherein the one or more configuration parameters further indicate a cache size associated with the storage gateway.

8. The computer-implemented method of claim 4 , wherein the storage gateway caches data based on access frequency.

9. The computer-implemented method of claim 4 , wherein the one or more configuration parameters include a parameter associated with performance of the storage gateway.

10. The computer-implemented method of claim 4 , wherein the storage gateway is hosted by an extension of the provider network.

11. The computer-implemented method of claim 4 , wherein the storage gateway is activated via the cloud provider network.

12. A system comprising:
a first one or more electronic devices of a cloud provide network to implement a plurality of object stores; and
a second one or more electronic devices of the cloud provider network to implement a storage gateway service, the storage gateway service including instructions that, upon execution, cause the storage gateway service to:
receive one or more configuration parameters for a storage gateway instance, wherein the one or more configuration parameters indicates a data transfer mode associated with the storage gateway, wherein the indicated data transfer mode is one of a first data transfer mode or a second data transfer mode, and wherein each of the first and second data transfer modes indicates at least a caching mode for object data;
store the one or more configuration parameters in a data store hosted by the cloud provider network;
send, via at least a third-party network, at least one configuration parameter of the one or more configuration parameters to the storage gateway instance;
receive, from the storage gateway instance, a read request that includes the identifier of the first object store, a credential, and a first object identifier wherein the credential is associated with a first compute instance that requested a first object associated with the first object identifier and stored in the first object store;
send, to the storage gateway instance, the first object; and
verify the first compute instance is permitted to access the first object store based on the credential.

13. The system of claim 12 , wherein object data is written to and/or read from an object store of a storage service of the cloud provider network without caching the object data by the storage gateway when using the first data transfer mode.

14. The system of claim 12 , wherein object data written to a cache of the storage gateway is asynchronously sent to the cloud provider network for writing to the object store as a data transfer mode associated with the storage gateway when using the second data transfer mode.

15. The system of claim 12 , wherein the one or more configuration parameters further indicate a cache size associated with the storage gateway instance.

16. The system of claim 12 , wherein the storage gateway instance is to cache data based on access frequency.

17. The system of claim 12 , wherein the one or more configuration parameters include a parameter associated with performance of the storage gateway instance.

18. The system of claim 12 , wherein the storage gateway instance is activated via the cloud provider network.

19. The system of claim 12 , wherein the storage gateway service includes further instructions that upon execution cause the storage gateway service to:
receive, from the storage gateway instance, a write request that includes the identifier of the first object store and a second object; and
store the second object in the first object store of the cloud provider network.

Assignees

• Amazon Tech Inc

Inventors

• Reed Paul C
• Kalavade Asawaree
• Wei Danny
• Olson Marc Stephen
• Marshall Brad E

Classifications

• H04L63/0272 Primary

  Virtual private networks · CPC title

• H04L12/4633 Primary

  Interconnection of networks using encapsulation techniques, e.g. tunneling · CPC title

• H04L67/53

  using third party service providers · CPC title

• H04L12/66

  Arrangements for connecting between networks having differing types of switching systems, e.g. gateways · CPC title

• H04L67/568

  Storing data temporarily at an intermediate stage, e.g. caching · CPC title