Hybrid data storage system with private storage cloud and public storage cloud

Patent metadata

Field	Value
Publication number	US-10289310-B2
Application number	US-201715635056-A
Country	US
Kind code	B2
Filing date	Jun 27, 2017
Priority date	Jun 27, 2017
Publication date	May 14, 2019
Grant date	May 14, 2019

Abstract

Systems and methods are disclosed for accessing data on a storage system. An apparatus, such as a data storage device or a computing device, may include a memory configured to store data. The apparatus is configured to receive a request for a file stored in a storage system. The storage system includes a private storage cloud and a set of public storage clouds. The apparatus is also configured to determine whether the file is retrievable from the set of public storage clouds. If the file is retrievable from the set of public storage clouds the apparatus may determine whether access to the set of public storage clouds is faster than access to the private storage cloud and may retrieve the file from one or more of the private storage cloud and the set of public storage clouds.

First claim

What is claimed is:

1. An apparatus, comprising:
a memory configured to store data; and
a processor coupled to the memory, the processor configured to:
receive a request for a file stored in a storage system comprising a private storage cloud and a set of public storage clouds;
determine whether the file is retrievable from the set of public storage clouds;
responsive to determining that the file is retrievable from the set of public storage clouds:
determine whether access to the set of public storage clouds is faster than access to the private storage cloud; and
retrieve the file from one or more of the private storage cloud and the set of public storage clouds; and

responsive to determining that the file is not retrievable from the set of public storage clouds:
retrieve the file from the private storage cloud;
determine an importance level for the file and a hotness level for the file; and
determine, based at least in part on the importance level and the hotness level, to keep the file on the private storage cloud and store a set of recovery data chunks for the file in the set of public storage clouds.

2. The apparatus of claim 1 , wherein the processor is configured to retrieve the file from one or more of the private storage cloud and the set of public storage clouds by:
retrieving the file from the private storage cloud responsive to determining that access to the set of public storage clouds is not faster than access to the private storage cloud.

3. The apparatus of claim 1 , wherein the processor is further configured to:
determine whether the private storage cloud and the set of public storage clouds can be accessed in parallel.

4. The apparatus of claim 3 , wherein retrieving the file from one or more of the private storage cloud and the set of public storage clouds comprises:
retrieving a first set of portions of the file from the private storage cloud and a second set of portions of the file from the set of public storage clouds, responsive to determining that the private storage cloud and the set of public storage clouds can be accessed in parallel.

5. The apparatus of claim 3 , wherein retrieving the file from one or more of the private storage cloud and the set of public storage clouds comprises:
retrieving the file from the set of public storage clouds, responsive to determining that the private storage cloud and the set of public storage clouds cannot be accessed in parallel.

6. The apparatus of claim 1 , wherein the processor is further configured to:
determine whether a latest version of the file is retrievable from the set of public storage clouds; and
retrieve the file from the private storage cloud, responsive to determining that the latest version of the file is not retrievable from the set of public storage clouds.

7. The apparatus of claim 6 , wherein the processor is further configured to:
request that the latest version of the file be stored in the set of public storage clouds, responsive to determining that the latest version of the file is not retrievable from the set of public storage clouds.

8. The apparatus of claim 1 , wherein the processor is configured to retrieve the file from one or more of the private storage cloud and the set of public storage clouds by:
retrieving portions of the file from one or more of the private storage cloud or the set of public storage clouds.

9. The apparatus of claim 1 , wherein the processor is configured to retrieve the file from one or more of the private storage cloud and the set of public storage clouds by:
retrieving a set of recovery data chunks for the file from one or more of the private storage cloud or the set of public storage clouds; and
generating the file based on the set of recovery data chunks.

10. A method, comprising:
receiving a request for a file stored in a storage system comprising a private storage cloud and a set of public storage clouds;
determining whether the file is retrievable from the set of public storage clouds;
responsive to determining that the file is retrievable from the set of public storage clouds:
determining whether access to the set of public storage clouds is faster than access to the private storage cloud; and
retrieving the file from one or more of the private storage cloud and the set of public storage clouds; and

responsive to determining that the file is not retrievable from the set of public storage clouds:
retrieving the file from the private storage cloud;
determining an importance level for the file and a hotness level for the file; and
determining, based at least in part on the importance level and the hotness level, to keep the file on the private storage cloud and store a set of recovery data chunks for the file in the set of public storage clouds.

11. The method of claim 10 , wherein retrieving the file from one or more of the private storage cloud and the set of public storage clouds comprises:
retrieving the file from the private storage cloud responsive to determining that access to the set of public storage clouds is not faster than access to the private storage cloud.

12. The method of claim 10 , further comprising:
determining whether the private storage cloud and the set of public storage clouds can be accessed in parallel.

13. The method of claim 12 , wherein retrieving the file from one or more of the private storage cloud and the set of public storage clouds comprises:
retrieving a first set of portions of the file from the private storage cloud and a second set of portions of the file from the set of public storage clouds, responsive to determining that the private storage cloud and the set of public storage clouds can be accessed in parallel.

14. The method of claim 12 , wherein retrieving the file from one or more of the private storage cloud and the set of public storage clouds comprises:
retrieving the file from the set of public storage clouds, responsive to determining that the private storage cloud and the set of public storage clouds cannot be accessed in parallel.

15. The method of claim 10 , further comprising:
determining whether a latest version of the file is retrievable from the set of public storage clouds; and
retrieving the file from the private storage cloud, responsive to determining that the latest version of the file is not retrievable from the set of public storage clouds.

16. A system comprising:
a storage means configured to store data; and
a processing means coupled to the storage means, the processing means configured to:
receive a request for a file stored in a storage system comprising a private storage cloud and a set of public storage clouds;
determine whether the file is retrievable from the set of public storage clouds;
responsive to determining that the file is retrievable from the set of public storage clouds:
determine whether access to the set of public storage clouds is faster than access to the private storage cloud; and
retrieve the file from one or more of the private storage cloud and the set of public storage clouds; and

responsive to determining that the file is not retrievable from the set of public storage clouds:
retrieve the file from the private storage cloud;
determine an importance level for the file and a hotness level for the file; and

determine, based at least in part on the importance level and the hotness level, to keep the file on the private storage cloud and store a set of recovery data chunks for the file in the set of public storage clouds.

Assignees

• Western Digital Tech Inc

Inventors

• Xu Jun
• Xi Wei
• Guo Guoxiao
• Bjornson Eric
• Yu Jie
• Wei Ling Chih

Classifications

• G06F21/602

  Providing cryptographic facilities or services · CPC title

• H04L67/1097

  for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS] · CPC title

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title

• G06F3/065

  Replication mechanisms · CPC title

• G06F21/6218

  to a system of files or objects, e.g. local or distributed file system or database · CPC title