Scalable approach to manage storage volumes across heterogenous cloud systems

Patent metadata

Field	Value
Publication number	US-9565253-B2
Application number	US-201414336687-A
Country	US
Kind code	B2
Filing date	Jul 21, 2014
Priority date	Jul 21, 2014
Publication date	Feb 7, 2017
Grant date	Feb 7, 2017

Abstract

There are provided a system and a computer program product for managing heterogeneous cloud data storage systems. A computing system defines rules that govern a plurality of heterogeneous cloud data storage systems. The computing system receives complete data from a user's computer. The computing system splits the complete data. The computing system stores the split data according to the defined rules into the plurality of heterogeneous cloud data storage systems.

First claim

What is claimed is:

1. A system for managing heterogeneous cloud data storage systems, the system comprising:
at least one memory device;
at least one processor connected to the memory device,
wherein the processor is configured to:
define rules that govern a plurality of heterogeneous cloud data storage systems;
receive first-type data and second-type data from one or more user computers;
determine a respective priority for each of the first-type data and the second-type data, the priority of the first-type data is different than the priority of the second-type data;
send the first-type data to a first queue for storage thereat and the second-type data to a second queue for storage thereat according to the determined priority; and
send the first-type data and the second-type data from the first or second queue according to the defined rules for storage into the plurality of heterogeneous cloud data storage systems,
wherein one of the first and second queues takes a longer data processing time to store and send than the other of the first and second queues.

2. The system according to claim 1 , wherein in order to define rules, the processor is configured to:
specify that each cloud data storage system stores a different type of data.

3. The system according to claim 1 , wherein in order to define rules, the processor is configured to:
split at least one of the first-type data and the second-type data; and
store the split data at a cloud storage system whose resource usage to store the split data is lowest among the plurality of heterogeneous cloud data storage systems.

4. The system according to claim 1 , wherein the processor is further configured to:
split at least one of the first-type data and the second-type data; and
encrypt the split data before storing the split data at the plurality of heterogeneous cloud data storage systems.

5. The system according to claim 1 , wherein the processor is further configured to:
split at least one of the first-type data and the second-type data; and
send the split data to each different cloud data storage system according to the defined rules.

6. The system according to claim 1 , wherein the first queue takes a longer data processing time than the second queue whose priority is lower than the first queue.

7. The system according to claim 1 , wherein the first queue takes a less data processing time than the second queue whose priority is lower than the first queue.

8. The system according to claim 1 , further comprising:
an input scheduler by which the receiving of first-type data and second-type from one or more user computers, the determining of a respective priority for each of the first-type data and the second type data, and sending of the first-type data to a first queue for storage thereat and the second-type data to a second queue for storage thereat according to the determined priority are performed; and
an output scheduler including the first and second queues, and an output processing unit,
wherein the output processing unit is configured to provide feedback data corresponding to status of each cloud data storage system to the at least one processor.

9. The system according to claim 1 , further comprising:
an output scheduler including the first and second queues, and an output processing unit,
wherein the output processing unit is configured to apply a corresponding security rule on the first-type data and the second-type data according to the determined priority of each of the first-type data and the second-type data.

10. The system according to claim 8 , wherein the feedback data is used to update the defined rules in real-time based on the feedback data to at least one of the cloud data storage systems.

11. The system according to claim 10 , wherein the updating of the defined rules includes changing a data type that can be stored in the at least one of the cloud data storage system.

12. A computer program product for managing heterogeneous cloud data storage systems, the computer program product comprising a computer readable storage medium, the computer readable storage medium excluding a propagating signal, the computer readable storage medium readable by a processing circuit and storing instructions run by the processing circuit for performing a method, said method steps comprising:
defining rules that govern a plurality of heterogeneous cloud data storage systems;
receiving first-type data and second-type data from one or more user computers;
determining a respective priority for each of the first-type data and the second-type data, the priority of the first-type data is different than the priority of the second-type data;
sending the first-type data to a first queue for storage thereat and the second-type data to a second queue for storage thereat according to the determined priority; and
sending the first-type data and the second-type data from the first or second queue according to the defined rules for storage into the plurality of heterogeneous cloud data storage systems,
wherein one of the first and second queues takes a longer data processing time to send and store than the other of the first and second queues.

13. The computer program product according to claim 12 , wherein the method steps further comprise:
splitting at least one of the first-type data and the second-type data; and
sending the split data to each different cloud data storage system according to the defined rules.

14. The computer program product according to claim 12 , wherein the defining rules include:
specifying that each cloud data storage system stores a different type of data.

15. The computer program product according to claim 12 , wherein the method steps further comprise:
splitting at least one of the first-type data and the second-type data, and
wherein the defining rules include:
storing the split data at a cloud storage system whose resource usage to store the split data is lowest among the plurality of heterogeneous cloud data storage systems.

16. The computer program product according to claim 12 , wherein the method steps further comprise:
splitting at least one of the first-type data and the second-type data; and
encrypting the split data before storing the split data at the plurality of heterogeneous cloud data storage systems.

17. The computer program product according to claim 12 , wherein the first queue takes a data longer processing time than the second queue whose priority is lower than the first queue.

18. The computer program product according to claim 12 , wherein the first queue takes a data less processing time than the second queue whose priority is lower than the first queue.

Assignees

• IBM

Inventors

• De Sene Rafael Peria
• Dos Santos Tiago Nunes
• Folco Rafael Camarda Silva
• Leitao Breno Henrique

Classifications

• G06F16/1827

  Management specifically adapted to NAS (management of storage area networks [SAN] G06F3/067) · CPC title

• H04L67/1097 Primary

  for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS] · CPC title

• H04L47/821

  Prioritising resource allocation or reservation requests · CPC title

• G06F17/302

  Physics · mapped topic