Three dimensional grid compression storage

Patent metadata

Field	Value
Publication number	US-9692447-B2
Application number	US-201514682205-A
Country	US
Kind code	B2
Filing date	Apr 9, 2015
Priority date	Apr 9, 2015
Publication date	Jun 27, 2017
Grant date	Jun 27, 2017

Abstract

Various embodiments for data compression by a processor. Levels of data distribution are configured for data processing, including a first level of the data distribution incorporating a GRID network of data storage nodes, and a second level of the data distribution incorporating a GRID network of compressive nodes in communication with the GRID network of data storage nodes. Input/output (I/O) for an associated storage volume is load balanced between the data storage nodes, as data passes through the first level into the second level to be compressed or uncompressed.

First claim

What is claimed is:

1. A method for data compression by a processor, the method comprising:
configuring levels of data distribution for data processing, including a first level of the data distribution incorporating a GRID network of data storage nodes, and a second level of the data distribution incorporating a GRID network of compressive nodes in communication with the GRID network of data storage nodes;
wherein input/output (I/O) for an associated storage volume is load balanced between the data storage nodes, as data passes through the first level into the second level to be compressed or uncompressed.

2. The method of claim 1 , further including configuring the second level incorporating the GRID network of compressive nodes between the first level incorporating the GRID network of data storage nodes and an additional level incorporating a GRID network of interface nodes.

3. The method of claim 2 , further including directing the I/O from one of the interface nodes to one of the compressive nodes, or directing the I/O from one of the compressive nodes to one of the data storage nodes.

4. The method of claim 1 , further including pursuant to load balancing the I/O between the data storage nodes, upon a failure of one of the data storage nodes in the GRID network, redistributing the I/O among the remaining data storage nodes.

5. The method of claim 1 , further including organizing sections of the storage volume into a plurality of compression objects to be passed to the compressive nodes.

6. The method of claim 5 , further including directing the I/O to an appropriate one of the compressive nodes by determining a relationship between an associated section and the appropriate one of the compressive nodes in a compression distribution table.

7. The method of claim 6 , further including determining a section number as a function of a logical block address (LBA), a volume offset, a region size, and a number of sections.

8. A system for data compression, comprising:
a processor that configures levels of data distribution for data processing, including a first level of the data distribution incorporating a GRID network of data storage nodes, and a second level of the data distribution incorporating a GRID network of compressive nodes in communication with the GRID network of data storage nodes;
wherein input/output (I/O) for an associated storage volume is load balanced between the data storage nodes, as data passes through the first level into the second level to be compressed or uncompressed.

9. The system of claim 8 , wherein the processor configures the second level incorporating the GRID network of compressive nodes between the first level incorporating the GRID network of data storage nodes and an additional level incorporating a GRID network of interface nodes.

10. The system of claim 9 , wherein the processor directs the I/O from one of the interface nodes to one of the compressive nodes, or directs the I/O from one of the compressive nodes to one of the data storage nodes.

11. The system of claim 8 , wherein the processor, pursuant to load balancing the I/O between the data storage nodes, upon a failure of one of the data storage nodes in the GRID network, redistributes the I/O among the remaining data storage nodes.

12. The system of claim 8 , wherein the processor organizes sections of the storage volume into a plurality of compression objects to be passed to the compressive nodes.

13. The system of claim 12 , wherein the processor directs the I/O to an appropriate one of the compressive nodes by determining a relationship between an associated section and the appropriate one of the compressive nodes in a compression distribution table.

14. The system of claim 13 , wherein the processor determines a section number as a function of a logical block address (LBA), a volume offset, a region size, and a number of sections.

15. A computer program product for data compression by a processor, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:
a first executable portion that configures levels of data distribution for data processing, including a first level of the data distribution incorporating a GRID network of data storage nodes, and a second level of the data distribution incorporating a GRID network of compressive nodes in communication with the GRID network of data storage nodes;
wherein input/output (I/O) for an associated storage volume is load balanced between the data storage nodes, as data passes through the first level into the second level to be compressed or uncompressed.

16. The computer program product of claim 15 , further including a second executable portion that configures the second level incorporating the GRID network of compressive nodes between the first level incorporating the GRID network of data storage nodes and an additional level incorporating a GRID network of interface nodes.

17. The computer program product of claim 16 , further including a third executable portion that directs the I/O from one of the interface nodes to one of the compressive nodes, or directs the I/O from one of the compressive nodes to one of the data storage nodes.

18. The computer program product of claim 15 , further including a second executable portion that, pursuant to load balancing the I/O between the data storage nodes, upon a failure of one of the data storage nodes in the GRID network, redistributes the I/O among the remaining data storage nodes.

19. The computer program product of claim 15 , further including a second executable portion that organizes sections of the storage volume into a plurality of compression objects to be passed to the compressive nodes.

20. The computer program product of claim 19 , further including a third executable portion that directs the I/O to an appropriate one of the compressive nodes by determining a relationship between an associated section and the appropriate one of the compressive nodes in a compression distribution table.

21. The computer program product of claim 20 , further including a fourth executable portion that determines a section number as a function of a logical block address (LBA), a volume offset, a region size, and a number of sections.

Assignees

• IBM

Inventors

• Amit Jonathan
• Fischer-Toubol Jonathan
• Koifman Chaim
• Marenkov Sergey
• Nissan-Messing Orit
• Yaari Assaf

Classifications

• G06F3/0689 Primary

  Disk arrays, e.g. RAID, JBOD · CPC title

• H03M7/30

  Compression (speech analysis-synthesis for redundancy reduction G10L19/00; for image communication H04N); Expansion; Suppression of unnecessary data, e.g. redundancy reduction · CPC title

• H03M7/3057

  Distributed Source coding, e.g. Wyner-Ziv, Slepian Wolf · CPC title

• H03M7/6058

  Saving memory space in the encoder or decoder · CPC title

• H03M7/6041 Primary

  Compression optimized for errors · CPC title