Reducing fragmentation in compressed journal storage

Patent metadata

Field	Value
Publication number	US-9703794-B2
Application number	US-201313732514-A
Country	US
Kind code	B2
Filing date	Jan 2, 2013
Priority date	Jan 2, 2013
Publication date	Jul 11, 2017
Grant date	Jul 11, 2017

Abstract

While discharging a data chunk, the chunk is compressed into a storage block. If the chunk is found to be too large to be able to be completely compressed into the storage block, certain characteristics of the data chunk are examined to determine whether or not the data chunk should be split. If the data chunk should be split, a remaining portion of the data chunk is compressed to a storage block that is next in chronological order to the original storage block. If the data chunk should not be split, all of the data chunk is moved to the next chronological storage block while leaving any remaining space in the storage block as unused.

First claim

What is claimed is:

1. A system for reducing fragmentation in compressed journal storage in a computing environment, comprising:
a processor device, configured in the computing storage environment, wherein the processor device:
in the compressed journal storage in which a user write size of a data chunk is unknown before compression, during the compression of the data chunk of a plurality of various sized compressed data blocks into a fixed size storage block when emitting the data chunk and when the data chunk is unable to be completely compressed into the storage block after attempting to completely compress the data chunk into the storage block:
analyzes a plurality of attributes of the data chunk, including whether a compressed journaling defragmentation process or a user initiated process emitted the data chunk, a remaining hole size, a size of the remaining data chunk, a ratio between two split pieces of the data chunk, a total size of holes in a storage system, an average compression ratio in the storage system, and a compression ratio in the storage block containing compressed data, for determining whether the data chunk should be split, wherein:
when the data chunk should be split, any possible remaining portion of the data chunk to a next chronological storage block is compressed, and
when the data chunk should not be split, all of the data chunk is moved to the next chronological storage block while any remaining space in the storage block is left as unused.

2. The system of claim 1 , wherein the processor device, during one of an update operation and a garbage collection operation on the storage block, performs one of:
preventing a splitting of the data chunks thereby leaving holes in the storage block, and
splitting the data chunks and placing the split data chunks into chronological storage blocks.

3. The system of claim 1 , wherein the processor device prevents a first unused portion of the storage block from being used for write operations until the entire portion of the storage block is freed.

4. The system of claim 1 , wherein the processor device is configured to use a second unused portion of the storage block for being used for write operations.

5. The system of claim 1 , wherein the processor device performs one of:
writing a portion of the data chunk, and
updating the remaining portion of the data chunk.

6. The system of claim 1 , wherein the processor device, if the data chunk is able to be completely compressed into the storage block, performs one of:
writing compressed data to the storage block, and
marking the compressed data as being written.

7. The system of claim 1 , wherein the processor device allocates the next chronological storage block.

8. A computer program product for reducing fragmentation in compressed journal storage in a computing environment by a processor device, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:
a first executable portion that:
in the compressed journal storage in which a user write size of a data chunk is unknown before compression, during the compression of the data chunk of a plurality of various sized compressed data blocks into a fixed size storage block when emitting the data chunk and when the data chunk is unable to be completely compressed into the storage block after attempting to completely compress the data chunk into the storage block:
analyzes a plurality of attributes of the data chunk, including whether a compressed journaling defragmentation process or a user initiated process emitted the data chunk, a remaining hole size, a size of the remaining data chunk, a ratio between two split pieces of the data chunk, a total size of holes in a storage system, an average compression ratio in the storage system, and a compression ratio in the storage block containing compressed data, for determining whether the data chunk should be split, wherein:
when the data chunk should be split, any possible remaining portion of the data chunk is compressed to a next chronological storage block, and
when the data chunk should not be split, all of the data chunk is moved to the next chronological storage block while any remaining space in the storage block is left as unused.

9. The computer program product of claim 8 , further including a second executable portion that, during one of an update operation and a garbage collection operation on the storage block, performs one of:
preventing a splitting of the data chunks thereby leaving holes in the storage block, and
splitting the data chunks and placing the split data chunks into chronological storage blocks.

10. The computer program product of claim 8 , further including a second executable portion that prevents a first unused portion of the storage block from being used for write operations until the entire portion of the storage block is freed.

11. The computer program product of claim 8 , further including a second executable portion that uses a second unused portion of the storage block for being used for write operations.

12. The computer program product of claim 8 , further including a second executable portion that performs one of:
writing a portion of the data chunk, and
updating the remaining portion of the data chunk.

13. The computer program product of claim 8 , further including a second executable portion that, if the data chunk is able to be completely compressed into the storage block, performs one of:
writing compressed data to the storage block, and
marking the compressed data as being written.

14. The computer program product of claim 8 , further including a second executable portion that allocates the next chronological storage block.

Assignees

• IBM

Inventors

• Amit Jonathan
• Marenkov Sergey
• Sasson Ben
• Shalev Ori

Classifications

• G06F16/1744 Primary

  using compression, e.g. sparse files · CPC title

• G06F16/1815

  Journaling file systems · CPC title

• G06F16/22

  Indexing; Data structures therefor; Storage structures · CPC title

• G06F17/30191

  Physics · mapped topic

• G06F17/30153 Primary

  Physics · mapped topic