Data compression utilizing low-ratio compression and delayed high-ratio compression

Patent metadata

Field	Value
Publication number	US-2020393968-A1
Application number	US-201916439789-A
Country	US
Kind code	A1
Filing date	Jun 13, 2019
Priority date	Jun 13, 2019
Publication date	Dec 17, 2020
Grant date	—

Abstract

An embodiment of the invention may include a method, computer program product and system for saving data received from a host computing device to a storage system. The storage system includes at least one processor and at least one storage. An embodiment may include storing the received data to the storage on a record basis. A record includes a record header including information indicative of an implemented compression method of the record. An embodiment may include monitoring a processing load of the at least one processor. In response to the processing load being less than a predetermined level, an embodiment may include further compressing the record utilizing a high-ratio compression method based on the record requiring further compression. An embodiment may include updating the record header information to reflect details of the utilized a high-ratio compression method. An embodiment may include storing the further compressed record to the storage.

First claim

What is claimed is:

1 . A computer-implemented method for saving data received from a host computing device to a storage system, wherein the storage system comprises at least one processor and at least one storage, the method comprising:
storing the received data to the storage on a record basis, wherein a record comprises a record header including information indicative of an implemented compression method of the record; monitoring a processing load of the at least one processor of the storage system; in response to the processing load being less than a predetermined level, further compressing the record utilizing a high-ratio compression method based on the record requiring further compression; updating the record header information to reflect details of the utilized a high-ratio compression method; and storing the further compressed record to the storage.

2 . The computer-implemented method of claim 1 , wherein storing the received data to the storage on a record basis further comprises:
performing a compression of the received data utilizing a low-ratio compression method; and adding, to the record, the record header, wherein the record header comprises a record ID, an identification of the utilized compression method, a compression ratio of the utilized compression method, a record length before compression, and a compressed record length.

3 . The computer-implemented method of claim 2 , wherein the low-ratio compression method is performed by the at least one processor of the storage system or by compression hardware of the storage system.

4 . The computer-implemented method of claim 1 , wherein the processing load of the at least one processor of the storage system is determined as being less than the predetermined level when the storage system is not processing an I/O request from the host computing device during a time period set by a user or during a time period the storage system is determined as not processing an I/O request.

5 . The computer-implemented method of claim 1 , wherein the record is determined to require further compression based on a compression ratio of the implemented compression method being less than a threshold value.

6 . The computer-implemented method of claim 1 , wherein the high-ratio compression method is performed by the at least one processor of the storage system or by compression hardware of the storage system.

7 . The computer-implemented method of claim 1 , wherein a file system of the storage system supports Sparse File.

8 . The computer-implemented method of claim 1 , further comprising:
identifying, in response to a read request from the host computing device, at least one record within the storage which corresponds to data requested by the read request; decompressing the identified at least one record based on record header information of the at least one record; and sending the decompressed record to the host computing device.

9 . A computer program product for saving data received from a host computing device to a storage system, wherein the storage system comprises at least one processor and at least one storage, the computer program product comprising:
one or more computer-readable tangible storage devices and program instructions stored on at least one of the one or more computer-readable tangible storage devices, wherein the program instructions are executable by a computer, the program instructions comprising:
program instructions to store the received data to the storage on a record basis, wherein a record comprises a record header including information indicative of an implemented compression method of the record;
program instructions to monitor a processing load of the at least one processor of the storage system;
in response to the processing load being less than a predetermined level, program instructions to further compress the record utilizing a high-ratio compression method based on the record requiring further compression;
program instructions to update the record header information to reflect details of the utilized a high-ratio compression method; and
program instructions to store the further compressed record to the storage.

10 . The computer program product of claim 9 , wherein program instructions to store the received data to the storage on a record basis further comprises:
program instructions to perform a compression of the received data utilizing a low-ratio compression method; and program instructions to add, to the record, the record header, wherein the record header comprises a record ID, an identification of the utilized compression method, a compression ratio of the utilized compression method, a record length before compression, and a compressed record length.

11 . The computer program product of claim 10 , wherein the low-ratio compression method is performed by the at least one processor of the storage system or by compression hardware of the storage system.

12 . The computer program product of claim 9 , wherein the processing load of the at least one processor of the storage system is determined as being less than the predetermined level when the storage system is not processing an I/O request from the host computing device during a time period set by a user or during a time period the storage system is determined as not processing an I/O request.

13 . The computer program product of claim 9 , wherein the record is determined to require further compression based on a compression ratio of the implemented compression method being less than a threshold value.

14 . The computer program product of claim 9 , wherein the high-ratio compression method is performed by the at least one processor of the storage system or by compression hardware of the storage system.

15 . A storage system for saving data received from a host computing device, the storage system comprising:
one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage devices, and program instructions stored on at least one of the one or more computer-readable tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, the program instructions comprising:
program instructions to store the received data to the one or more computer-readable tangible storage devices on a record basis, wherein a record comprises a record header including information indicative of an implemented compression method of the record;
program instructions to monitor a processing load of the one or more processors;
in response to the processing load being less than a predetermined level, program instructions to further compress the record utilizing a high-ratio compression method based on the record requiring further compression;
program instructions to update the record header information to reflect details of the utilized a high-ratio compression method; and
program instructions to store the further compressed record to the one or more computer-readable tangible storage devices.

16 . The storage system of claim 15 , wherein program instructions to store the received data to the one or more computer-readable tangible storage devices on a record basis further comprises:
program instructions to perform a compression of the received data utilizing a low-ratio compression method; and program instructions to add, to the record, the record header, wherein the record header comprises a record ID, an identification of the utilized compression method, a compression ratio of the utilized compression method, a record length b

Assignees

• IBM

Inventors

• Kawase Ryohta
• Tosaka Eiji
• Kawamura Kousei
• Masuda Koichi
• Mitsuma Shinsuke

Classifications

• H03M7/6029

  Pipelining · CPC title

• H03M7/607

  Selection between different types of compressors · CPC title

• H03M7/30

  Compression (speech analysis-synthesis for redundancy reduction G10L19/00; for image communication H04N); Expansion; Suppression of unnecessary data, e.g. redundancy reduction · CPC title

• G06F3/0683 Primary

  Plurality of storage devices · CPC title

• G06F3/0661

  Format or protocol conversion arrangements · CPC title