High performance data storage management using dynamic compression

Patent metadata

Field	Value
Publication number	US-9760310-B2
Application number	US-201514819811-A
Country	US
Kind code	B2
Filing date	Aug 6, 2015
Priority date	Aug 6, 2015
Publication date	Sep 12, 2017
Grant date	Sep 12, 2017

Abstract

Embodiments of the present invention allow a data segment stored in a compressed format to be directly staged into a cache allowing access to the data segment. In operation, a request to access a data segment is received. In response, whether the data segment is stored in a compressed format is determined. If the data segment is stored in the compressed format, the data segment is staged directly into a cache.

First claim

What is claimed is:

1. A computer-implemented method for data storage management using dynamic compression, the computer-implemented method comprising:
receiving, by one or more computer processors, a request to access a data segment;
determining, by the one or more computer processors, whether the data segment is stored in a compressed format;
responsive to determining that the data segment is stored in the compressed format on a compressed storage medium, staging, by the one or more computer processors, the data segment directly into a cache from the compressed storage medium and decompressing the data segment;
responsive to determining that the data segment is stored in the compressed format on a non-compressed storage medium, staging, by the one or more computer processors, the data segment directly into the cache from the non-compressed storage medium and decompressing the data segment;
determining, by the one or more computer processors, a hot degree of the data segment during a time period of a predetermined length;
responsive to determining that the hot degree is below a predetermined threshold, destaging, by the one or more computer processors, the data segment from the cache, compressing, the data segment to create a compressed data segment and storing the compressed data segment; and
responsive to determining that the hot degree is below a second predetermined threshold and determining that the data segment is not stored in the compressed format on a non-compressed storage medium, migrating, by the one or more computer processors, the data segment by compressing the data segment and storing the data segment in the non-compressed storage medium in the compressed format or compressing the data segment and storing the data segment in the compressed storage medium in the compressed format.

2. The computer-implemented method of claim 1 , further comprising:
responsive to determining that the hot degree is below a first predetermined threshold, destaging, by the one or more computer processors, the data segment from the cache to the non-compressed storage medium in the non-compressed format.

3. The computer-implemented method of claim 1 , wherein determining the hot degree of the data segment during the time period comprises:
determining, by the one or more computer processors, an access count of the data segment in the time period as the hot degree.

4. The computer-implemented method of claim 3 , wherein determining an access count of the data segment in the time period comprises:
dividing the time period into a plurality of sub-periods;
determining a sub-count of the data segment for each of the plurality of sub-periods; and
determining the access count of the data segment in the time period based on the sub-count of the data segment for each of the plurality of sub-periods.

5. The computer-implemented method of claim 1 , wherein storing the compressed data segment comprises one of:
storing, by the one or more computer processors, the compressed data segment in the compressed storage medium; or
storing, by the one or more computer processors, the compressed data segment in the non-compressed storage medium.

6. A device for data storage management using dynamic compression, the device comprising:
one or more processors;
a memory coupled to at least one of the processors;
a set of computer program instructions stored in the memory and executed by at least one of the processors in order to perform actions comprising:
receiving, by one or more computer processors, a request to access a data segment;
determining, by the one or more computer processors, whether the data segment is stored in a compressed format;
responsive to determining that the data segment is stored in the compressed format on a compressed storage medium, staging, by the one or more computer processors, the data segment directly into a cache from the compressed storage medium and decompressing the data segment;
responsive to determining that the data segment is stored in the compressed format on a non-compressed storage medium, staging, by the one or more computer processors, the data segment directly into the cache from the non-compressed storage medium and decompressing the data segment;
determining, by the one or more computer processors, a hot degree of the data segment during a time period of a predetermined length;
responsive to determining that the hot degree is below a predetermined threshold, destaging, by the one or more computer processors, the data segment from the cache, compressing, the data segment to create a compressed data segment and storing the compressed data segment; and
responsive to determining that the hot degree is below a second predetermined threshold and determining that the data segment is not stored in the compressed format on a non-compressed storage medium, migrating, by the one or more computer processors, the data segment by compressing the data segment and storing the data segment in the non-compressed storage medium in the compressed format or compressing the data segment and storing the data segment in the compressed storage medium in the compressed format.

7. The device of claim 6 , wherein the actions further comprise:
responsive to determining that the hot degree is below a first predetermined threshold, destaging, by the one or more computer processors, the data segment from the cache to the non-compressed storage medium in the non-compressed format.

8. The device of claim 6 , wherein the actions further comprise:
determining, by the one or more computer processors, an access count of the data segment in the time period as the hot degree.

9. The device of claim 8 , wherein the actions further including:
dividing the time period into a plurality of sub-periods;
determining a sub-count of the data segment for each of the plurality of sub-periods; and
determining the access count of the data segment in the time period based on the sub-count of the data segment for each of the plurality of sub-periods.

10. The device of claim 6 , wherein storing the compressed data segment comprises one of:
storing, by the one or more computer processors, the compressed data segment in the compressed storage medium; or
storing, by the one or more computer processors, the compressed data segment in the non-compressed storage medium.

11. A computer program product for data storage management using dynamic compression, the computer program product comprising:
one or more non-transient computer readable storage media and program instructions tangibly stored on the one or more non-transient computer readable storage media, the program instructions comprising:
program instructions to receive, by one or more computer processors, a request to access a data segment;
program instructions to determine, by the one or more computer processors, whether the data segment is stored in a compressed format;
program instructions to respond to determining that the data segment is stored in the compressed format on a compressed storage medium, staging, by the one or more computer processors, the data segment directly into a cache from the compressed storage medium and decompressing the data segment;
program instructions to respond to determining that the data segment is stored in the compressed format on a non-compressed storage medium, staging, by the one or more computer processors, the data segment directly into the cache from the non-compressed storage medium and decompressing the data segment;
program instructions to determine, by the one or more computer processors, a hot degree of the data segment during a time period of a predetermined length;
program instructions to res

Assignees

• IBM

Inventors

• Feng Yicheng
• He Shiwen
• Liao Jun
• Wang dan dan
• Yin Wen Bao

Classifications

• G06F3/0683

  Plurality of storage devices · CPC title

• G06F3/0638

  Organizing or formatting or addressing of data · CPC title

• G06F12/0868

  Data transfer between cache memory and other subsystems, e.g. storage devices or host systems · CPC title

• G06F3/0656 Primary

  Data buffering arrangements · CPC title

• G06F3/0608

  Saving storage space on storage systems · CPC title