Intelligent data compression

Patent metadata

Field	Value
Publication number	US-10013170-B1
Application number	US-201615086747-A
Country	US
Kind code	B1
Filing date	Mar 31, 2016
Priority date	Mar 31, 2016
Publication date	Jul 3, 2018
Grant date	Jul 3, 2018

Abstract

Determining whether to compress data of a virtual storage unit based at least in part on: an I/O activity value of a virtual storage unit; a compressibility value of the virtual storage unit; and/or a capacity utilization of the storage system or a component thereof. For example, decision logic may be configured based on one or more of such parameters such that virtual storage units with relatively high I/O activities are rarely or never compressed, e.g., to avoid the disproportionately high increases in CPU and bandwidth resource consumption and I/O latency this could create. Decision logic may be configured such that, in general, the likelihood that a virtual storage unit will be compressed increases as: the I/O activity of the virtual storage unit decreases; the system capacity utilization increases; and/or as the compressibility value of the virtual storage unit increases.

First claim

What is claimed is:

1. For a system comprising one or more physical data storage media and a plurality of virtual storage units, each virtual storage unit associated with one or more physical address ranges of the one or more physical storage media, a method comprising, for first data associated with a first of the plurality of virtual storage units, an act of:
determining whether to compress the first data based at least in part on an I/O activity value of the first virtual storage unit;
if it is determined to compress the first data, initiating compression of the first data; and
determining whether to update a compressibility value in response to determining whether to compress the first data, wherein the compressibility value is associated with a compressibility level that is based upon an achievable compressibility value.

2. The method of claim 1 , wherein the act of determining whether to compress the first data is based at least in part on a compressibility value of the first virtual storage unit.

3. The method of claim 1 , further comprising an act of:
determining whether to update a compressibility value of the first virtual storage unit; and
if it is determined to update the compressibility value of the first virtual storage unit, updating the compressibility value.

4. The method of claim 1 , wherein the act of determining whether to compress the first data is based at least in part on a storage capacity utilization of the storage media or a subcomponent thereof.

5. The method of claim 1 , wherein the act of determining whether to compress the first data is performed in response to receiving a write I/O request for the first data.

6. The method of claim 1 , further comprising, prior to performing the act of determining whether to compress the first data, acts of:
receiving an initial write I/O request for the first virtual storage unit, to write second data to a first one or more physical address ranges associated with the first virtual storage unit; and
determining a compressibility value of the first virtual storage unit based on a compressibility of the second data, irrespective of a storage capacity utilization of the storage media or a subcomponent thereof.

7. The method of claim 1 , further comprising:
determining that the compressibility value has not been determined for the first data for at least a threshold amount of time; and
in response to determining that the compressibility value has not been determined for at least the threshold amount of time, determining a compressibility value for the first data.

8. A system comprising:
one or more physical data storage media and a plurality of virtual storage units, each virtual storage unit associated with one or more physical address ranges of the one or more physical storage media;
first logic operative to, for first data associated with a first of the plurality of virtual storage units, determining whether to compress the first data based at least in part on an I/O activity value of the first virtual storage unit;
second logic to initiate compression of the first data if it is determined to compress the first data; and
fifth logic operative to determining whether to update a compressibility value in response to determining whether to compress the first data, wherein the compressibility value is associated with a compressibility level that is based upon an achievable compressibility value.

9. The system of claim 8 , wherein the first logic is operative to determine whether to compress the first data based at least in part on a compressibility value of the first virtual storage unit.

10. The system of claim 8 , further comprising:
third logic to determine whether to update a compressibility value of the first virtual storage unit; and
fourth logic to update the compressibility value of the first virtual storage unit if it is determined to update the compressibility value.

11. The system of claim 8 , wherein the first logic is operative to determine whether to compress the first data based at least in part on a storage capacity utilization of the storage media or a subcomponent thereof.

12. The system of claim 8 , wherein the first logic is operative to determine whether to compress the first data in response to receiving a write I/O request for the first data.

13. The system of claim 8 , wherein the first logic is operative, for an initial write I/O request for the first virtual storage unit specifying to write second data to a first one or more physical address ranges associated with the first virtual storage unit, to determine a compressibility value of the first virtual storage unit based on a compressibility of the second data, irrespective of a storage capacity utilization of the storage media or a subcomponent thereof.

14. The system of claim 8 , further comprising:
third logic to determine that the compressibility value has not been determined for the first data for at least a threshold amount of time; and
fourth logic to determine the compressibility value for the first data in response to determining that the compressibility value has not been determined for at least the threshold amount of time.

15. A non-transitory computer-readable medium encoded with computer-executable instructions that, as a result of being executed by a computer, control the computer to perform, for a system comprising one or more physical data storage media and a plurality of virtual storage units, each virtual storage unit associated with one or more physical address ranges of the one or more physical storage media, a method comprising, for first data associated with a first of the plurality of virtual storage units, an act of:
determining whether to compress the first data based at least in part on an I/O activity value of the first virtual storage unit;
if it is determined to compress the first data, initiating compression of the first data; and
determining whether to update a compressibility value in response to determining whether to compress the first data, wherein the compressibility value is associated with a compressibility level that is based upon an achievable compressibility value.

16. The computer-readable medium of claim 15 , wherein the act of determining whether to compress the first data is based at least in part on a compressibility value of the first virtual storage unit.

17. The computer-readable medium of claim 15 , wherein the method further comprises an act of:
determining whether to update a compressibility value of the first virtual storage unit; and
if it is determined to update the compressibility value of the first virtual storage unit, updating the compressibility value.

18. The computer-readable medium of claim 15 , wherein the act of determining whether to compress the first data is based at least in part on a storage capacity utilization of the storage media or a subcomponent thereof.

19. The computer-readable medium of claim 15 , wherein the act of determining whether to compress the first data is performed in response to receiving a write I/O request for the first data.

20. The computer-readable medium of claim 15 , wherein the method further comprises, prior to performing the act of determining whether to compress the first data, acts of:
receiving an initial write I/O request for the first virtual storage unit, to write second data to a first one or more physical address ranges associated with the first virtual storage unit; and
determining a compressibility value of the first virtual storage unit based on a

Assignees

• Emc Corp
• Emc Ip Holding Co Llc

Inventors

• Sahin Adnan
• Martin Owen
• O'Hare Jeremy J

Classifications

• G06F3/0661

  Format or protocol conversion arrangements · CPC title

• G06F3/0608 Primary

  Saving storage space on storage systems · CPC title

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title

• G06F3/0683

  Plurality of storage devices · CPC title

• G06F3/0665

  at area level, e.g. provisioning of virtual or logical volumes · CPC title