Direct input/output path to compressed data

Patent metadata

Field	Value
Publication number	US-11269776-B2
Application number	US-201916656222-A
Country	US
Kind code	B2
Filing date	Oct 17, 2019
Priority date	Oct 17, 2019
Publication date	Mar 8, 2022
Grant date	Mar 8, 2022

Abstract

Techniques for providing a direct IO path to compressed data on storage media of a storage system. The techniques include triggering a transaction cache to perform a flush operation for updating mapping metadata for a storage object containing the compressed data. Having updated the mapping metadata for the storage object, the techniques further include issuing, by a copier module, an IO read request for the compressed data of the storage object to a namespace layer, which issues the IO read request to a mapping layer. The techniques further include forwarding the IO read request to a logical layer of the mapping layer, bypassing the transaction cache. The techniques further include reading, by the logical layer, the compressed data of the storage object from the storage media, and providing, via the mapping layer and the namespace layer, the compressed data to the copier module for transfer to a destination storage system.

First claim

What is claimed is:

1. A method of transferring data from a source data storage system to a destination data storage system, the source data storage system including a mapping layer, an input/output (IO) transaction cache, and storage media, the method comprising:
issuing an IO read request for compressed data of a storage object to the mapping layer of the source data storage system;
in response to the IO read request for compressed data of the storage object, obtaining, by the mapping layer, the compressed data of the storage object from the storage media of the source data storage system, while avoiding decompressing and caching the compressed data of the storage object; and
providing, by the mapping layer, the compressed data of the storage object for subsequent transmission or transfer to the destination data storage system,
wherein the compressed data of the storage object is compressed snapshot data of the storage object,
wherein the method further comprises:
comparing the compressed snapshot data against compressed data of the storage object to obtain differences in data between the compressed snapshot data and the compressed data of the storage object, and

wherein the providing of the compressed data of the storage object includes providing the differences in data between the compressed snapshot data and the compressed data of the storage object for subsequent transmission or transfer to the destination data storage system.

2. The method of claim 1 wherein the compressed data of the storage object is compressed read-only data of the storage object, and wherein the method further comprises:
validating that the IO read request for compressed data of the storage object is against a read-only storage extent.

3. The method of claim 1 further comprising:
issuing, over a data channel, an IO write request containing the compressed data of the storage object to the destination data storage system.

4. A source data storage system, comprising:
a memory configured to accommodate a mapping layer;
storage media; and
storage processing circuitry configured to execute program instructions out of the memory to:
issue an IO read request for compressed data of a storage object to the mapping layer;
in response to the IO read request for compressed data of the storage object, obtain, by the mapping layer, the compressed data of the storage object from the storage media, while avoiding decompressing and caching the compressed data of the storage object; and
provide, by the mapping layer, the compressed data of the storage object for subsequent transmission or transfer to a destination data storage system,
wherein the compressed data of the storage object is compressed snapshot data of the storage object, and
wherein the storage processing circuitry is further configured to execute the program instructions out of the memory to:
compare the compressed snapshot data against compressed data of the storage object to obtain differences in data between the compressed snapshot data and the compressed data of the storage object; and
provide the differences in data between the compressed snapshot data and the compressed data of the storage object for subsequent transmission or transfer to the destination storage system.

5. The source data storage system of claim 4 wherein the compressed data of the storage object is compressed read-only data of the storage object, and wherein the storage processing circuitry is further configured to execute the program instructions out of the memory to validate that the IO read request for compressed data of the storage object is against a read-only storage extent.

6. The source data storage system of claim 4 wherein the storage processing circuitry is further configured to execute the program instructions out of the memory to issue, over a data channel, an IO write request containing the compressed data of the storage object to the destination storage system.

7. A computer program product including a set of non-transitory, computer-readable media having instructions that, when executed by processing circuitry of a computerized apparatus, cause the processing circuitry to perform a method of transferring data from a source data storage system to a destination data storage system, the source data storage system including a mapping layer, an input/output (IO) transaction cache, and storage media, wherein the method comprises:
issuing an IO read request for compressed data of a storage object to the mapping layer of the source data storage system;
in response to the IO read request for compressed data of the storage object, obtaining, by the mapping layer, the compressed data of the storage object from the storage media of the source data storage system, while avoiding decompressing and caching the compressed data of the storage object; and
providing, by the mapping layer, the compressed data of the storage object for subsequent transmission or transfer to the destination data storage system,
wherein the compressed data of the storage object is compressed snapshot data of the storage object,
wherein the method further comprises:
comparing the compressed snapshot data against compressed data of the storage object to obtain differences in data between the compressed snapshot data and the compressed data of the storage object, and

wherein the providing of the compressed data of the storage object includes providing the differences in data between the compressed snapshot data and the compressed data of the storage object for subsequent transmission or transfer to the destination data storage system.

8. The computer program product of claim 7 wherein the compressed data of the storage object is compressed read-only data of the storage object, and wherein the method further comprises:
validating that the IO read request for compressed data of the storage object is against a read-only storage extent.

9. The computer program product of claim 7 further comprising:
issuing, over a data channel, an IO write request containing the compressed data of the storage object to the destination data storage system.

10. The method of claim 1 wherein the source data storage system further includes a namespace layer, and wherein the providing of the compressed data of the storage object for subsequent transmission or transfer to the destination data storage system includes, having avoided decompressing and caching the compressed data of the storage object, providing the compressed data of the storage object from the mapping layer to the namespace layer.

Assignees

• Emc Ip Holding Co Llc

Inventors

• Chen Xiangping
• Armangau Philippe
• Kucherov Anton
• Zhou Xunce
• Davenport William C

Classifications

• G06F3/0656

  Data buffering arrangements · CPC title

• G06F12/0868 Primary

  Data transfer between cache memory and other subsystems, e.g. storage devices or host systems · CPC title

• G06F2201/84

  Using snapshots, i.e. a logical point-in-time copy of the data · CPC title

• G06F9/30047

  Prefetch instructions; cache control instructions · CPC title

• G06F2201/835

  Timestamp · CPC title