Method, device, and computer program product for managing data transfer

Patent metadata

Field	Value
Publication number	US-11281610-B2
Application number	US-202017064763-A
Country	US
Kind code	B2
Filing date	Oct 7, 2020
Priority date	Aug 7, 2020
Publication date	Mar 22, 2022
Grant date	Mar 22, 2022

Abstract

Embodiments of the present disclosure relate to a method, a device, and a computer program product for managing data transfer. A method for managing data transfer is provided, including: if determining that a request to transfer a data block between a memory and a persistent memory of a data storage system is received, obtaining a utilization rate of a central processing unit of the data storage system; and determining, from a first transfer technology and a second transfer technology and at least based on the utilization rate of the central processing unit, a target transfer technology for transferring a data block between the memory and the persistent memory, the first transfer technology transferring data through direct access to the memory, and the second transfer technology transferring data through the central processing unit. Therefore, the embodiments of the present disclosure can improve the data transfer performance of the storage system.

First claim

The invention claimed is:

1. A method for managing data transfer, comprising:
if determining that a request to transfer a data block between a memory and a persistent memory of a data storage system is received, obtaining a utilization rate of a central processing unit of the data storage system, wherein the utilization rate is obtained through a data storage system bus; and
determining, from a first transfer technology and a second transfer technology and at least based on the utilization rate of the central processing unit, a target transfer technology for transferring a data block between the memory and the persistent memory, the first transfer technology transferring data through direct access to the memory, and the second transfer technology transferring data through the central processing unit, wherein determining the target transfer technology comprises if determining that the utilization rate is lower than a threshold utilization rate, determining the second transfer technology as the target transfer technology, wherein the first transfer technology is an input-output accelerated direct memory access technology, the input-output accelerated direct memory access technology using parallel channels to transfer data, and wherein the second transfer technology is a central processing unit memory replication technology, the central processing unit memory replication technology transferring data in a serial manner.

2. The method according to claim 1 , wherein determining the target transfer technology further comprises:
if determining that the utilization rate is higher than or equal to the threshold utilization rate,
obtaining a size of the data block to be transferred, and
determining the target transfer technology based on the size of the data block.

3. The method according to claim 2 , wherein determining the target transfer technology based on the size of the data block comprises:
if determining that the size of the data block is larger than a threshold size, determining the first transfer technology as the target transfer technology, wherein the threshold size is determined by reading a threshold size table storing a plurality of preset threshold sizes for different data storage systems; and
if determining that the size of the data block is smaller than or equal to the threshold size, determining the second transfer technology as the target transfer technology.

4. The method according to claim 2 , wherein the threshold size is preset based on at least one of a hardware configuration of the data storage system, central processing unit performance, and a size distribution of the data block.

5. The method according to claim 1 , wherein the data storage system is a storage system for deduplication process comprising a data stream buffer and a slice.

6. The method according to claim 1 , further comprising: in response to determining that the received request to transfer the data block between the memory and the persistent memory of the data storage system is not the request from a data domain, directly determining to use the central processing unit memory replication technology to transfer data associated with the request.

7. An electronic device, comprising:
at least one processor; and
at least one memory storing computer program instructions, the at least one memory and the computer program instructions being configured to cause, together with the at least one processor, the electronic device to perform actions comprising:
if determining that a request to transfer a data block between a memory and a persistent memory of a data storage system is received, obtaining a utilization rate of a central processing unit of the data storage system, wherein the utilization rate is obtained through a data storage system bus; and
determining, from a first transfer technology and a second transfer technology and at least based on the utilization rate of the central processing unit, a target transfer technology for transferring a data block between the at least one memory and the persistent memory, the first transfer technology transferring data through direct access to the at least one memory, and the second transfer technology transferring data through the central processing unit, wherein determining the target transfer technology comprises if determining that the utilization rate is lower than a threshold utilization rate, determining the second transfer technology as the target transfer technology, wherein the first transfer technology is an input-output accelerated direct memory access technology, the input-output accelerated direct memory access technology using parallel channels to transfer data, and wherein the second transfer technology is a central processing unit memory replication technology, the central processing unit memory replication technology transferring data in a serial manner.

8. The electronic device according to claim 7 , wherein determining the target transfer technology further comprises:
if determining that the utilization rate is higher than or equal to the threshold utilization rate,
obtaining a size of the data block to be transferred, and
determining the target transfer technology based on the size of the data block.

9. The electronic device according to claim 8 , wherein determining the target transfer technology based on the size of the data block comprises:
if determining that the size of the data block is larger than a threshold size, determining the first transfer technology as the target transfer technology, wherein the threshold size is determined by reading a threshold size table storing a plurality of preset threshold sizes for different data storage systems; and
if determining that the size of the data block is smaller than or equal to the threshold size, determining the second transfer technology as the target transfer technology.

10. The electronic device according to claim 7 , wherein the data storage system is a storage system for deduplication process comprising a data stream buffer and a slice.

11. A computer program product tangibly stored in a non-transitory computer storage medium and including machine-executable instructions, which when executed by a device, cause the device to perform actions, the actions comprising:
if determining that a request to transfer a data block between a memory and a persistent memory of a data storage system is received, obtaining a utilization rate of a central processing unit of the data storage system, wherein the utilization rate is obtained through a data storage system bus; and
determining, from a first transfer technology and a second transfer technology and at least based on the utilization rate of the central processing unit, a target transfer technology for transferring a data block between the memory and the persistent memory, the first transfer technology transferring data through direct access to the memory, and the second transfer technology transferring data through the central processing unit, wherein determining the target transfer technology comprises if determining that the utilization rate is lower than a threshold utilization rate, determining the second transfer technology as the target transfer technology, wherein the first transfer technology is an input-output accelerated direct memory access technology, the input-output accelerated direct memory access technology using parallel channels to transfer data, and wherein the second transfer technology is a central processing unit memory replication technology, the central processing unit memory replication technology transferring data in a serial manner.

12. The computer program product according to claim 11 , wherein determinin

Assignees

• Emc Ip Holding Co Llc

Inventors

• Gong Shuguang
• Wang Long
• Chen Tao
• Liu Bing

Classifications

• G06F3/0689

  Disk arrays, e.g. RAID, JBOD · CPC title

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title

• G06F3/0659

  Command handling arrangements, e.g. command buffers, queues, command scheduling · CPC title

• G06F3/0634

  by changing the state or mode of one or more devices · CPC title

• G06F3/0619

  in relation to data integrity, e.g. data losses, bit errors · CPC title