Method, device and computer program product for parallel migration of data

Patent metadata

Field	Value
Publication number	US-10979502-B2
Application number	US-201816117622-A
Country	US
Kind code	B2
Filing date	Aug 30, 2018
Priority date	Apr 20, 2018
Publication date	Apr 13, 2021
Grant date	Apr 13, 2021

Abstract

Embodiments of the present disclosure provide a method, device and computer program product for migrating data. The method comprises initiating a first migration job for a first client and a second migration job for a second client. The method also comprises setting a first cache file for the first client and a second cache file for the second client, and a cache file records a hash value of a migrated file of a client. Moreover, the method further comprises executing the first migration job and the second migration job in parallel, wherein the first migration job is executed using the first cache file and the second migration job is executed using the second cache file.

First claim

We claim:

1. A method for migrating data, comprising:
initiating a first migration job for a first client and a second migration job for a second client; and
in response to the initiating, executing the first migration job and the second migration job in parallel, the execution of the first migration job using a first cache file and the execution of the second migration job using a second cache file,
wherein the first cache file is associated with the first client and the second cache file is associated with the second client, and
wherein executing the first migration job and the second migration job comprises:
determining a parallel number of migration jobs using a table, the parallel number indicating a number of migration jobs to be executed in parallel, the table contents based on hardware information, file size, and results of testing different file sizes and different parallel numbers on a migration platform; and
initiating a plurality of migration jobs corresponding to the parallel number, the plurality of migration jobs comprising the first migration job and the second migration job;

setting a first identification for the first migration job;
setting a second identification for the second migration job; and
monitoring the first migration job and the second migration job using the first identification and the second identification, respectively, during parallel execution of the first migration job and the second migration job,
wherein monitoring the first migration job and the second migration job comprises acquiring current progress information of the first migration job and the second migration job.

2. The method of claim 1 , wherein the executing the first migration job and the second migration job in parallel comprises:
in response to a first hash value of a first file being present in the first cache file, discarding a migration of the first file; and
in response to a second hash value of a second file being absent in the first cache file, executing a migration of the second file.

3. The method of claim 1 , wherein,
in response to detecting a fault, determining, based on the current progress information, a migration job associated with the fault, wherein the migration job is one selected from the group consisting of the first migration job and the second migration job.

4. The method of claim 1 , wherein the first migration job and the second migration job are used for migrating data from a source server to a target server, and the method further comprises:
setting, in the target server, a first storage path for the first client and a second storage path for the second client, the first storage path being different from the second storage path.

5. The method of claim 1 , wherein the results of the testing including usage of a processor, usage of a memory and a rate of data migration.

6. A device for migrating data, comprising:
a processing unit; and
a memory coupled to the processing unit and stored with instructions, the instructions, when executed by the processing unit, performing a method, the method comprising:
initiating a first migration job for a first client and a second migration job for a second client; and
executing the first migration job and the second migration job in parallel, the execution of the first migration job using a first cache file and the execution of the second migration job using a second cache file,

wherein the first cache file is associated with the first client and the second cache file is associated with the second client, and
wherein executing the first migration job and the second migration job comprises:
determining a parallel number of migration jobs using a table, the parallel number indicating a number of migration jobs to be executed in parallel, the table contents based on hardware information, a file size, and results of testing different file sizes and different parallel numbers on a migration platform; and
initiating a plurality of migration jobs corresponding to the parallel number, the plurality of migration jobs comprising the first migration job and the second migration job;

setting a first identification for the first migration job;
setting a second identification for the second migration job; and
monitoring the first migration job and the second migration job using the first identification and the second identification, respectively, during parallel execution of the first migration job and the second migration job,
wherein monitoring the first migration job and the second migration job comprises acquiring current progress information of the first migration job and the second migration job.

7. The device of claim 6 , wherein executing the first migration job and the second migration job in parallel comprises:
in response to a first hash value of a first file being present in the first cache file, discarding a migration of the first file; and
in response to a second hash value of a second file being absent in the first cache file, executing a migration of the second file.

8. The device of claim 6 , wherein,
in response to detecting a fault, determining, based on the current progress information, a migration job associated with the fault, wherein the migration job is one selected from a group consisting of the first migration job and the second migration job.

9. The device of claim 6 , wherein the first migration job and the second migration job are used for migrating data from a source server to a target server, and the method further comprises:
setting, in the target server, a first storage path for the first client and a second storage path for the second client, the first storage path being different from the second storage path.

10. The device of claim 6 , wherein the results of the testing including usage of a processor, usage of a memory and a rate of data migration.

11. A computer program product tangibly stored on a non-transient computer-readable medium and including computer-executable instructions, the computer-executable instructions, when executed, causing a computer to perform a method, the method comprising:
initiating a first migration job for a first client and a second migration job for a second client; and
in response to the initiating, executing the first migration job and the second migration job in parallel, the execution of the first migration job using a first cache file and the execution of the second migration job using a second cache file,
wherein the first cache file is associated with the first client and the second cache file is associated with the second client, and
wherein executing the first migration job and the second migration job comprises:
determining a parallel number of migration jobs using a table, the parallel number indicating a number of migration jobs to be executed in parallel, the table contents based on hardware information, a file size, and results of testing different file sizes and different parallel numbers on a migration platform; and

initiating a plurality of migration jobs corresponding to the parallel number, the plurality of migration jobs comprising the first migration job and the second migration job;

setting a first identification for the first migration job;
setting a second identification for the second migration job; and
monitoring the first migration job and the second migration job using the first identification and the second identification, respectively, during parallel execution of the first migration job and the second migration job,
wherein monitoring the first migration job and the second migration job comprises acquiring current progress information of the first migration job and the second migration job.

Assignees

• Emc Ip Holding Co Llc

Inventors

• Wang Yi
• Zhang Xinwang
• Lin Lili
• Zheng Qingxiao
• Wang Yang

Classifications

• H04L67/1097 Primary

  for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS] · CPC title

• G06F16/119 Primary

  Details of migration of file systems (migration mechanisms in storage systems G06F3/0647) · CPC title

• H04L67/5683

  Storage of data provided by user terminals, i.e. reverse caching · CPC title

• H04L67/01

  Protocols · CPC title

• G06F11/1448

  Management of the data involved in backup or backup restore · CPC title