Efficient migration of replicated files from a file server having a file de-duplication facility

Patent metadata

Field	Value
Publication number	US-9323758-B1
Application number	US-64484909-A
Country	US
Kind code	B1
Filing date	Dec 22, 2009
Priority date	Dec 22, 2009
Publication date	Apr 26, 2016
Grant date	Apr 26, 2016

Abstract

Needless migration of duplicate file data is avoided by recording in a database a record of migration of a first instance of a replicated file from a source file server to a target file server. When migrating a subsequent instance of a replicated file to the target file server, the database is searched for a record of replication of a first instance of the replicated file to the target file server. If such a record is found, the subsequent instance is replicated by sending from the source file server to the target file server attributes of the subsequent instance of the replicated file and an identification of the previously migrated data of the replicated file without re-transmission of the previously migrated data of the replicated file.

First claim

What is claimed is:

1. A computer-implemented method of at least one data processor executing a file migration program in memory in response to a request for migration of a specified file from a source file server to a target file server in a data network, said method comprising the steps of:
(a) searching storage in the data network for a record indicating that the target file server contains a replica of the specified file, the replica of the specified file having data of the specified file, and the replica of the specified file having attributes different from attributes of the specified file; and
(b) in response to finding a record indicating that the target file server contains a replica of the specified file, creating a copy of the specified file in the target file server by copying the attributes but not the data of the specified file from the source file server to the target file server and associating the copied attributes of the specified file in the target file server with the data of the replica of the specified file in the target file server.

2. The computer-implemented method as claimed in claim 1 , wherein the method further includes storing the record indicating that the target file server contains a replica of the specified file when the execution of the file migration program determines that a first instance of a replicated file is being migrated to the target file server.

3. The computer-implemented method as claimed in claim 1 , wherein the record indicating that the target file server contains a replica of the specified file includes a file identifier of the replica and an identifier of the data of the replica, and wherein the step (a) of searching storage includes searching the storage for a record containing a specified identifier of data in the specified file and finding the file identifier of the replica associated with the specified identifier of the data of the replica.

4. The computer-implemented method as claimed in claim 3 , wherein the method further includes searching storage of the source file server to find the specified identifier of the data in the specified file.

5. The computer-implemented method as claimed in claim 3 , wherein the method further includes searching the storage of the source file server to determine whether storage of the source file server contains more than one replica of the specified file, and in response to determining that the storage of the source file server contains more than one replica of the specified file, obtaining the specified identifier of the data in the specified file from the storage of the source file server in order to perform the copying of the attributes but not the data of the specified file from the source file server to the target file server and the associating of the copied attributes of the specified file in the target file server with the data of the replica of the specified file in the target file server, and otherwise copying the attributes and the data of the specified file to the target file server when the storage of the source file server does not contain more than one replica of the specified file.

6. A computer-implemented method of at least one data processor executing a file migration program in memory to migrate instances of a replicated file from a source file server to a target file server, each of the instances of the replicated file having the same file data but having different file attributes, said method comprising:
upon migration of attributes and data of a first instance of the replicated file from the source file server to the target file server, recording in a database a record of migration of the first instance of the replicated file from the source file server to the target file server; and
upon migration of a second instance of the replicated file, searching the database for a record of a prior migration of an instance of the replicated file, and in response to finding the record of the migration of the first instance of the replicated file in the database, migrating the second instance of the replicated file from the source file server to the target file server by sending from the source file server to the target file server attributes of the second instance of the replicated file and an identification of the previously migrated data of the replicated file so that the second instance of the replicated file is migrated from the source file server to the target file server without re-transmission of the previously migrated data of the replicated file;
which further includes said at least one data processor executing a file de-duplication program in memory in order to de-duplicate instances of the replicated file to produce file inodes sharing data of the replicated file in storage of the source file server, the execution of the file de-duplication program producing a reference count of the file inodes sharing the data of the replicated file in the storage of the source file server, and the recording in the database of the migration of the first instance of the replicated file from the source file server to the target file server being performed in response to execution of the migration program finding that the reference count is greater than one upon migrating the first instance of the replicated file.

7. A computer-implemented method of at least one data processor executing a file migration program in memory to migrate instances of a replicated file from a source file server to a target file server, each of the instances of the replicated file having the same file data but having different file attributes, said method comprising:
upon migration of attributes and data of a first instance of the replicated file from the source file server to the target file server, recording in a database a record of migration of the first instance of the replicated file from the source file server to the target file server; and
upon migration of a second instance of the replicated file, searching the database for a record of a prior migration of an instance of the replicated file, and in response to finding the record of the migration of the first instance of the replicated file in the database, migrating the second instance of the replicated file from the source file server to the target file server by sending from the source file server to the target file server attributes of the second instance of the replicated file and an identification of the previously migrated data of the replicated file so that the second instance of the replicated file is migrated from the source file server to the target file server without re-transmission of the previously migrated data of the replicated file;
which further includes said at least one data processor executing a file de-duplication program in memory in order to de-duplicate instances of the replicated file to produce file inodes sharing data of the replicated file in storage of the source file server, the execution of the file de-duplication program producing a reference count of the file inodes sharing the data of the replicated file in the storage of the source file server, and the searching of the database for a record of a prior migration of an instance of the replicated file being performed in response to execution of the migration program finding that the reference count is greater than one upon migrating the second instance of the replicated file.

8. A data processing system comprising:
a source file server and a target file server in a data network; and
memory containing a file migration program, the file migration program being executed by at least one data processor in the data processing system to migrate instances of a replicated file from the source file server to the target file server, each of the instances of the replicate

Assignees

• Stacey Christopher H
• Lemahieu Paul
• Emc Corp

Inventors

• Stacey Christopher H
• Lemahieu Paul

Classifications

• G06F17/30088

  Physics · mapped topic

• G06F11/1446

  Point-in-time backing up or restoration of persistent data · CPC title

• G06F17/30097

  Physics · mapped topic

• G06F17/30073 Primary

  Physics · mapped topic

• G06F16/137

  Hash-based (content-based indexing of textual data G06F16/31) · CPC title