Datacenter relocation utilizing storage carriers and erasure coding

Patent metadata

Field	Value
Publication number	US-11662933-B2
Application number	US-201816169337-A
Country	US
Kind code	B2
Filing date	Oct 24, 2018
Priority date	Oct 24, 2018
Publication date	May 30, 2023
Grant date	May 30, 2023

Abstract

Computer implemented systems and methods for migrating datacenter data include providing a quantity of carriers having a data storage capacity, receiving, by the quantity of carriers, a quantity of data stored in a first data storage system having a first location and including erasure coded data blocks. The quantity of carriers migrates to a second data storage system having a second location; and transmits the quantity of data to the second data storage system.

First claim

What is claimed is:

1. A method for migrating data, the method comprising:
providing a quantity of carriers having a data storage capacity;
receiving, by the quantity of carriers, a quantity of data stored in a first data storage system having a first location, wherein the quantity of data comprises erasure coded data blocks;
migrating the quantity of carriers to a second data storage system having a second location;
during the migrating the quantity of carriers to the second data storage system having the second location, monitoring for the loss of a carrier;
in response to determining from the monitoring that a certain carrier of the quantity of carriers is missing, reconstructing data blocks stored on the certain carrier using a reconstruction protocol and storing the reconstructed data blocks on a substitute carrier; and
transmitting, by the quantity of carriers including the substitute carrier, the erasure coded data blocks to the second data storage system.

2. The method according to claim 1 wherein providing a quantity of carriers having a data storage capacity comprises providing a quantity of carriers having a data storage capacity greater than the quantity of data stored in the first data storage system.

3. The method according to claim 1 wherein receiving the erasure coded data blocks by the quantity of carriers comprises receiving the erasure coded data blocks using a data transfer protocol selected from the group consisting of: iSCSI (Internet Small Computer System Interface) over a UDP (User Datagram Protocol) network, and iFCP (Internet File Communications Protocol) over a UDP network.

4. The method according to claim 1 wherein migrating the quantity of carriers to a second data storage system includes flying a set of carriers from the first location to the second location.

5. The method according to claim 1 further comprising receiving destination GPS (Global Positioning System) coordinates for the second location by the set of carriers.

6. The method according to claim 1 wherein receiving, by the quantity of carriers, a quantity of data stored in a first data storage system having a first location, wherein the quantity of data comprises erasure coded data blocks includes receiving, by the quantity of carriers, a quantity of data stored in a first data storage system having a first location, wherein the quantity of data comprises erasure coded data blocks having an IP (Internet Protocol) address assigned to each erasure coded data block.

7. The method according to claim 1 further comprising reconstructing a portion of the erasure coded data blocks as the quantity of carriers are migrating from the first data storage system to the second data storage system.

8. The method of claim 1 , wherein the reconstructing data blocks stored on the certain carrier using a reconstruction protocol is performed with carriers of the quantity of carriers in transit from the first data storage system to the second data storage system.

9. The method of claim 1 , wherein the reconstructing data blocks stored on the certain carrier using the reconstruction protocol includes reconstructing the data blocks from remaining data blocks utilizing the RAID 6 data reconstruction protocol.

10. The method of claim 1 , wherein the reconstructing data blocks stored on the certain carrier using a reconstruction protocol is performed with carriers of the quantity of carriers in transit from the first data storage system to the second data storage system, and wherein the reconstructing data blocks stored on the certain carrier using the reconstruction protocol includes reconstructing the data blocks from remaining data blocks utilizing the RAID 6 data reconstruction protocol.

11. The method of claim 1 , wherein providing a quantity of carriers having a data storage capacity comprises providing a quantity of carriers having a data storage capacity greater than the quantity of data stored in the first data storage system, wherein receiving the erasure coded data blocks by the quantity of carriers comprises receiving the erasure coded data blocks using a data transfer protocol selected from the group consisting of: iSCSI (Internet Small Computer System Interface) over a UDP (User Datagram Protocol) network, and iFCP (Internet File Communications Protocol) over a UDP network, wherein migrating the quantity of carriers to a second data storage system includes flying a set of carriers from the first location to the second location, wherein receiving, by the quantity of carriers, a quantity of data stored in a first data storage system having a first location, wherein the quantity of data comprises erasure coded data blocks includes receiving, by the quantity of carriers, a quantity of data stored in a first data storage system having a first location, wherein the quantity of data comprises erasure coded data blocks having an IP (Internet Protocol) address assigned to each erasure coded data block, wherein the method includes reconstructing a portion of the erasure coded data blocks as the quantity of carriers are migrating from the first data storage system to the second data storage system, wherein the reconstructing data blocks stored on the certain carrier using a reconstruction protocol is performed with carriers of the quantity of carriers in transit from the first data storage system to the second data storage system, and wherein the reconstructing data blocks stored on the certain carrier using the reconstruction protocol includes reconstructing the data blocks from remaining data blocks utilizing the RAID 6 data reconstruction protocol.

12. The method of claim 1 , wherein the method includes maintaining network connectivity between carriers of the quantity of carriers during the migrating of the quantity of carriers to the second data storage system having the second location, wherein the monitoring for the loss of the carrier includes respective ones of the quantity of carriers, with carriers of the quantity of carriers in transit from the first data storage system to the second data storage system, querying network addresses of remaining carriers of the quantity of carriers, and wherein the respective carriers of the quantity of carriers ascertain that the certain carrier is missing when, as a result of the querying the network addresses of remaining carriers of the quantity of carriers, a certain network address of the certain carrier is determined to be missing.

13. The method of claim 1 , wherein providing a quantity of carriers having a data storage capacity comprises providing a quantity of carriers having a data storage capacity greater than the quantity of data stored in the first data storage system, wherein receiving the erasure coded data blocks by the quantity of carriers comprises receiving the erasure coded data blocks using a data transfer protocol selected from the group consisting of: iSCSI (Internet Small Computer System Interface) over a UDP (User Datagram Protocol) network, and iFCP (Internet File Communications Protocol) over a UDP network, wherein migrating the quantity of carriers to a second data storage system includes flying a set of carriers from the first location to the second location.

14. A computer system for migrating data, the computer system comprising: one or more computer processors; one or more computer readable storage devices; and program instructions stored on the one or more computer readable storage devices for execution by at least one of the one or more computer processors, the program instructions executable for performance of the method comprising:
providing a quantity of carriers having a data storage capacity;
recei

Assignees

• Kyndryl Inc

Inventors

• Zolotow Clea A
• O'Reilly Gavin C
• Delaney John V
• Hunt Anthony
• Northway Tedrick N

Classifications

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title

• H04L67/1097

  for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS] · CPC title

• B64U2201/104

  using satellite radio beacon positioning systems, e.g. GPS · CPC title

• G06F3/0614

  Improving the reliability of storage systems · CPC title

• H04L1/0041

  Arrangements at the transmitter end · CPC title