Multi-format migration for network attached storage devices and virtual machines

Patent metadata

Field	Value
Publication number	US-10620883-B1
Application number	US-201916257689-A
Country	US
Kind code	B1
Filing date	Jan 25, 2019
Priority date	Jan 4, 2019
Publication date	Apr 14, 2020
Grant date	Apr 14, 2020

Abstract

A method and system for migrating data are described. A storage capture instance in a first format from a first type of device is received. Processing utilized to back up the storage capture instance to a second format of a snapshot tree is distributed to multiple storage nodes. A request to migrate at least part of the storage capture instance to a second type of device in a third format is received. In response to the request, processing utilized to migrate the at least part of the storage capture instance from the second format to the second type of device in the third format is distributed to the storage nodes. In one aspect, file(s) in a first network attached storage (NAS) device format are migrated to a second NAS device format. In another aspect, a virtual machine (VM) and/or file(s) therein having a first VM format are migrated to a second VM format.

First claim

What is claimed is:

1. A method, comprising:
receiving a storage capture instance in a first format from a first type of device, wherein the storage capture instance includes a plurality of items for the first type of device and a first metadata item;
distributing to a plurality of storage nodes, backup processing utilized to back up the storage capture instance to a second format of a snapshot tree, the backup processing including converting from the first format to the second format, the plurality of storage nodes storing the snapshot tree, wherein distributing the backup processing to the plurality of storage nodes comprises:
ingesting the first metadata item to provide a second metadata item in the second format,
selecting one of the plurality of storage nodes as a master node,
discovering the plurality of items in a snapshot of a file system,
dividing the plurality of items into a plurality of batches of items, and
distributing the plurality of batches to a portion of the plurality of storage nodes using the master node;

receiving a request to migrate at least a portion of the storage capture instance to a second type of device in a third format; and
in response to the request, distributing to the plurality of storage nodes, migrate processing utilized to migrate the at least the portion of the storage capture instance from the second format to the second type of device in the third format.

2. The method of claim 1 , wherein the first type of device is a first network attached storage device and the second type of device is a second network attached storage device.

3. The method of claim 2 , wherein the storage capture instance is the snapshot of a file system in the first format, the file system including a plurality of files for the first network attached storage device and a first metadata file, and wherein the distributing to the plurality of storage nodes, the backup processing further includes:
dynamically distributing processing to the plurality of storage nodes.

4. The method of claim 1 , wherein the first type of device is a first device utilizing a first virtual machine format, wherein the second type of device is a second device utilizing a second virtual machine format, and wherein the storage capture instance includes at least one virtual machine in the first virtual machine format.

5. The method of claim 4 , wherein the at least the portion of the storage capture instance requested to be migrated to the third format consists of a virtual machine of the at least one virtual machine.

6. The method of claim 4 , wherein the distributing to the plurality of storage nodes, the backup processing further includes:
indexing at least one file in the at least one virtual machine.

7. The method of claim 6 , wherein the at least the portion of the storage capture instance includes a selected file in a virtual machine of the at least one virtual machine and wherein the migrate processing utilized to migrate the at least the portion of the storage capture instance to the second type of device in the third format further includes:
mounting the selected file in the second virtual machine format; and
pushing the selected file to the second device having the second virtual machine format.

8. The method of claim 1 wherein the snapshot tree includes a plurality of nodes and at least one pointer from a root node of the snapshot tree to at least one intermediate node of a previous snapshot tree.

9. A method, comprising:
receiving a storage capture instance in a first format from a first network attached storage device, the storage capture instance being a snapshot of a file system in the first format, the file system including a plurality of files for the first network attached storage device and a first metadata file;
dynamically distributing to a plurality of storage nodes, backup processing utilized to back up the storage capture instance to a second format of a snapshot tree, wherein the dynamically distributing further includes:
ingesting the first metadata file to provide a second metadata file in the second format;
selecting one of the plurality of storage nodes as a master node;
discovering the plurality of files in the snapshot of the file system;
dividing the plurality of files into a plurality of batches of files; and
distributing the plurality of batches to a portion of the plurality of storage nodes using the master node;

receiving a request to migrate at least a portion of the storage capture instance to a second network attached storage device in a third format; and
in response to the request, distributing to the plurality of storage nodes, migrate processing utilized to migrate at least the portion of the storage capture instance from the second format to the second network attached storage device in the third format.

10. The method of claim 9 , wherein the at least the portion of the storage capture instance to be migrated includes at least one of the plurality of files and fewer than the plurality of files.

11. A system for migrating data, comprising:
a processor configured to:
receive a storage capture instance in a first format from a first type of device, wherein the storage capture instance includes a plurality of items for the first type of device and a first metadata item;
distribute to a plurality of storage nodes, backup processing utilized to back up the storage capture instance to a second format of a snapshot tree, the backup processing including converting from the first format to the second format, the plurality of storage nodes storing the snapshot tree, wherein to distribute the backup processing to the plurality of storage nodes, the processor is configured to:
ingest the first metadata item to provide a second metadata item in the second format,
select one of the plurality of storage nodes as a master node,
discover the plurality of items in a snapshot of a file system,
divide the plurality of items into a plurality of batches of items, and
distribute the plurality of batches to a portion of the plurality of storage nodes using the master node;

receive a request to migrate at least a portion of the storage capture instance to a second type of device in a third format; and
in response to the request, distributing to the plurality of storage nodes, migration processing utilized to migrate the at least the portion of the storage capture instance from the second format to the second type of device in the third format; and

a memory coupled to the processor and configured to provide the processor with instructions.

12. The system of claim 11 , wherein the first type of device is a first network attached storage device and wherein the second type of device is a second network attached storage device.

13. The system of claim 12 , wherein the first type of device is a first network attached storage device, the second type of device is a second network attached storage device, and the storage capture instance is the snapshot of a file system in the first format, the file system including a plurality of files for the first network attached storage device and a first metadata file, and wherein to distribute to the plurality of storage nodes the backup processing the processor is further configured to:
dynamically distribute processing to the plurality of storage nodes.

14. The system of claim 11 , wherein the first type of device is a first device utilizing a first virtual machine format, wherein the second type of device is a second device utilizing a second virtual machine format and wherein the storage capture instance includes at least one virtual machine in the first

Assignees

• Cohesity Inc

Inventors

• Cai Zheng
• Bajaj Rupesh
• Manjunath Chinmaya
• Arun Anand
• Thomas Markose

Classifications

• G06F3/067 Primary

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title

• G06F3/0617

  in relation to availability · CPC title

• G06F3/0685

  Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays · CPC title

• G06F3/0647

  Migration mechanisms · CPC title

• G06F9/45558 Primary

  Hypervisor-specific management and integration aspects · CPC title