Using a data mover and a clone blocklist primitive to clone files on a virtual file system

Patent metadata

Field	Value
Publication number	US-11188254-B2
Application number	US-201715409294-A
Country	US
Kind code	B2
Filing date	Jan 18, 2017
Priority date	Jan 21, 2009
Publication date	Nov 30, 2021
Grant date	Nov 30, 2021

Abstract

In a computer system with a disk array that has physical storage devices arranged as logical storage units and is capable of carrying out hardware storage operations on a per logical storage unit basis, data movement operations can be carried out on a per-file basis. A data mover software component for use in a computer or storage system enables cloning and initialization of data to provide high data throughput without moving the data between the kernel and application levels.

First claim

What is claimed is:

1. A method comprising:
receiving a clone request to clone a first file to a second file, wherein the first file is on a virtual file system corresponding to a virtual disk associated with a virtual machine;
resolving the first file into first file segments and the second file into second file segments, each file segment represented by an identifier, an offset, and a length, and wherein each file segment represents a contiguous region on the virtual disk;
resolving each of the first file segments to a corresponding first list of blocks and resolving each of the second file segments to a corresponding second list of blocks in the virtual file system, wherein each file segment of the first and second file segments comprises one or more blocks;
consolidating the first lists of blocks into a source blocklist and consolidating the second lists of blocks into a destination blocklist, wherein each blocklist is an ordered list of logical unit number (LUN) blocks of a storage system, and each blocklist representing the first file and the second file, respectively, wherein the storage system is represented as a contiguous logical storage space of LUN blocks, and wherein each LUN block is associated with an extent map that associates the LUN block with one or more spindle-extent pairs of a disk array of the storage system;
generating, by a hypervisor, a clone blocklist primitive; and
after the generating of the clone blocklist primitive by the hypervisor, determining whether the clone blocklist primitive is supported by the disk array, and in response to a determination that the clone blocklist primitive is supported by the disk array:
using the generated clone blocklist primitive to implement a move command for the entire first file, wherein the move command includes the source blocklist as a source and the destination blocklist as a destination for the clone of the first file to the second file; and
providing the move command to the disk array, wherein the disk array uses the source blocklist and the destination blocklist to identify the corresponding spindle-extent pairs to carry out the clone request.

2. The method of claim 1 , wherein the clone blocklist primitive embeds the source blocklist and the destination blocklist in a write command issued to the storage system.

3. The method of claim 1 , further comprising, in response to a determination that the clone blocklist primitive is not supported:
generating a move data command for each LUN block in the source blocklist that moves the LUN block in the source blocklist to a corresponding LUN block in the destination blocklist, wherein in response to receiving each move data command the storage system translates the corresponding LUN block in the destination blocklist into appropriate spindle-extents and writes a corresponding destination extent representing that block.

4. A computing system comprising:
one or more computers including one or more processors and one or more computer-readable storage devices, the one or more computers configured to perform operations comprising:
receiving a clone request to clone a first file to a second file, wherein the first file is on a virtual file system corresponding to a virtual disk associated with a virtual machine;
resolving the first file into first file segments and the second file into second file segments, each file segment represented by an identifier, an offset, and a length, and wherein each file segment represents a contiguous region on the virtual disk;
resolving each of the first file segments to a corresponding first list of blocks and resolving each of the second file segments to a corresponding second list of blocks in the virtual file system, wherein each file segment of the first and second file segments comprises one or more blocks;
consolidating the first lists of blocks into a source blocklist and consolidating the second lists of blocks into a destination blocklist, wherein each blocklist is an ordered list of logical unit number (LUN) blocks of a storage system, and each blocklist representing the first file and the second file, respectively, wherein the storage system is represented as a contiguous logical storage space of LUN blocks, and wherein each LUN block is associated with an extent map that associates the LUN block with one or more spindle-extent pairs of a disk array of the storage system;
generating, by a hypervisor, a clone blocklist primitive; and
after the generating of the clone blocklist primitive by the hypervisor, determining whether the clone blocklist primitive is supported by the disk array, and in response to a determination that the clone blocklist primitive is supported by the disk array:
using the generated a clone blocklist primitive to implement a move command for the entire first file, wherein the move command includes the source blocklist as a source and the destination blocklist as a destination for the clone of the first file to the second file; and
providing the move command to the disk array, wherein the disk array uses the source blocklist and the destination blocklist to identify the corresponding spindle-extent pairs to carry out the clone request.

5. The computing system of claim 4 , wherein the clone blocklist primitive embeds the source blocklist and the destination blocklist in a write command issued to the storage system.

6. The computing system of claim 4 , wherein in response to a determination that the clone blocklist primitive is not supported, the one or more computers further perform operations comprising:
generating a move data command for each LUN block in the source blocklist that moves the LUN block in the source blocklist to a corresponding LUN block in the destination blocklist, wherein in response to receiving each move data command the storage system translates the corresponding LUN block in the destination blocklist into appropriate spindle-extents and writes a corresponding destination extent representing that block.

7. A non-transitory computer readable medium having computer readable program code that when executed performs operations comprising:
receiving a clone request to clone a first file to a second file, wherein the first file is on a virtual file system corresponding to a virtual disk associated with a virtual machine;
resolving the first file into first file segments and the second file into second file segments, each file segment represented by an identifier, an offset, and a length, and wherein each file segment represents a contiguous region on the virtual disk;
resolving each of the first file segments to a corresponding first list of blocks and resolving each of the second file segments to a corresponding second list of blocks in the virtual file system, wherein each file segment of the first and second file segments comprises one or more blocks;
consolidating the first lists of blocks into a source blocklist and consolidating the second lists of blocks into a destination blocklist, wherein each blocklist is an ordered list of logical unit number (LUN) blocks of a storage system representing the first file and the second file, respectively, wherein the storage system is represented as a contiguous logical storage space of LUN blocks, and wherein each LUN block is associated with an extent map that associates the LUN block with one or more spindle-extent pairs of a disk array of the storage system;
generating, by a hypervisor, a clone blocklist primitive; and
after the generating of the clone blocklist primitive by the hypervisor, determining whether the clone blocklist primitive is supported by the disk array, and in response to a determination that the clone blocklist primitive is supported by the disk array:
using the generated clone blocklist primitive to imp

Assignees

• Vmware Inc

Inventors

• Vaghani Satyam B
• Rawat Mayank
• Rai Abhishek

Classifications

• G06F12/0866 Primary

  for peripheral storage systems, e.g. disk cache · CPC title

• G06F3/0643

  Management of files · CPC title

• G06F16/119

  Details of migration of file systems (migration mechanisms in storage systems G06F3/0647) · CPC title

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title

• G06F3/0665

  at area level, e.g. provisioning of virtual or logical volumes · CPC title