Systems and methods for enabling access to extensible remote storage over a network as local storage via a logical storage controller

Patent metadata

Field	Value
Publication number	US-9529773-B2
Application number	US-201615041892-A
Country	US
Kind code	B2
Filing date	Feb 11, 2016
Priority date	May 2, 2014
Publication date	Dec 27, 2016
Grant date	Dec 27, 2016

Abstract

A new approach is proposed that contemplates systems and methods to support elastic (extensible/flexible) storage access in real time by mapping a plurality of remote storage devices that are accessible over a network fabric as logical namespace(s) via a logical storage controller using a multitude of access mechanisms and storage network protocols. The logical storage controller exports and presents the remote storage devices to one or more VMs running on a host of the logical storage controller as the logical namespace(s), wherein these remote storage devices appear virtually as one or more logical volumes of a collection of logical blocks in the logical namespace(s) to the VMs. As a result, each of the VMs running on the host can access these remote storage devices to perform read/write operations as if they were local storage devices via the logical namespace(s).

First claim

What is claimed is:

1. A system to support elastic network storage, comprising:
a logical storage controller of a local network interface card/controller (NIC), configured to:
accept a request for storage space from one of a plurality of virtual machines (VMs) running on a host;
allocate storage volumes on one or more remote storage devices accessible over a network fabric in accordance with the request for the storage space;
create and map one or more logical volumes in one or more logical namespaces to the storage volumes on the remote storage devices;
present the logical volumes mapped to the storage volumes on the remote storage devices as local storage volumes to the VM requesting the storage space;
enable the VM to perform a read/write operation on the logical volumes via a first instruction.

2. The system of claim 1 , wherein:
the host of the VM is an x86 or ARM server.

3. The system of claim 1 , wherein:
the NIC includes or implements one or more of an NVMe controller, a remote direct memory access (RDMA)/RDMA over Converged Ethernet (RoCE) controller, a Simplified Transport over Ethernet, an internet Wide Area RDMA Protocol (iWARP) controller, and a local SCSI or SATA controller.

4. The system of claim 1 , wherein:
the remote storage devices are part of one or more backend storage servers accessible by the NIC over the network fabric.

5. The system of claim 1 , wherein:
the network fabric is a network topology in which nodes in a network interconnect via one or more network switches.

6. The system of claim 1 , wherein:
the logical volumes are further mapped to a storage device attached to the NIC locally.

7. The system of claim 1 , wherein:
the VMs run independently on the host and are isolated from each other so that one VM cannot access the data and/or communication of any other VMs running on the same host.

8. The system of claim 1 , wherein:
the logical storage controller is configured to
convert the logical volumes in the first instruction from the VM to the storage volumes of the remote storage devices in a second instruction according to a storage network protocol;
present result and/or data of the read/write operation to the VM after the read/write operation has been performed on the storage volumes of the remote storage devices over the network fabric using the second instruction.

9. The system of claim 8 , wherein:
the storage network protocol is Internet Small Computer System Interface (iSCSI).

10. The system of claim 1 , wherein:
the logical storage controller is configured to enable multiple of the plurality of VMs to access the same logical volume and each logical volume is enabled to be shared among the multiple VMs.

11. The system of claim 1 , wherein:
the logical storage controller is configured to map a single logical volume to a single remote storage device via a controller of the NIC.

12. The system of claim 1 , wherein:
the logical storage controller is configured to map a single logical volume to a plurality of remote storage devices via different controllers of the NIC.

13. The system of claim 1 , wherein:
the logical storage controller is configured to perform the mapping and the operations on the remote storage devices over the network transparent to the VM.

14. The system of claim 1 , wherein:
the logical storage controller is configured to
dynamically allocate additional storage space on the remote physical storage devices to the VM per additional storage request by the VM in real time;
expand mappings between the logical volumes and the remote physical storage devices to include the additional storage space allocated on the remote physical storage devices.

15. A method to support elastic network storage via a local network interface card/controller (NIC), comprising:
accepting a request for storage space from one of a plurality of virtual machines (VMs) running on a host;
allocating storage volumes on one or more remote storage devices accessible over a network fabric in accordance with the request for the storage space;
creating and mapping one or more logical volumes in one or more logical namespaces to the storage volumes on the remote storage devices;
presenting the logical volumes mapped to the storage volumes on the remote storage devices as local storage volumes to the VM requesting the storage space;
enabling the VM to perform a read/write operation on the logical volumes via a first instruction.

16. The method of claim 15 , further comprising:
including or implementing one or more of an NVMe controller, a remote direct memory access (RDMA)/RDMA over Converged Ethernet (RoCE) controller, a Simplified Transport over Ethernet, an internet Wide Area RDMA Protocol (iWARP) controller, and a local SCSI or SATA controller via the NIC.

17. The method of claim 15 , further comprising:
mapping the logical volumes to a storage device attached to the NIC locally.

18. The method of claim 15 , further comprising:
enabling the VMs to run independently on the host and isolating the VMs from each other so that one VM cannot access the data and/or communication of any other VMs running on the same host.

19. The method of claim 15 , further comprising:
converting the logical volumes in the first instruction from the VM to the storage volumes of the remote storage devices in a second instruction according to a storage network protocol;
presenting result and/or data of the read/write operation to the VM after the read/write operation has been performed on the storage volumes of the remote storage devices over the network fabric using the second instruction.

20. The method of claim 15 , further comprising:
enabling multiple of the plurality of VMs to access the same logical volume and each logical volume to be shared among the multiple VMs.

21. The method of claim 15 , further comprising:
mapping a single logical volume to a single remote storage device via a controller of the NIC.

22. The method of claim 15 , further comprising:
mapping a single logical volume to a plurality of remote storage devices via different controllers of the NIC.

23. The method of claim 15 , further comprising:
performing the mapping and the operations on the remote storage devices over the network transparent to the VM.

24. The method of claim 15 , further comprising:
dynamically allocating additional storage space on the remote physical storage devices to the VM per additional storage request by the VM in real time;
expanding mappings between the logical volumes and the remote physical storage devices to include the additional storage space allocated on the remote physical storage devices.

Assignees

• Cavium Inc

Inventors

• Hussain Muhammad Raghib
• Murgai Vishal
• Panicker Manojkumar
• Masood Faisal
• Folsom Brian
• Kessler Richard Eugene

Classifications

• G06F3/0604 Primary

  Improving or facilitating administration, e.g. storage management · CPC title

• G06F3/0665

  at area level, e.g. provisioning of virtual or logical volumes · CPC title

• G06F9/45533

  Hypervisors; Virtual machine monitors · CPC title

• H04L67/1097

  for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS] · CPC title

• G06F2009/45583

  Memory management, e.g. access or allocation · CPC title