Unified datapath processing with virtualized storage processors

Patent metadata

Field	Value
Publication number	US-10447524-B1
Application number	US-201313828294-A
Country	US
Kind code	B1
Filing date	Mar 14, 2013
Priority date	Mar 14, 2013
Publication date	Oct 15, 2019
Grant date	Oct 15, 2019

Abstract

A technique for managing host data in a data storage apparatus having a storage processor (SP) provides virtualized storage processors (VSPs) as substantially self-describing and independent entities. Each VSP has its own namespace, independent of the namespace of any other VSP. Each VSP also has its own network address. Hosts may thus access VSPs directly, without having to include path information relative to the SP on which the VSP is operated. VSPs can thus be moved from one physical SP to another with little or no disruption to hosts, which may continue to access the VSPs on the new SPs using the same paths as were used when the VSPs were running on the original SPs.

First claim

What is claimed is:

1. A method of managing host data on a data storage apparatus connected to a network, comprising:
storing a network address and a set of host data objects that are accessible within a namespace of a virtualized storage processor (VSP) operated by a physical storage processor of the data storage apparatus, the namespace including only names of objects that are specific to the VSP;
receiving, by the physical storage processor, a transmission over the network from a host computing device, the transmission directed to a network address and including an IO request designating a pathname to a host data object to be written or read;
identifying the host data object designated by the IO request by (i) matching the network address to which the transmission is directed with the network address stored for the VSP, to identify the VSP as the recipient of the IO request, and (ii) locating the host data object within the namespace of the VSP using the pathname; and
processing the IO request to complete the requested read or write operation on the identified host data object,
wherein the method further comprises:
running a container within an operating system of the physical storage processor, the container executing over a kernel of the operating system and providing an isolated userspace instance;
operating the VSP within the container; and
storing a set of configuration files accessible within the namespace of the VSP, the configuration files defining VSP-specific configuration settings, the configuration settings including a set of domain name system (DNS) definitions providing a host name of the VSP, a domain name of the VSP, and the identity of a DNS server to be used by the VSP to resolve host names,
wherein the configuration settings further include settings for configuring a set of network protocol servers running on the physical storage processor to perform network protocol operations on behalf of the VSP,
wherein the VSP includes a root file system, the root file system including a set of directories having:
a first mount point on which a first host-accessible file system is mounted within the namespace of the VSP;
a second mount point on which a second host-accessible file system is mounted within the namespace of the VSP; and
a third mount point on which a configuration file system is mounted within the namespace of the VSP, the configuration file system storing the set of configuration files, and

wherein the method further comprises exporting on the network the first host-accessible file system and the second host-accessible file system as respective folders.

2. The method of claim 1 , wherein the set of network protocol servers include at least one Common Internet File System (CIFS) server.

3. The method of claim 1 , wherein the set of network protocol servers include at least one Network File System (NFS) server.

4. The method of claim 1 , wherein the configuration settings further include settings for specifying Network Information Service (NIS) and Lightweight Directory Access Protocol (LDAP) settings of the VSP.

5. The method of claim 1 , further comprising storing each of the set of host file systems in the form of a lower-deck file of a set of lower-deck file systems, each lower-deck file providing a file representation of the respective host file system.

6. The method of claim 5 , wherein storing each of the set of host file systems in the form of a lower-deck file includes storing lower-deck files for different host file systems in different lower-deck file systems.

7. The method of claim 5 , further comprising storing the root file system and the configuration file system in the form of respective lower-deck files of a second set of lower-deck file systems, the lower-deck file for the root file system providing a file representation of the root file system and the lower-deck file for the configuration file system providing a file representation of the configuration file system.

8. A data storage apparatus for managing host data, comprising:
a physical storage processor including control circuitry, memory accessible by the control circuitry, and a set of network interfaces arranged to connect to a set of host computing devices over a network to enable the set of host computing devices to access host data stored on the data storage apparatus;
wherein the memory stores instructions which, when carried out by the control circuitry, cause the control circuitry to:
store, for each of multiple virtualized storage processors (VSPs) on the physical storage processor, a network address and a set of host data objects accessible within a namespace of the VSP, the namespace including only names of objects that are specific to the VSP;
receive, by the set of network interfaces of the physical storage processor, a transmission over the network from a host computing device, the transmission directed to a network address and including an IO request designating a pathname to a host data object to be written to or read;
identify the host data object designated by the IO request by (i) matching the network address to which the transmission is directed with the network address stored for one of the VSPs, to identify that VSP as the recipient of the IO request, and (ii) to locate the host data object within the namespace of the identified VSP using the pathname; and
process the IO request to complete the requested read or write operation on the identified host data object,
wherein the instructions further cause the control circuitry to store a set of configuration files accessible within the namespace of each VSP, the configuration files defining VSP-specific configuration settings, the configuration settings including a set of domain name system (DNS) definitions providing a host name of the respective VSP, a domain name of the respective VSP, and the identity of a DNS server to be used by the respective VSP to resolve host names,
wherein each of the VSP includes a respective root file system, each root file system including a set of directories including:
a first mount point on which a first host-accessible file system is mounted within the namespace of the respective VSP;
a second mount point on which a second host-accessible file system is mounted within the namespace of the respective VSP; and
a third mount point on which a configuration file system is mounted within the namespace of the respective VSP, the configuration file system storing the respective set of configuration files, and

wherein the instructions further cause the control circuitry to export on the network each of the first and second host-accessible file systems of each VSP as a respective folder.

9. The data storage apparatus of claim 8 , wherein the instructions, when carried out by the control circuitry, further cause the control circuitry to:
run a container within an operating system of the physical storage processor, the container executing over a kernel of the operating system to provide an isolated userspace instance; and
operate the VSPs within the container.

10. The data storage apparatus of claim 8 , wherein, for each VSP, the data storage apparatus stores the set of host data objects in a set of host file systems, and wherein each of the set of host file systems is stored in the form of a lower-deck file of a set of lower-deck file systems, each lower-deck file providing a file representation of the respective host file system.

11. The data storage apparatus of claim 10 , wherein, for each VSP, the data storage apparatus stores a root file system, the root file system including a set of directories having mount points on which each of the set of host file systems for the respect

Assignees

• Emc Corp
• Emc Ip Holding Co Llc

Inventors

• Bono Jean-Pierre
• Corniquet Frederic
• De Forest Miles A
• Tummala Himabindu
• Forrester Walter C

Classifications

• G06F3/0647

  Migration mechanisms · CPC title

• G06F3/0635

  by changing the path, e.g. traffic rerouting, path reconfiguration · CPC title

• G06F3/0607

  by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device · CPC title

• G06F9/5077

  Logical partitioning of resources; Management or configuration of virtualized resources (specific details on emulation or internal functioning of virtual machines G06F9/455) · CPC title

• G06F16/11

  File system administration, e.g. details of archiving or snapshots (error detection or correction of the data by redundancy in operations G06F11/14) · CPC title