Systems and methods for configuring, creating, and modifying parallel file systems

Patent metadata

Field	Value
Publication number	US-2021334235-A1
Application number	US-202016856809-A
Country	US
Kind code	A1
Filing date	Apr 23, 2020
Priority date	Apr 23, 2020
Publication date	Oct 28, 2021
Grant date	—

Abstract

A method, a computing device, and a non-transitory machine-readable medium for allocating configuring, creating, and modifying parallel file systems are disclosed. In one or more example embodiments, a file system object that identifies a set of parameters (e.g., name, capacity, subnetwork, subnetwork partition, etc.) for a parallel file system is received at an orchestration engine from a service. In response to detecting the presence of the file system object, a controller of the orchestration engine creates a set of orchestration objects based on the set of parameters. The orchestration engine then configures a container structure based on the set of orchestration objects. The container structure may include a container for running a file system service for the parallel file system. The orchestration engine mounts a set of volumes in a distributed storage system to the container structure for use in running the parallel file system.

First claim

What is claimed is:

1 . A method comprising:
detecting, by an orchestration engine, a presence of a file system object received by the orchestration engine, wherein the file system object includes a set of parameters for a parallel file system; creating, automatically by the orchestration engine, a set of orchestration objects based on the set of parameters; configuring, by the orchestration engine, a container structure based on the set of orchestration objects; and mounting, by the orchestration engine, a set of volumes in a distributed storage system to the container structure for use in running the parallel file system.

2 . The method of claim 1 , wherein the creating automatically further comprises:
creating, automatically by the orchestration engine, a container management object, a container storage object, and a network attachment object based on the set of parameters.

3 . The method of claim 1 , wherein the configuring further comprises:
configuring, by the orchestration engine, the container structure to run a file system service based on at least one orchestration object of the set of orchestration objects.

4 . The method of claim 1 , wherein the configuring further comprises:
assigning, by the orchestration engine, the container structure to a subnetwork based on a network attachment object of the set of orchestration objects to isolate input/output traffic for the container structure to the subnetwork.

5 . The method of claim 1 , further comprising:
receiving, by the orchestration engine, the file system object from a request service, wherein a parameter in the set of parameters identified in the file system object includes an item selected from a list consisting of a name, a capacity, and a subnetwork.

6 . The method of claim 1 , further comprising:
receiving, by the orchestration engine, the file system object at an application programming interface server in the orchestration engine from a source, wherein the source includes an item selected from a list consisting of user input, a request service, an object service, and another service.

7 . The method of claim 1 , further comprising:
establishing, by the orchestration engine, communications between a client and a file system service running within the container structure, wherein the container structure provides access to data stored in the set of volumes.

8 . The method of claim 1 , wherein the creating further comprises:
running, by the orchestration engine, at least one algorithm to fill out a set of templates based on the set of parameters, wherein each template of the set of templates forms a specification for a corresponding orchestration object of the set of orchestration objects.

9 . A non-transitory machine-readable medium having stored thereon instructions for performing a method comprising machine executable code which, when executed by at least one machine, causes the at least one machine to:
detect a presence of a file system object on an application programming interface server, wherein the file system object includes a set of parameters for a parallel file system; create a set of orchestration objects based on the set of parameters; configure a container structure based on the set of orchestration objects, wherein the container structure is assigned to a worker node associated with the orchestration engine; mount a set of volumes in a distributed storage system to the container structure for use in running the parallel file system; and establish communications between a client and a file system service running within the container structure, wherein the container structure provides access to data stored in the set of volumes.

10 . The non-transitory machine-readable medium of claim 9 , wherein the at least one machine creating the set of orchestration objects comprises:
creating automatically a container management object, a container storage object, and a network attachment object based on the set of parameters.

11 . The non-transitory machine-readable medium of claim 9 , wherein the at least one machine configuring the container structure comprises:
configuring the container structure to run a file system service for the parallel file system based on at least one orchestration object of the set of orchestration objects.

12 . The non-transitory machine-readable medium of claim 9 , wherein the at least one machine configuring the container structure comprises:
assigning the container structure to a subnetwork based on a network attachment object of the set of orchestration objects to isolate input/output traffic for the container structure to the subnetwork.

13 . The non-transitory machine-readable medium of claim 9 , wherein the machine executable code further causes the at least one machine to:
receive the file system object at the application programming interface server from a source, wherein the source includes an item selected from a list consisting of user input, a request service, an object service, and another service.

14 . The non-transitory machine-readable medium of claim 9 , wherein the machine executable code further causes the at least one machine to:
receive the file system object including the set of parameters at the application programming interface server, wherein a parameter in the set of parameters identified in the file system object includes an item selected from a list consisting of a name, a capacity, a subnetwork, and a subnetwork partition for the parallel file system.

15 . A computing device comprising:
a memory containing machine readable medium comprising machine executable code having stored thereon instructions for performing a method of managing a parallel file system during input/output (I/O) operation; and a processor coupled to the at least one memory, the at least one processor configured to execute the machine executable code to cause the processor to:
detect a presence of a file system object on an application programming interface server of an orchestration engine, wherein the file system object includes a set of parameters for a parallel file system;
create automatically a set of orchestration objects based on the set of parameters;
configure a container structure based on the set of orchestration objects; and
mount a set of volumes in a distributed storage system to the container structure for use in running the parallel file system.

16 . The computing device of claim 15 , wherein the set of orchestration objects includes a container management object, a container storage object, and a network attachment object based on the set of parameters.

17 . The computing device of claim 15 , wherein configuring the container structure comprises assigning the container structure to a subnetwork and a subnetwork partition based on at least a network attachment object of the set of orchestration objects to isolate input/output traffic for the container structure to the subnetwork partition.

18 . The computing device of claim 15 , wherein a parameter in the set of parameters identified in the file system object includes an item selected from a list consisting of a name, a capacity, a subnetwork, and a subnetwork partition for the parallel file system.

19 . The computing device of claim 15 , wherein at least one algorithm is run to fill out a set of templates based on the set of parameters in which each template of the set of templates forms a specification for a corresponding orchestration object of the set of orchestration objects.

Assignees

• Netapp Inc

Inventors

• Weber Eric
• Eastburn Jason
• Hennessy Jason

Classifications

• G06F16/1858 Primary

  Parallel file systems, i.e. file systems supporting multiple processors · CPC title

• G06F16/11 Primary

  File system administration, e.g. details of archiving or snapshots (error detection or correction of the data by redundancy in operations G06F11/14) · CPC title

• G06F16/182

  Distributed file systems · CPC title