Pluggable storage system for distributed file systems

Patent metadata

Field	Value
Publication number	US-11288267-B2
Application number	US-201916573925-A
Country	US
Kind code	B2
Filing date	Sep 17, 2019
Priority date	Feb 25, 2013
Publication date	Mar 29, 2022
Grant date	Mar 29, 2022

Abstract

A method, article of manufacture, and apparatus for managing data. In some embodiments, this includes an initial instruction for a file stored in a first storage system, determining that the initial instruction is not supported by the first storage system, identifying a combination of instructions to the first storage system after determining that the initial instruction is not supported by the first storage system, wherein the combination of instructions is based on the initial instruction, performing the identified combination of instructions on the file stored in the first storage system, and storing results of the performed identified combination of instructions.

First claim

What is claimed is:

1. A method, comprising:
receiving, by an interfacing module that operatively connects a segment execution engine and a first storage system, an initial instruction for a file stored in the first storage system;
determining, by the interfacing module, that the initial instruction is not supported by the first storage system;
determining, by the interfacing module and based on metadata associated with the first storage system, a set of one or more instructions to perform with respect to the file, the one or more instructions performing a function corresponding to the initial instruction;
performing the set of at least one instruction with respect to the file stored in the first storage system; and
storing results of the performed set of at least one instruction.

2. The method of claim 1 , wherein the set of at least one instruction comprises a combination of instructions.

3. The method of claim 1 , wherein the set of at least one instruction to perform with respect to the file is determined based at least in part on the metadata associated with the first storage system, and the metadata associated with the first storage system is stored in a meta store that includes information respectively associated with one or more storage systems.

4. The method of claim 1 , wherein the set of at least one instruction to perform with respect to the file is determined based at least in part on the metadata associated with the first storage system, and the metadata associated with the first storage system indicates a mechanism for accessing a file system corresponding to the first storage system.

5. The method of claim 1 , wherein the set of at least one instruction to perform with respect to the file comprises one or more instructions that are determined based at least in part on the metadata associated with the first storage system.

6. The method of claim 1 , wherein the set of at least one instruction to perform with respect to the file comprises one or more instructions that are determined based at least in part on the initial instruction.

7. The method of claim 1 , further comprising:
selecting a second storage system to which the file is to be moved;
storing the file on the second storage system; and
performing a series of actions in connection with carrying out a collective result corresponding to the initial instruction.

8. The method of claim 7 , wherein the set of at least one instruction to perform with respect to the file comprises one or more instructions, the one or more instructions include one or more of the selecting of the second storage system, the storing of the file on the second storage system, and the performing of the series of actions in connection with carrying out the collective result.

9. The method of claim 7 , wherein the second storage system is selected based at least in part on the second storage system having a second file system.

10. The method of claim 7 , further comprising:
in response to performing the series of actions, moving the file to the first storage system.

11. The method of claim 1 , wherein the initial instruction includes a truncate instruction.

12. The method of claim 11 , wherein the set of at least one instruction to perform with respect to the file include copy a first portion of the file, delete the file, and rename the first portion of the file.

13. The method of claim 1 , wherein the initial instruction includes an update instruction.

14. A system, comprising a storage device and at least one processor configured to:
receive, by an interfacing module that operatively connects a segment execution engine and a first storage system, an initial instruction for a file stored in the first storage system;
determine, by the interfacing module, that the initial instruction is not supported by the first storage system;
determining, by the interfacing module and based on metadata associated with the first storage system, a set of one or more instructions to perform with respect to the file, the one or more instructions performing a function corresponding to the initial instruction;
perform the set of at least one instruction with respect to the file stored in the first storage system; and
store results of the performed set of at least one instruction.

15. The system of claim 14 , wherein the set of at least one instruction to perform with respect to the file is determined based at least in part on the metadata associated with the first storage system, and the metadata associated with the first storage system is stored in a meta store that includes information respectively associated with one or more storage systems.

16. The system of claim 14 , wherein the set of at least one instruction to perform with respect to the file is determined based at least in part on the metadata associated with the first storage system, and the metadata associated with the first storage system indicates a mechanism for accessing a file system corresponding to the first storage system.

17. The system of claim 14 , wherein the set of at least one instruction to perform with respect to the file comprises one or more instructions that are determined based at least in part on the metadata associated with the first storage system.

18. The system of claim 14 , wherein the set of at least one instruction to perform with respect to the file comprises one or more instructions that are determined based at least in part on the initial instruction.

19. The system of claim 18 , wherein the set of at least one instruction to perform with respect to the file comprises one or more instructions that cause the processor to perform one or more of the selecting of the second storage system, the storing of the file on the second storage system, and the performing of the series of actions in connection with carrying out the collective result.

20. The system of claim 14 , wherein the at least one processor is further configured to:
select a second storage system to which the file is to be moved;
store the file on the second storage system; and
perform a series of actions in connection with carrying out a collective result corresponding to the initial instruction.

21. A computer program product, comprising a non-transitory computer readable medium having program instructions embodied therein for:
receiving, by an interfacing module that operatively connects a segment execution engine and a first storage system, an initial instruction for a file stored in the first storage system;
determining, by the interfacing module, that the initial instruction is not supported by the first storage system;
determining, by the interfacing module and based on metadata associated with the first storage system, a set of one or more instructions to perform with respect to the file, the one or more instructions performing a function corresponding to the initial instruction;
performing the set of at least one instruction with respect to the file stored in the first storage system; and
storing results of the performed set of at least one instruction.

Assignees

• Emc Ip Holding Co Llc

Inventors

• Chang Lei
• Ma Tao
• Wang Zhanwei
• Jian Lirong
• Ma Lili
• Sherry Gavin

Classifications

• G06F16/245

  Query processing · CPC title

• G06F16/2455

  Query execution · CPC title

• G06F16/113

  Details of archiving (lifecycle management in storage systems G06F3/0649; point-in-time backing up or restoration of persistent data G06F11/1446) · CPC title

• G06F16/24532

  of parallel queries · CPC title

• G06F16/24524

  Access plan code generation and invalidation; Reuse of access plans · CPC title