Intelligent data routing and storage provisioning

Patent metadata

Field	Value
Publication number	US-11119986-B2
Application number	US-201916506392-A
Country	US
Kind code	B2
Filing date	Jul 9, 2019
Priority date	Apr 2, 2013
Publication date	Sep 14, 2021
Grant date	Sep 14, 2021

Abstract

Approaches for routing data to storage are provided. An approach includes determining implicit metadata from explicit metadata received with a request from a user to store a file. The approach also includes determining a storage resource based on the explicit metadata, the implicit metadata, and a registry of storage resources. The approach additionally includes routing data of the file to the determined storage resource.

First claim

What is claimed is:

1. A method for routing data to storage comprising:
parsing both a user request and a file which is to be stored into data comprising raw data and explicit metadata describing both the user request and the file to be stored;
validating the explicit metadata and implicit metadata determined from the explicit metadata by comparing to schema stored in at least one storage resource, wherein the at least one storage resource comprises at least one of: predefined configurations of processors, memories, storage devices and data structures;
monitoring status information in a registry of each of the at least one storage resource, wherein the registry is in a storage engine and comprises storage resource information including a provider identifier, a storage type, a storage cost, a storage availability, a confidentiality type, a legal type, a location type, a quality type, and a durability type;
determining a predetermined storage resource, based on the status information in the registry, comprising a percentage of space below a predetermined threshold;
storing identifiers of elements of the predetermined storage resource in a resource pool;
marking the identifiers of the elements of the predetermined storage resource available for provisioning;
determining whether at least one suitable storage resource of the at least one storage resource is available and satisfies requirements for the file based on the explicit metadata, the implicit metadata, and the registry of the at least one storage resource;
when the at least one suitable storage resource of the at least one storage resource is available and satisfies the requirements for the file, determining a storage resource of the at least one storage resource based on the explicit metadata, the implicit metadata, and the registry of the at least one storage resource, wherein the determined implicit metadata and the determining the storage resource are performed by a computing device comprising at least one processor; and
when no suitable storage resource satisfies the requirements for the file, re-configuring the predetermined storage resource of the at least one storage resource based on a storage platform template which does satisfy the requirements for the file based on the explicit metadata, the implicit metadata, and the registry of the at least one storage resource.

2. The method of claim 1 , wherein the registry of the at least one storage resource includes information describing characteristics of available storage resources.

3. The method of claim 1 , wherein the explicit metadata comprises information provided by the file to be stored and information provided by the user in the user request.

4. The method of claim 1 , further comprising routing the file to be stored to the determined storage resource.

5. The method of claim 1 , further comprising tracking access history and patterns to re-determine a storage location based on the access history and patterns.

6. The method of claim 1 , wherein the determined implicit metadata comprises determining information about the user, the user request, and the file.

7. The method of claim 1 , wherein the determined implicit metadata uses one or more predefined policies corresponding to the explicit metadata.

8. The method of claim 1 , wherein the determining the storage resource comprises selecting one of a plurality of storage resources from the registry of the at least one storage resource.

9. The method of claim 8 , wherein the selecting the storage resource comprises comparing the implicit metadata and the explicit metadata to characteristics of the plurality of storage resources in the registry of the at least one storage resource.

10. The method of claim 9 , wherein at least two storage resources of the plurality of storage resources are provided by remote storage services operated by different entities.

11. The method of claim 1 , wherein the determining the storage resource comprises dynamically provisioning a new storage resource based on the implicit metadata and the explicit metadata.

12. The method of claim 11 , wherein the provisioning the new storage resource comprises configuring the new storage resource from a pool of available storage resource elements.

13. The method of claim 11 , wherein the provisioning the new storage resource comprises converting one of the plurality of storage resources.

14. The method of claim 1 , wherein:
the explicit metadata comprises a plurality of explicit metadata and the implicit metadata comprises a plurality of implicit metadata;
the registry of the at least one storage resource comprises predefined information describing characteristics of available storage resources; and
the determining the storage resource comprises comparing the plurality of explicit metadata and the plurality of implicit metadata to the predefined information describing characteristics of available storage resources.

15. The method of claim 1 , wherein:
the explicit metadata is selected from at least one of: file name, file type, file size, file creation date, file modification data, file owner, file author, storage costs, redundancy type, quality type, durability type, confidentiality type, legal type, user-defined exceptions and combinations thereof; and
the implicit metadata determined from the explicit metadata is selected from the group consisting of: data type, data size, confidentiality type, legal type, location type, access type, user type, device type and combinations thereof.

16. The method of claim 1 , wherein the implicit metadata comprises a data center meeting location of the predetermined storage resource.

17. The method of claim 16 , further comprising reserving a plurality of storage elements corresponding to a type of storage device that satisfies a storage type in the implicit metadata.

18. The method of claim 17 , wherein the plurality of storage elements comprises at least one processor and at least one memory device.

Assignees

• IBM

Inventors

• Dejana Ryan G
• Deluca Lisa Seacat
• Goodman Brian D
• Krook Daniel C

Classifications

• G06F3/0635

  by changing the path, e.g. traffic rerouting, path reconfiguration · CPC title

• G06F3/0643

  Management of files · CPC title

• G06F3/0631

  by allocating resources to storage systems · CPC title

• G06F16/1827 Primary

  Management specifically adapted to NAS (management of storage area networks [SAN] G06F3/067) · CPC title

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title