Data migration with placement based on access patterns

Patent metadata

Field	Value
Publication number	US-10552059-B2
Application number	US-201715417687-A
Country	US
Kind code	B2
Filing date	Jan 27, 2017
Priority date	Jan 27, 2017
Publication date	Feb 4, 2020
Grant date	Feb 4, 2020

Abstract

A method, executed by a computer, includes determining an access metric, an input/output operations per second (IOPs) metric, and a size metric for each data target of a plurality of data targets, ranking the plurality of data targets according to the access metric of each data target, assigning each data target to a storage pool of a plurality of storage pools according to the IOPs metric and the size metric of the data target. A computer system and computer program product corresponding to the above method are also disclosed herein.

First claim

What is claimed is:

1. A method for data migration, the method comprising:
scanning an audit log corresponding to a data target of a plurality of data targets, wherein the scanning includes analyzing entries of the audit log one entry at a time, wherein the scanning further includes analyzing, in the entries, timestamps of when the data target is accessed, wherein the scanning further includes incrementing a count associated with the data target every time the data target is accessed, and wherein results of the scanning are output into a target record which identifies the data target and includes the count associated with the data target;
determining an access metric, an input/output operations per second (IOPs) metric, and a size metric for each data target of the plurality of data targets, based on target records which identify each data target of the plurality of data targets and respective counts associated with each data target, wherein each data target of the plurality of data targets is tracked based on a number of access metric events and a data size of the respective data target;
ranking the plurality of data targets according to the access metric of each data target; and
assigning each data target to a storage pool of a plurality of storage pools according to the IOPs metric and the size metric of the respective data target, wherein each respective storage pool of the plurality of storage pools includes a performance specification of physical storage media of the respective storage pool, wherein each respective storage pool of the plurality of storage pools correlates to a particular tier of a tiered storage destination for storing the data targets based the size metrics and the IOPs metrics of the data targets, and wherein assigning each data target to the storage pool of a plurality of storage pools according to the IOPs metric and the size metric of the respective data target includes, for each respective data target:
determining whether the IOPs metric of the respective data target meets an IOPs threshold of a respective storage pool of the plurality of storage pools;
determining whether the size metric of the respective data target meets a storage capacity threshold of the respective storage pool;
in response to determining that the IOPs metric and the size metric of the respective data target respectively meet the IOPs threshold and the storage capacity threshold for the respective storage pool, updating a stored list of the assigned data targets to identify the respective data target as being assigned to the respective storage pool; and
determining whether there are additional data targets for assigning to storage pools of the plurality of storage pools.

2. The method of claim 1 , further comprising copying each data target to its assigned storage pool.

3. The method of claim 1 , wherein the plurality of data targets are assigned to the plurality of storage pools in an order corresponding to the ranking of the plurality of data targets.

4. The method of claim 1 , further comprising ranking the plurality of data targets according to the size metric of each data target.

5. The method of claim 1 , wherein each data target of the plurality of targets is selected from the list consisting of a file, a directory, an object and a container.

6. A computer system comprising:
one or more computer processors;
one or more computer readable storage media;

program instructions stored therein for execution by at least one of the one or more computer processors, the program instructions comprising instructions for:
scanning an audit log corresponding to a data target of a plurality of data targets, wherein the scanning includes analyzing entries of the audit log one entry at a time, wherein the scanning further includes analyzing, in the entries, timestamps of when the data target is accessed, wherein the scanning further includes incrementing a count associated with the data target every time the data target is accessed, and wherein results of the scanning are output into a target record which identifies the data target and includes the count associated with the data target;
determining an access metric, an input/output operations per second (IOPs) metric, and a size metric for each data target of the plurality of data targets, based on target records which identify each data target of the plurality of data targets and respective counts associated with each data target, wherein each data target of the plurality of data targets is tracked based on a number of access metric events and a data size of the respective data target;
ranking the plurality of data targets according to the access metric of each data target; and
assigning each data target to a storage pool of a plurality of storage pools according to the IOPs metric and the size metric of the respective data target, wherein each respective storage pool of the plurality of storage pools includes a performance specification of physical storage media of the respective storage pool, wherein each respective storage pool of the plurality of storage pools correlates to a particular tier of a tiered storage destination for storing the data targets based the size metrics and the IOPs metrics of the data targets, and wherein assigning each data target to the storage pool of a plurality of storage pools according to the IOPs metric and the size metric of the respective data target includes, for each respective data target:
determining whether the IOPs metric of the respective data target meets an IOPs threshold of a respective storage pool of the plurality of storage pools;
determining whether the size metric of the respective data target meets a storage capacity threshold of the respective storage pool;
in response to determining that the IOPs metric and the size metric of the respective data target respectively meet the IOPs threshold and the storage capacity threshold for the respective storage pool, updating a stored list of the assigned data targets to identify the respective data target as being assigned to the respective storage pool; and
determining whether there are additional data targets for assigning to storage pools of the plurality of storage pools.

7. The computer system of claim 6 , further comprising instructions for copying each data target to its assigned storage pool.

8. The computer system of claim 6 , wherein the plurality of data targets are assigned to the plurality of storage pools in an order corresponding to the ranking of the plurality of data targets.

9. The computer system of claim 6 , further comprising instructions for ranking the plurality of data targets according to the size metric of each data target.

10. The computer system of claim 6 , wherein each data target of the plurality of targets is selected from the list consisting of a file, a directory, an object and a container.

11. A computer program product comprising:
a computer readable storage medium and program instructions stored on the computer readable storage medium, the program instructions comprising instructions for:
scanning an audit log corresponding to a data target of a plurality of data targets, wherein the scanning includes analyzing entries of the audit log one entry at a time, wherein the scanning further includes analyzing, in the entries, timestamps of when the data target is accessed, wherein the scanning further includes incrementing a count associated with the data target every time the data target is accessed, and wherein results of the scanning are output into a target record which identifies the data target and includes the count associated with the data target;
determining an access metric, an input/output operations per

Assignees

• IBM

Inventors

• Dain Joseph W

Classifications

• G06F3/0605

  by facilitating the interaction with a user or administrator · CPC title

• G06F3/0619 Primary

  in relation to data integrity, e.g. data losses, bit errors · CPC title

• G06F3/065

  Replication mechanisms · CPC title

• G06F3/0649

  Lifecycle management · CPC title

• G06F3/0685

  Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays · CPC title