Event based reconcile operation for hierarchical storage management

Patent metadata

Field	Value
Publication number	US-11308986-B2
Application number	US-202016990190-A
Country	US
Kind code	B2
Filing date	Aug 11, 2020
Priority date	Aug 11, 2020
Publication date	Apr 19, 2022
Grant date	Apr 19, 2022

Abstract

In an approach to automatically reconciling data in HSM without affecting system performance, responsive to migrating a file on a hierarchical storage system from a primary storage to one or more tape drives, one or more file migration records are recorded in a reconcile database. Responsive to the occurrence of a file event on the primary storage, the one or more file migration records in the reconcile database are updated. Responsive to receiving a command to unmount a first mounted tape on one of the one or more tape drives, a reconcile function is performed on the first mounted tape, wherein the reconcile function updates the first mounted tape with the one or more file migration records in the reconcile database.

First claim

What is claimed is:

1. A computer-implemented method for automatic data reconciliation, the computer-implemented method comprising:
responsive to migrating a file on a hierarchical storage system from a primary storage to one or more tape drives, recording, by one or more computer processors, one or more file migration records in a reconcile database;
responsive to the occurrence of a file event on the primary storage, updating, by the one or more computer processors, the one or more file migration records in the reconcile database, wherein the file event is chosen from the group consisting of a delete operation and a rename operation; and
responsive to receiving a command to unmount a first mounted tape on one tape drive of the one or more tape drives, performing, by the one or more computer processors, a reconcile function on the first mounted tape on the one tape drive of the one or more tape drives, wherein the reconcile function updates the first mounted tape with the one or more file migration records in the reconcile database.

2. The computer-implemented method of claim 1 , wherein responsive to receiving a command to unmount the first mounted tape on the one tape drive of the one or more tape drives, performing the reconcile function on the first mounted tape on the one tape drive of the one or more tape drives, comprises:
receiving, by the one or more computer processors, a signal to unmount the first mounted tape on the one tape drive of the one or more tape drives;
searching, by the one or more computer processors, the reconcile database for one or more file migration records for the first mounted tape;
responsive to the reconcile database containing one or more file migration records for the first mounted tape, performing, by the one or more computer processors, the reconcile function on the first mounted tape, wherein the reconcile function updates the first mounted tape with the one or more file migration records in the reconcile database; and
unmounting, by the one or more computer processors, the first mounted tape.

3. The computer-implemented method of claim 1 , further comprising:
selecting, by the one or more computer processors, a first tape drive of the one or more tape drives;
determining, by the one or more computer processors, if the first tape drive of the one or more tape drives is in an idle state;
responsive to determining that the first tape drive of the one or more tape drives is in an idle state, determining, by the one or more computer processors, if the time that the first tape drive of the one or more tape drives is in an idle state exceeds a threshold;
responsive to determining the time that the first tape drive of the one or more tape drives is in an idle state exceeds a threshold, determining, by the one or more computer processors, if an online tape is mounted in the first tape drive of the one or more tape drives;
responsive to determining that the online tape is mounted in the first tape drive of the one or more tape drives, determining, by the one or more computer processors, if one or more file migration records for the online tape exist in the reconcile database; and
responsive to determining that one or more file migration records for the online tape exist in the reconcile database, performing, by the one or more computer processors, the reconcile function on the online tape, wherein the reconcile function updates the online tape with the one or more file migration records in the reconcile database.

4. The computer-implemented method of claim 3 , further comprising:
responsive to determining that an online tape is not mounted in the first tape drive of the one or more tape drives, determining, by the one or more computer processors, if one or more file migration records exist in the reconcile database for one or more offline tapes for the first tape drive of the one or more tape drives;
responsive to determining that the one or more file migration records exist in the reconcile database for the one or more offline tapes for the first tape drive of the one or more tape drives, selecting, by the one or more computer processors, one of the one or more offline tapes, wherein the one of the one or more offline tapes has a largest number of file migration records in the reconcile database;
mounting, by the one or more computer processors, the one of the one or more offline tapes; and
performing, by the one or more computer processors, the reconcile function on the one of the one or more offline tapes.

5. The computer-implemented method of claim 1 , wherein migrating a file on a hierarchical storage system from a primary storage to one or more tape drives further comprises creating a stub file on the primary storage containing a metadata of the migrated file.

6. The computer-implemented method of claim 1 , wherein the file migration records in the reconcile database contain at least an event type, a first file path, and a second file path.

7. The computer-implemented method of claim 1 , wherein the primary storage contains solid state disk drives.

8. A computer program product for automatic data reconciliation, the computer program product comprising one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions including instructions to:
responsive to migrating a file on a hierarchical storage system from a primary storage to one or more tape drives, record one or more file migration records in a reconcile database;
responsive to the occurrence of a file event on the primary storage, update the one or more file migration records in the reconcile database, wherein the file event is chosen from the group consisting of a delete operation and a rename operation; and
responsive to receiving a command to unmount a first mounted tape on one tape drive of the one or more tape drives, perform a reconcile function on the first mounted tape on the one tape drive of the one or more tape drives, wherein the reconcile function updates the first mounted tape with the one or more file migration records in the reconcile database.

9. The computer program product of claim 8 , wherein responsive to receiving a command to unmount the first mounted tape on the one tape drive of the one or more tape drives, performing the reconcile function on the first mounted tape on the one tape drive of the one or more tape drives, comprises one or more of the following program instructions, stored on the one or more computer readable storage media, to:
receive a signal to unmount the first mounted tape on the one tape drive of the one or more tape drives;
search the reconcile database for one or more file migration records for the first mounted tape;
responsive to the reconcile database containing one or more file migration records for the first mounted tape, perform the reconcile function on the first mounted tape, wherein the reconcile function updates the first mounted tape with the one or more file migration records in the reconcile database; and
unmount the first mounted tape.

10. The computer program product of claim 8 , further comprises one or more of the following program instructions, stored on the one or more computer readable storage media, to:
select a first tape drive of the one or more tape drives;
determine if the first tape drive of the one or more tape drives is in an idle state;
responsive to determining that the first tape drive of the one or more tape drives is in an idle state, determine if the time that the first tape drive of the one or more tape drives is in an idle state exceeds a threshold;
responsive to determining the time that the first tape drive of the one or more tap

Assignees

• IBM

Inventors

• Araki Hiroshi
• Ishimoto Takeshi
• Miyoshi Hiroyuki
• Abe Atsushi

Classifications

• G06F3/0685

  Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays · CPC title

• G06F3/0649

  Lifecycle management · CPC title

• G06F3/061 Primary

  Improving I/O performance · CPC title

• G11B15/24

  Drive disengaging means · CPC title

• G11B5/86 Primary

  Re-recording, i.e. transcribing information from one magnetisable record carrier on to one or more similar or dissimilar record carriers {(by varying the order of the information G11B27/029, G11B27/036)} · CPC title