Storing selected data in a stub file in a hierarchical storage management system

Patent metadata

Field	Value
Publication number	US-10222994-B2
Application number	US-201615207553-A
Country	US
Kind code	B2
Filing date	Jul 12, 2016
Priority date	Jul 12, 2016
Publication date	Mar 5, 2019
Grant date	Mar 5, 2019

Abstract

According to an aspect of the present invention, there is a method, computer program product and/or system for storing data that performs the following operations (not necessarily in the following order): (i) receiving a request to migrate a data file from primary storage to secondary storage; (ii) invoking a primary data extraction function, registered by a user, to determine primary data for the data file; and (iii) inserting the primary data into a stub file.

First claim

What is claimed is:

1. A method for storing data, the method comprising:
receiving a request to migrate a data file containing a plurality of records from a primary storage device to a secondary storage device;
determining primary data where the primary data includes a subset of the data file, and the primary data is determined based on rules and criteria set by a user, and further based on a type of data included in the data file;
inserting the primary data into a stub file; and
storing the stub file on the primary storage device.

2. The method of claim 1 further comprising:
migrating the data file to the secondary storage device to produce a migrated data file.

3. The method of claim 1 , wherein determining primary data comprises:
determining that the data file comprises a system log file that includes a plurality of error records including a first error record, where the first error record is preceded by an adjacent first pre-determined number of contiguous preceding records and the first error record is followed by an adjacent second pre-determined number of contiguous following records;
in response to determining the data file comprises a system log file, designating the combination of the preceding records, the first error record and the following records as primary data.

4. The method of claim 1 , wherein determining primary data comprises:
determining that the data file comprises numerical data;
in response to determining the data file comprises numerical data, designating primary data as data that is based at least in part on the numerical data and is selected from the group consisting of: a computed result, a selected subset of the numerical data, a minimum value, a maximum value, a mean value, a median value, a standard deviation value, a cardinality value, and a distribution parameter.

5. A method for accessing data, the method comprising:
determining that:
a data file has been migrated to secondary storage,
a stub file, corresponding to the data file, exists on primary storage, and
the stub file includes primary data, with respect to the data file; and

in response to the determining, accessing the primary data from the stub file;
wherein the primary data includes a subset of the data file, and the primary data is determined based on rules and criteria set by a user, and further based on a type of data included in the data file.

Assignees

• IBM

Inventors

• Araki Hiroshi
• Fujihara Shinobu
• Hasegawa Tohru
• Ishimoto Takeshi
• Itagaki Hiroshi
• Miyoshi Hiroyuki
• Oishi Yutaka

Classifications

• G06F3/0683

  Plurality of storage devices · CPC title

• G06F3/0647

  Migration mechanisms · CPC title

• G06F3/061 Primary

  Improving I/O performance · CPC title

• G06F3/065

  Replication mechanisms · CPC title

• G06F3/0643

  Management of files · CPC title