Data de-duplication

Patent metadata

Field	Value
Publication number	US-9547663-B2
Application number	US-201414259506-A
Country	US
Kind code	B2
Filing date	Apr 23, 2014
Priority date	Apr 23, 2013
Publication date	Jan 17, 2017
Grant date	Jan 17, 2017

Abstract

Disclosed are computer implemented methods, computer program products, and computer systems for storing a file into a storage system. An embodiment includes, responsive to a determination that a descriptive information describing content of a first file corresponds to a descriptive information describing content of a second file, that a format of the first file is convertible to a format of the second file using a transformation matrix, and that the format of the first file has a higher quality indicator value than the format of the second file, storing the first file into the storage system.

First claim

The invention claimed is:

1. A computer-implemented method for storing a file into a storage system, the method comprising:
determining that a descriptive information describing content of a first file corresponds to a descriptive information describing content of a second file;
in response to determining that a format of the first file is convertible to a format of the second file using a transformation matrix, comparing a first quality indicator value associated with the format of the first file to a second quality indicator value associated with the format of the second file;
determining that the first quality indicator value associated with the format of the first file is higher than the second quality indicator value associated with the format of the second file; and
storing the first file into the storage system.

2. The method of claim 1 , wherein determining that the descriptive information describing content of the first file corresponds to the descriptive information describing content of the second file further comprises:
comparing a hash value in the descriptive information describing content of the first file with a hash value in the descriptive information describing content of the second file.

3. The method of claim 1 , further comprising:
determining that the descriptive information describing content of the first file does not correspond to the descriptive information describing content of the second file but instead corresponds to a descriptive information describing content of a third file; and
determining that the format of the first file is convertible to a format of the third file using the transformation matrix; and
converting the first file to the format of the third file and storing the converted first file into the storage system.

4. The method of claim 3 , further comprising:
determining that the format of the first file is not convertible to the format of the third file; and
storing the first file into the storage system.

5. The method of claim 1 , further comprising:
in response to receiving a request for the first file in a selected file format, converting the first file to the selected file format based on the first file being convertible to the selected file format.

6. The method of claim 5 , wherein the selected file format belongs to a format category corresponding to at least one of a compressed file format, a media file format, and an electronic mail file format.

7. The method of claim 1 , wherein storing the first file further comprises:
storing a ranking value assigned to the format of the first file.

8. The method of claim 7 , wherein the ranking value comprises a measure of a quality of the stored first file, and the quality is selected from the group comprised of a sampling rate, a resolution, a compression ratio, and an information richness of the file content.

9. A computer program product for storing a file into a storage system, the computer program product comprising a non-transitory computer readable storage medium having program code embodied therewith, the program code executable by a processor to perform a method, the method comprising:
determining that a descriptive information describing content of a first file corresponds to a descriptive information describing content of a second file;
in response to determining that a format of the first file is convertible to a format of the second file using a transformation matrix, comparing a first quality indicator value associated with the format of the first file to a second quality indicator value associated with the format of the second file;
determining that the first quality indicator value associated with the format of the first file is higher than the second quality indicator value associated with the format of the second file; and
storing the first file into the storage system.

10. The computer program product of claim 9 , wherein determining that the descriptive information describing content of the first file corresponds to the descriptive information describing content of the second file further comprises:
comparing a hash value in the descriptive information describing content of the first file with a hash value in the descriptive information describing content of the second file.

11. The computer program product of claim 9 , wherein the method performed by the program code further comprises:
determining that the descriptive information describing content of the first file does not correspond to the descriptive information describing content of the second file but instead corresponds to a descriptive information describing content of a third file; and
determining that the format of the first file is convertible to a format of the third file using the transformation matrix; and
converting the first file to the format of the third file and storing the converted first file into the storage system.

12. The computer program product of claim 11 , wherein the method performed by the program code further comprises:
determining that the format of the first file is not convertible to the format of the third file; and
storing the first file into the storage system.

13. The computer program product of claim 9 , wherein the method performed by the program code further comprises:
in response to receiving a request for the first file in a selected file format, converting the first file to the selected file format based on the first file being convertible to the selected file format.

14. The computer program product of claim 9 , wherein storing the first file further comprises:
storing a ranking value assigned to the format of the first file.

15. A computer system for storing a file into a storage system, the computer system comprising:
a memory having instructions stored on; and
a processor configured to execute the instructions,
the system configured to:
determine that a descriptive information describing content of a first file corresponds to a descriptive information describing content of a second file;
in response to determining that a format of the first file is convertible to a format of the second file using a transformation matrix, compare a first quality indicator value associated with the format of the first file to a second quality indicator value associated with the format of the second file;
determine that the first quality indicator value associated with the format of the first file is higher than the second quality indicator value associated with the format of the second file; and
store the first file into the storage system.

16. The computer system of claim 15 , wherein, to determine that the descriptive information describing content of the first file corresponds to the descriptive information describing content of the second file, the system is further configured to:
compare a hash value in the descriptive information describing content of the first file with a hash value in the descriptive information describing content of the second file.

17. The computer system of claim 15 , wherein the system is further configured to:
determine that the descriptive information describing content of the first file does not correspond to the descriptive information describing content of the second file but instead corresponds to a descriptive information describing content of a third file;
determine that the format of the first file is convertible to a format of the third file using the transformation matrix; and
convert the first file to the format of the third file and store the converted first file into the storage system.

Assignees

• IBM

Inventors

• Baessler Michael
• Jiang peng hui
• Jiang Pi Jun

Classifications

• G06F16/1748 Primary

  De-duplication implemented within the file system, e.g. based on file segments (de-duplication techniques in storage systems for the management of data blocks G06F3/0641) · CPC title

• G06F17/30156 Primary

  Physics · mapped topic