Preserving redundancy in data deduplication systems

Patent metadata

Field	Value
Publication number	US-9779103-B2
Application number	US-201213453252-A
Country	US
Kind code	B2
Filing date	Apr 23, 2012
Priority date	Apr 23, 2012
Publication date	Oct 3, 2017
Grant date	Oct 3, 2017

Abstract

Various embodiments for preserving data redundancy in a data deduplication system in a computing environment are provided. An indicator is configured. The indicator is provided with a selected data segment to be written through the data deduplication system to designate that the selected data segment must not be subject to a deduplication operation, such that repetitive data can be written and stored on physical locations despite being identical.

First claim

What is claimed is:

1. A system for preserving data redundancy in a data deduplication system in a computing environment, comprising:
a file system module;
a storage controller in communication with the file system module, wherein the file system module:
receives a write command for writing a selected data segment to a physical storage location, wherein the selected data segment is at least one of a Superblock and file system metadata required to be stored repetitively on physical storage;
determines whether the write command includes an indicator including at least one of a bit and a flag, the indicator designating that the selected data segment must not be subject to a deduplication operation;
if the write command does not include the indicator, generates a fingerprint for the selected data segment and performing a deduplication operation on the selected data segment; and
if the write command does include the indicator, bypasses the generating the fingerprint and the deduplication operation; and

an application, operationally communicative with the file system module, wherein the application:
provides a system call with an extended attribute indicating that the selected data segment must memory notwithstanding the selected data segment matching data written to the physical memory earlier in time.

2. The system of claim 1 , wherein the storage controller processes the indicator such that the deduplication operation is withheld from being performed on the selected data segment.

3. The system of claim 2 , further including a storage driver in communication between the file system module and the storage controller, wherein the storage driver, pursuant to processing the indicator, prepares the write command and incorporates the indicator into the write command to be provided to the storage controller.

4. The system of claim 3 , wherein the storage controller, pursuant to processing the indicator:
receives the write command, and
directly writes the selected data segment to a new physical storage location.

5. The system of claim 1 , wherein the at least one of the bit and the flag are associated with the selected data segment using an adapted small computer system interface (SCSI) write command.

6. A computer program product for preserving data redundancy in a data deduplication system in a computing environment by a processor, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:
a first executable portion for:
receiving a write command for writing a selected data segment to a physical storage location, wherein the selected data segment is at least one of a Superblock and file system metadata required to be stored repetitively on physical storage;
determining whether the write command includes an indicator including at least one of a bit and a flag, the indicator designating that the selected data segment must not be subject to a deduplication operation;
if the write command does not include the indicator, generating a fingerprint for the selected data segment and performing a deduplication operation on the selected data segment;
if the write command does include the indicator, bypassing the generating the fingerprint and the performing the deduplication operation; and
pursuant to configuring computing environment, providing a system call with an extended attribute indicating that the selected data segment must be written to physical memory notwithstanding the selected data segment matching data written to the physical memory earlier in time.

7. The computer program product of claim 6 , further including a second executable portion for processing the indicator such that the deduplication operation is withheld from being performed on the selected data segment.

8. The computer program product of claim 7 , further including a third executable portion for, pursuant to processing the indicator, preparing the write command, and incorporating the indicator into the write command to be provided to a storage controller in the computing environment.

9. The computer program product of claim 8 , further including a fourth executable portion for, pursuant to processing the indicator:
receiving the write command by the storage controller, and
directly writing the selected data segment to a new physical storage location.

Assignees

• Fiske Rahul M
• Jones Carl Evan
• Roy Subhojit
• IBM

Inventors

• Fiske Rahul M
• Jones Carl Evan
• Roy Subhojit

Classifications

• G06F3/0641 Primary

  De-duplication techniques · CPC title

• G06F3/0608 Primary

  Saving storage space on storage systems · CPC title

• G06F3/0659

  Command handling arrangements, e.g. command buffers, queues, command scheduling · CPC title

• G06F3/0619

  in relation to data integrity, e.g. data losses, bit errors · CPC title

• G06F3/0689

  Disk arrays, e.g. RAID, JBOD · CPC title