Dynamic caching module selection for optimized data deduplication

Patent metadata

Field	Value
Publication number	US-9298638-B2
Application number	US-201314059959-A
Country	US
Kind code	B2
Filing date	Oct 22, 2013
Priority date	Mar 13, 2013
Publication date	Mar 29, 2016
Grant date	Mar 29, 2016

Abstract

Embodiments of the invention provide a method, system and computer program product for dynamic caching module selection for optimized data deduplication. In an embodiment of the invention, a method for dynamic caching module selection for optimized data deduplication is provided. The method includes receiving a request to retrieve data and classifying the request. The method also includes identifying from amongst multiple different caching modules each with a different configuration a particular caching module associated with the classification of the request. Finally, the method includes deduplicating the data in the identified caching module.

First claim

We claim:

1. A computer processor implemented method for dynamic caching module selection for optimized data deduplication, the method comprising:
receiving a request to retrieve data;
classifying the request;
identifying from amongst multiple different caching modules, each multiple different caching module with a different configuration, a particular caching module associated with the classification of the request; and,
deduplicating the data in the identified particular caching module, but bypassing the deduplication of the data when the request indicates that data is encrypted.

2. The method of claim 1 , wherein the request is classified according to a table correlating different requests to different ones of the multiple different caching modules.

3. The method of claim 1 , wherein the multiple different caching modules include byte caching modules, each byte caching module configured with a different fingerprint size.

4. The method of claim 3 , wherein the byte caching modules additionally include an object caching module.

5. The method of claim 2 , wherein the table correlates a protocol and network address for each of the different requests with a corresponding one of the multiple different caching modules.

6. The method of claim 2 , wherein the table includes entries determined by processing training data for each of the different requests in each of the multiple different caching modules and correlating each of the different requests with an optimal one of the multiple different caching modules.

7. The method of claim 6 , further comprising constructing the table by:
submitting the training data to each of the multiple different caching modules from different servers according to different protocols,
monitoring performance metrics of each of the multiple different caching modules and measuring the performance for throughput, processor and memory utilization and response time,
submitting the measured metrics to a performance function that weights different metrics for utilization of different resources and then sums the weighted metrics into an aggregated metric,
comparing the aggregate metric for a particular training data set against other aggregate metrics for the training data set in different ones of the multiple different caching modules, and
selecting an optimal one of the multiple different caching modules corresponding to a classification for the training data.

8. The method of claim 1 , wherein each of the multiple different caching modules comprises an encoding caching module enabled to perform data deduplication and also a corresponding decoding caching module enabled to reconstitute data after data deduplication.

Assignees

• IBM

Inventors

• Callaway Robert D
• Papapanagiotou Ioannis

Classifications

• G06F12/0871 Primary

  Allocation or management of cache space · CPC title

• G06F2212/264

  Remote server · CPC title

• G06F2212/283

  Plural cache memories · CPC title

• G06F12/0891 Primary

  using clearing, invalidating or resetting means · CPC title

• G06F12/12

  Replacement control · CPC title