Method and system for implementing performance tier de-duplication in a virtualization environment

Patent metadata

Field	Value
Publication number	US-2016378355-A1
Application number	US-201615154835-A
Country	US
Kind code	A1
Filing date	May 13, 2016
Priority date	Aug 23, 2013
Publication date	Dec 29, 2016
Grant date	—

Abstract

The present application provides an improved approach for managing performance tier de-duplication in a virtualization environment. A content cache is implemented on high performance tiers of storage in order to maintain a working set for the user virtual machines accessing the system, and associates fingerprints with data stored therein. During write requests from the user virtual machines, fingerprints are calculated for the data to be written. However, no de-duplication is performed during the write. During read requests, fingerprints corresponding to the data to be read are retrieved and matched with the fingerprints associated with the data in the content cache. Thus, while multiple pieces of data having the same fingerprints may be written to the lower performance tiers of storage, only one of those pieces of data having that fingerprint will be stored in the content cache for fulfilling read requests.

First claim

1 . (canceled)

2 . A computer-implemented method for de-duplication, comprising:
receiving a read request from one or more virtual machines to read at least a portion of data; identifying fingerprints corresponding to the portion of data to be read; accessing a content cache that stores a set of data for the one or more virtual machines and fingerprints corresponding to the cached set of data, wherein the content cache is configured such that it does not store more than one copy of data corresponding to a particular fingerprint; determining if any of the identified fingerprints corresponding to the portion of data being requested match any of the fingerprints corresponding to the cached set of data; if a match is found, retrieving data corresponding to the matched fingerprints from the cached set of data; and if a match is not found, retrieving the portion of data from an extent store and writing a copy of the portion of data into the content cache, wherein the extent store is a persistent storage device associated with one or more virtual disks.

3 . The computer-implemented method of claim 2 , wherein the fingerprints comprise SHA1 fingerprints.

4 . The computer-implemented method of claim 2 , wherein the fingerprints are associated with locations on the one or more virtual disks.

5 . The computer-implemented method of claim 2 , wherein the content cache is implemented in RAM or flash.

6 . The computer-implemented method of claim 2 , wherein the content cache associates fingerprints with working set of data using a hash table.

7 . The computer-implemented method of claim 2 , wherein the content cache comprises one or more LRU chains.

8 . The computer-implemented method of claim 7 , wherein the LRU chains comprise a single-touch LRU chain and a multi-touch LRU chain.

9 . A system for de-duplication in a virtualization environment, comprising:
a processor; a memory comprising computer code executed using the processor, in which the computer code implements: receiving a read request from one or more virtual machines to read at least a portion of data; identifying fingerprints corresponding to the portion of data to be read; accessing a content cache that stores a set of data for the one or more virtual machines and fingerprints corresponding to the cached set of data, wherein the content cache is configured such that it does not store more than one copy of data corresponding to a particular fingerprint; determining if any of the identified fingerprints corresponding to the portion of data being requested match any of the fingerprints corresponding to the cached set of data; if a match is found, retrieving data corresponding to the matched fingerprints from the cached set of data; and if a match is not found, retrieving the portion of data from an extent store and writing a copy of the portion of data into the content cache, wherein the extent store is a persistent storage device associated with one or more virtual disks.

10 . The system of claim 9 , wherein the fingerprints comprise SHA1 fingerprints.

11 . The system of claim 9 , wherein the fingerprints are associated with locations on the one or more virtual disks.

12 . The system of claim 9 , wherein the content cache is implemented in RAM or flash.

13 . The system of claim 9 , wherein the content cache associates fingerprints with working set of data using a hash table.

14 . The system of claim 9 , wherein the content cache comprises one or more LRU chains.

15 . The system of claim 14 , wherein the LRU chains comprise a single-touch LRU chain and a multi-touch LRU chain.

16 . A computer program product embodied on a non-transitory computer readable medium, the computer readable medium having stored thereon a sequence of instructions which, when executed by a processor causes the processor to execute a method for de-duplication in a virtualization environment, the method comprising:
receiving a read request from one or more virtual machines to read at least a portion of data; identifying fingerprints corresponding to the portion of data to be read; accessing a content cache that stores a set of data for the one or more virtual machines and fingerprints corresponding to the cached set of data, wherein the content cache is configured such that it does not store more than one copy of data corresponding to a particular fingerprint; determining if any of the identified fingerprints corresponding to the portion of data being requested match any of the fingerprints corresponding to the cached set of data; if a match is found, retrieving data corresponding to the matched fingerprints from the cached set of data; and if a match is not found, retrieving the portion of data from an extent store and writing a copy of the portion of data into the content cache, wherein the extent store is a persistent storage device associated with one or more virtual disks.

17 . The computer program product of claim 16 , wherein the fingerprints comprise SHA1 fingerprints.

18 . The computer program product of claim 16 , wherein the fingerprints are associated with locations on the one or more virtual disks.

19 . The computer program product of claim 16 , wherein the content cache is implemented in RAM or flash.

20 . The computer program product of claim 16 , wherein the content cache associates fingerprints with working set of data using a hash table.

21 . The computer program product of claim 16 , wherein the content cache comprises one or more LRU chains.

22 . The computer program product of claim 21 , wherein the LRU chains comprise a single-touch LRU chain and a multi-touch LRU chain.

Assignees

• Nutanix Inc

Inventors

• Muthukkaruppan Kannan
• Ranganathan Karthik

Classifications

• G06F3/0641 Primary

  De-duplication techniques · CPC title

• G06F3/0659

  Command handling arrangements, e.g. command buffers, queues, command scheduling · CPC title

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title

• G06F2212/1044

  Space efficiency improvement · CPC title

• G06F2212/151

  Emulated environment, e.g. virtual machine · CPC title