System and method for operating a system to cache a networked file system utilizing tiered storage and customizable eviction policies based on priority and tiers

Patent metadata

Field	Value
Publication number	US-9355036-B2
Application number	US-201314031026-A
Country	US
Kind code	B2
Filing date	Sep 18, 2013
Priority date	Sep 18, 2012
Publication date	May 31, 2016
Grant date	May 31, 2016

Abstract

A network attached storage (NAS) caching appliance, system, and associated method of operation for caching a networked file system. Still further, some embodiments provide for a cache system that implements a mufti-tiered, policy-influenced block replacement algorithm.

First claim

What is claimed is:

1. A non-transitory computer-readable medium that stores instructions for caching a networked file system, the instructions being executable by one or more processors to cause the one or more processors to perform operations comprising:
connecting a cache system in-line as between a networked file system and one or more clients of the networked file system, the cache system including one or more appliances that store data corresponding to at least a portion of the networked file system;
assigning each of multiple cache resources to one of a plurality of ranks, wherein the cache resources of each rank include a greedy capacity;
processing requests from the one or more clients to access file system objects stored on the networked file system;
wherein processing the requests includes determining whether individual requests specify data from the networked file system that are also stored in the cache system;
wherein for each processed request that specifies data stored in the cache system, providing a response to the individual requests using data that is stored in the cache system; and
wherein for each processed request that specifies data that is not stored with the cache system:
forwarding the request to the networked file system;
receiving a response from the networked file system, the response including data corresponding to a file system object stored on the networked file system;
storing cache data corresponding to the file system object;
determining a natural rank for the cache data based at least in part on an access count of the file system object;
determining a highest rank of the cache resources with available greedy capacity;
upon determining that the highest rank of the cache resources with available greedy capacity is higher than the natural rank, (i) increasing, to a level consistent with the highest rank determined, an artificial access count of the file system object, and (ii) assigning the cache data to the cache resources of the highest rank determined;
assigning the cache data to the cache resources of the natural rank when there are no cache resources with available greedy capacity higher than the natural rank; and
forwarding the response from the networked file system to a client from which the individual requests originated.

2. The non-transitory computer-readable medium of claim 1 , wherein the instructions for storing cache data further include instructions for:
determining a priority designation for the file system object corresponding to the data corresponding to the file system object stored on the network file system returned with the response; and
storing the cache data in the cache resource based on the priority designation of the file system object.

3. The non-transitory computer-readable medium of claim 2 , wherein the priority designation for the file system object data is based on one or more user-defined policies.

4. The non-transitory computer-readable medium of claim 3 , further comprising instructions for determining when to evict the cache data from the cache resource based on the priority designation.

5. The non-transitory computer-readable medium of claim 4 , further comprising instructions for evicting the cache data from the assigned cache resources by performing one of (i) removing the cache data from the cache resources of the assigned rank and storing the cache data with cache resources of a lower rank if the assigned cache resources do not belong to the lowest rank, else (ii) removing the cache data from the cache resources of the assigned rank so that the cache data is no longer cached.

6. The non-transitory computer-readable medium of claim 1 , wherein each of the multiple cache resources is assigned to one of the plurality of ranks based on a type of memory employed with that cache resource.

7. A cache system comprising:
multiple cache resources;
one or more processors to:
connect the cache system to a networked file system, the cache system being connected in-line as between the networked file system and one or more clients of the networked file system;
assign each of multiple cache resources to one of a plurality of ranks, wherein the cache resources of each rank include a greedy capacity;
process requests from the one or more clients to access file system objects stored on the networked file system by:
(i) determining whether individual requests specify data from the networked file system that are stored in the cache system, and for each processed request that specifies data stored in the cache system, provide a response to the individual requests using data that is stored in the cache system; and (ii) for each processed request that specifies data that is not stored locally in the cache system:
forward the request to the networked file system;
receive a response from the networked file system, the response including data corresponding to a file system object stored on the networked file system;
store cache data corresponding to the file system object;
determine a natural rank for the cache data based at least in part on an access count of the file system object;
determine a highest rank of the cache resources with available greedy capacity;
upon determining that the highest rank of the cache resources with available greedy capacity is higher than the natural rank, (i) increase, to a level consistent with the highest rank determined, an artificial access count of the file system object, and (ii) assign the cache data to the cache resources of the highest rank determined;
assign the cache data to the cache resources of the natural rank when there are no cache resources with available greedy capacity higher than the natural rank;
forward the response from the networked file system to a client from which the individual requests originated.

8. The cache system of claim 7 , wherein the one or more processors are to further assign each of the multiple cache resources to one of the plurality of ranks based at least in part on a type of memory used with that cache resource.

9. The cache system of claim 7 , wherein the one or more processors are to further provide a policy engine that receives input for determining multiple policies, and to determine a priority designation for the cache data based on one or more of the multiple policies.

10. The cache system of claim 7 , wherein the one or more processors are to further:
determine a priority designation for the file system object corresponding to the data corresponding to the file system object stored on the network file system returned with the response; and
store the cache data in the cache resource based on the priority designation of the file system object.

11. The cache system of claim 10 , wherein the one or more processors are to determine when to evict the cache data from the cache resource based on the priority designation.

Assignees

• Netapp Inc

Inventors

• Beard Derek
• Yammine Ghassan
• Dahl Gregory

Classifications

• G06F3/0611

  in relation to response time · CPC title

• G06F12/0875 Primary

  with dedicated cache, e.g. instruction or stack · CPC title

• G06F3/0671

  In-line storage system · CPC title

• G06F17/30132

  Physics · mapped topic

• G06F3/0646

  Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems · CPC title