Method and apparatus for using cache size estimations for guiding hot-tier insertion decisions

Patent metadata

Field	Value
Publication number	US-2019332536-A1
Application number	US-201815965721-A
Country	US
Kind code	A1
Filing date	Apr 27, 2018
Priority date	Apr 27, 2018
Publication date	Oct 31, 2019
Grant date	—

Abstract

A method and apparatus for using cache size estimations for guiding hot-tier insertion decisions. The method and apparatus include an adaptive management element that determines what accesses of a resource should be logged and the parameters for logging. The determinations are used to configure an adaptive logging element to log only accesses corresponding to the selected resource(s) and to log only those accesses that match the identified parameters. The adaptive management element operates in a feedback loop: first determining what will be logged and second implementing that determination by an adaptive logging element. Upon a triggering event, the process returns to the first determination based on any then current parameters. In some embodiments, the parameters include a size estimate to achieve a given target hit rate (target hit rate size estimate) that is used in generating a score or weighting to identify the highest/best scoring/weighted disk(s) for logging.

First claim

What is claimed is:

1 . A method, comprising:
selecting, for logging an access request, a vDisk of a plurality of vDisks to manage placement of data into a hot storage tier, wherein the vDisk is selected for logging based on vDisk metadata and a target hit rate size estimate; and as a result of at least selecting the vDisk for logging the access request:
generating an entry in an activity log for an access request to the vDisk, and
placing corresponding data into the hot storage tier for the vDisk based at least in part on the entry corresponding to the access request in the activity log.

2 . The method of claim 1 , wherein the corresponding data is promoted from a lower storage tier to a hot storage tier is identified for promotion to the hot storage tier based on meeting or exceeding a threshold, and the threshold comprises a minimum number of accesses in a sliding time window.

3 . The method of claim 1 , further comprising processing updated node data to select a second vDisk for logging from the plurality of vDisks and logging a second access request corresponding to the second vDisk in the activity log.

4 . The method of claim 1 , wherein vDisks are selected based on at least node data and cluster data corresponding to a plurality of nodes.

5 . The method of claim 1 , further comprising processing cluster data and node data to determine a parameter for logging, and wherein only access requests that satisfy the parameter are logged in the activity log.

6 . The method of claim 4 , wherein the cluster data comprises storage pool metadata and the node data comprises the vDisk metadata and target hit rate size estimates.

7 . The method of claim 1 , wherein the vDisk is selected by at least generating an estimate of an amount of storage required to be moved to a hot storage tier to cause a specified incremental hit rate increase for the vDisk.

8 . The method of claim 1 , wherein a plurality of estimates of an amount of storage required are normalized to generate respective scores for respective vDisks of the plurality of vDisks.

9 . The method of claim 8 , wherein the vDisk selected is a best scoring vDisk of the plurality of vDisks and the best scoring vDisk is determined based on a scoring criteria.

10 . The computer program product of claim 18 , where in the respective scores are generated based on a parameter of node data, cluster data, or some combination thereof.

11 . A non-transitory computer readable medium having stored thereon a sequence of instructions which, when executed by a processor causes a process comprising:
selecting, for logging an access request, a vDisk of a plurality of vDisks to manage placement of data into a hot storage tier, wherein the vDisk is selected for logging based on vDisk metadata and a target hit rate size estimate; and as a result of at least selecting the vDisk for logging the access request:
generating an entry in an activity log for an access request to the vDisk, and
placing corresponding data into the hot storage tier for the vDisk based at least in part on the entry corresponding to the access request in the activity log.

12 . The computer program product of claim 11 , wherein the corresponding data is promoted from a lower storage tier to a hot storage tier is identified for promotion to the hot storage tier based on meeting or exceeding a threshold, and the threshold comprises a minimum number of accesses in a sliding time window.

13 . The computer program product of claim 11 , the process further comprising processing updated node data to select a second vDisk for logging from the plurality of vDisks and logging a second plurality access request corresponding to the second vDisk in the activity log.

14 . The computer program product of claim 11 , wherein the vDisks are selected based on at least node data and cluster data corresponding to a plurality of nodes.

15 . The computer program product of claim 11 , the process further comprising processing cluster data and node data to determine a parameter for logging, and wherein only access requests that satisfy the parameter are logged in the activity log.

16 . The computer program product of claim 14 , wherein the cluster data comprises storage pool metadata and the node data comprises the vDisk metadata and target hit rate size estimates.

17 . The computer program product of claim 11 , wherein the vDisk is selected by at least generating an estimate of an amount of storage required to be moved to a hot storage tier to cause a specified incremental hit rate increase for the vDisk.

18 . The computer program product of claim 11 , wherein a plurality of estimates of an amount of storage required are normalized to generate respective scores for respective vDisks of the plurality of vDisks.

19 . The computer program product of claim 18 , wherein the vDisk selected is a best scoring vDisk of the plurality of vDisks and the best scoring vDisk is determined based on a scoring criteria.

20 . A computing system for guiding hot-tier insertion decisions, comprising:
a memory for storing data and instructions; and a processor that executes the instructions to enable actions, including:
selecting, for logging an access request, a vDisk of a plurality of vDisks to manage placement of data into a hot storage tier, wherein the vDisk is selected for logging based on vDisk metadata and a target hit rate size estimate; and
as a result of at least selecting the vDisk for logging the access request:
generating an entry in an activity log for an access request to the vDisk, and
placing corresponding data into the hot storage tier for the vDisk based at least in part on the entry corresponding to the access request in the activity log.

Assignees

• Nutanix Inc

Inventors

• Allen Cyril Anthony
• NIJHAWAN Aman
• Wyckoff Peter Scott
• Faith Rickard Edward

Classifications

• G06F3/0649

  Lifecycle management · CPC title

• G06F3/0608

  Saving storage space on storage systems · CPC title

• G06F3/064

  Management of blocks · CPC title

• G06F2212/1024

  Latency reduction · CPC title

• G06F2212/152

  Virtualized environment, e.g. logically partitioned system · CPC title