Methods and systems for determining performance capacity of a resource of a networked storage environment

Patent metadata

Field	Value
Publication number	US-10511511-B2
Application number	US-201815896363-A
Country	US
Kind code	B2
Filing date	Feb 14, 2018
Priority date	Jul 22, 2015
Publication date	Dec 17, 2019
Grant date	Dec 17, 2019

Abstract

Methods and systems for a networked storage system are provided. One method includes filtering performance data associated with a resource used in a networked storage environment for reading and writing data at a storage device; and determining available performance capacity of the resource using the filtered performance data. The available performance capacity is based on optimum utilization of the resource and actual utilization of the resource, where utilization of the resource is an indicator of an extent the resource is being used at any given time, the optimum utilization is an indicator of resource utilization beyond which throughput gains for a workload is smaller than increase in latency and latency is an indicator of delay at the resource in processing the workload.

First claim

What is claimed is:

1. A machine implemented method, comprising:
transforming by a processor, performance and utilization data associated with a plurality of resources of a networked storage system by discarding any unreliable data due to an event associated with one or more of the plurality of resources and inserting missing performance and utilization data with expected performance and utilization data;
selecting by the processor a most reliable relationship between latency and utilization of a resource from a plurality of latency and utilization relationships generated from the transformed performance and utilization data by a model based technique that uses a queuing model and inter-arrival and service times to process workloads by the resource, and an observation based technique that uses current and historical measured latency and utilization of the resource; wherein the most reliable relationship is based on an indicator indicating a most reliable optimum utilization of the resource;
determining by the processor, available performance capacity of the resource using the most reliable latency and utilization relationship; wherein the available performance capacity is based on optimum and actual utilization of the resource; and
reconfiguring one or more resources of the networked storage system, based on the available performance capacity.

2. The machine implemented method of claim 1 , wherein the resource is a processor for a networking module that provides networking functionality in the networked storage environment and a processor for a storage module that interfaces with the storage device for storing data.

3. The machine implemented method of claim 1 , wherein the available performance capacity is stored at a data structure accessible to at least one application programming interface (API).

4. The machine implemented method of claim 1 , wherein data tracked by the processor includes current latency and utilization data, historical latency and utilization data for the resource, inter-arrival time and service time for workloads processed by the resource.

5. The machine implemented method of claim 1 , further comprising: using an object hierarchy by the processor for tracking performance and utilization of the plurality of resources of the networked storage system.

6. The machine implemented method of claim 1 , further comprising: tracking by the processor, latency at a node based on an operation type, idle time of a processor of the node, and inter-arrival times and service times for different workloads processed by the plurality of resources; wherein the model based technique uses inter-arrival time and service time for generating a relationship between latency and utilization.

7. The machine implemented method of claim 1 , wherein the actual utilization is based on a specific utilization associated with a certain service level for a user.

8. A non-transitory, machine readable storage medium having stored thereon instructions for performing a method, comprising machine executable code which when executed by at least one machine, causes the machine to:
transform by a processor, performance and utilization data associated with a plurality of resources of a networked storage system by discarding any unreliable data due to an unusual event associated with one or more of the plurality of resources and inserting missing performance and utilization with expected performance and utilization data;
select by the processor a most reliable relationship between latency and utilization of a resource from a plurality of latency and utilization relationships generated from the transformed performance and utilization data by a model based technique that uses a queuing model and inter-arrival and service times to process workloads by the resource, and an observation based technique that uses current and historical measured latency and utilization of the resource; wherein the most reliable relationship is based on an indicator indicating a most reliable optimum utilization of the resource;
determine by the processor, available performance capacity of the resource using the most reliable latency and utilization relationship; wherein the available performance capacity is based on optimum and actual utilization of the resource; and
reconfigure one or more resources of the networked storage system, based on the available performance capacity.

9. The storage medium of claim 8 , wherein the resource is a processor for a networking module that provides networking functionality in the networked storage environment and a processor for a storage module that interfaces with the storage device for storing data.

10. The storage medium of claim 8 , wherein the actual utilization is based on a specific utilization associated with a certain service level for a user.

11. The storage medium of claim 8 , wherein data tracked by the processor includes current latency and utilization data, historical latency and utilization data for the resource, inter-arrival time and service time for workloads processed by the resource.

12. The storage medium of claim 8 , wherein the machine executable code, further causes the machine to: use an object hierarchy by the processor for tracking performance and utilization of the plurality of resources of the networked storage system.

13. The storage medium of claim 8 , wherein the machine executable code, further causes the machine to: track by the processor, latency at a node based on an operation type, idle time of a processor of the node, and inter-arrival times and service times for different workloads processed by the plurality of resources; wherein the model based technique uses inter-arrival time and service time for generating a relationship between latency and utilization.

14. The storage medium of claim 8 , wherein the available performance capacity is stored at a data structure accessible to at least one application programming interface (API).

15. A system comprising:
a memory containing machine readable medium comprising machine executable code having stored thereon instructions; and a processor module coupled to the memory, the processor module configured to execute the machine executable code to:
transform performance and utilization data associated with a plurality of resources of a networked storage system by discarding any unreliable data due to an event associated with one or more of the plurality of resources and inserting missing performance and utilization with expected performance and utilization data;
select a most reliable relationship between latency and utilization of a resource from a plurality of latency and utilization relationships generated from the transformed performance and utilization data by a model based technique that uses a queuing model and inter-arrival and service times to process workloads by the resource, and an observation based technique that uses current and historical measured latency and utilization of the resource; wherein the most reliable relationship is based on an indicator indicating a most reliable optimum utilization of the resourced;
determine available performance capacity of the resource using the most reliable latency and utilization relationship; wherein the available performance capacity is based on optimum and actual utilization of the resource; and
reconfigure one or more resources of the networked storage system, based on the available performance capacity.

16. The system of claim 15 , wherein the resource is a processor for a networking module that provides networking functionality in the networked storage environment and a proces

Assignees

• Netapp Inc

Inventors

• Hrischuk Curtis
• Dimnaku Alma
• Fairbanks Leon
• Semerci Oguz

Classifications

• H04L43/028

  by filtering · CPC title

• H04L43/0852

  Delays · CPC title

• H04L43/0888 Primary

  Throughput · CPC title