System and method for parallelized performance data collection in a computing system

Patent metadata

Field	Value
Publication number	US-9304702-B2
Application number	US-201414290313-A
Country	US
Kind code	B2
Filing date	May 29, 2014
Priority date	May 29, 2014
Publication date	Apr 5, 2016
Grant date	Apr 5, 2016

Abstract

A system and method for of prioritizing accumulation of time-dependent data is disclosed. In an embodiment, a plurality of data elements are identified to be retrieved. The data elements include a high-priority data element and a low-priority data element. A first data retrieval operation is performed to retrieve the high-priority data element, to store a copy of the high-priority data element in a memory structure, and to reserve a memory space in the memory structure for the low-priority data element based on the low-priority data element corresponding to the high-priority data element. In parallel with the first data retrieval operation, a second data retrieval operation is performed to analyze the memory structure to detect the reserved memory space, upon detecting the reserved memory space, to retrieve the low-priority data element, and to store a copy of the low-priority data element in the reserved memory space.

First claim

What is claimed is:

1. A method of prioritizing accumulation of time-dependent data performed by a computing system, the method comprising:
identifying a plurality of data elements to be retrieved, wherein the plurality of data elements includes a high-priority data element and a low-priority data element;
performing a first data retrieval operation, wherein the first data retrieval operation includes:
retrieving the high-priority data element; and
storing a copy of the high-priority data element in a memory structure; and

performing a second data retrieval operation, wherein the second data retrieval operation is performed in parallel with the first data retrieval operation, and wherein the second data retrieval operation includes:
identifying the low-priority data based on the memory structure;
retrieving the low-priority data element; and
storing a copy of the low-priority data element in the memory structure.

2. The method of claim 1 ,
wherein the first data retrieval operation further includes reserving a memory space in the memory structure for the low-priority data element based on the low-priority data element corresponding to the high-priority data element, and
wherein the second data retrieval operation further includes identifying the low priority data based on the reserved memory space and storing the copy of the low-priority data element in the reserved memory space.

3. The method of claim 1 , wherein the high-priority data element includes a performance metric of a storage element, and wherein the low-priority data element includes an identifier of the storage element.

4. The method of claim 1 , wherein the high-priority data element includes a performance metric of a storage element, and wherein the low-priority data element includes an identifier of the performance metric.

5. The method of claim 1 , wherein the high-priority data element is identified as high-priority based on at least one of time-dependency, an access time, and a corresponding hierarchical level.

6. The method of claim 1 , wherein the retrieving of the low-priority data element includes retrieving the low-priority data element from a daemon-level virtual address space.

7. The method of claim 6 , wherein the retrieving of the low-priority data element includes constructing a batch request for the low-priority data element and at least one other data element.

8. The method of claim 6 , wherein the retrieving of the low-priority data element includes providing a Remote Procedure Call (RPC) request for the low-priority data element to a daemon-level program element.

9. The method of claim 1 further comprising storing the memory structure including the high-priority data element and the low-priority data element in a non-volatile storage medium, and analyzing the stored memory structure to determine a performance-limiting component of the computing system.

10. A data management method, the method comprising:
performing a first logical sequence, the first logical sequence including:
retrieving a plurality of data elements; and
storing the plurality of data elements in a memory structure; and

performing a second logical sequence concurrent with the performing of the first logical sequence, the second logical sequence including:
monitoring the memory structure to identify a related data element corresponding to at least one element of the plurality of data elements;
retrieving the related data element; and
storing the related data element in the memory structure.

11. The data management method of claim 10 , wherein the plurality of data elements include a performance metric associated with a storage element, and wherein the related data element includes at least one of: an identifier of the storage element, and an identifier of the performance metric.

12. The data management method of claim 10 further comprising storing the memory structure including the plurality of data elements and the related data element in a non-volatile storage medium, and analyzing the stored memory structure to determine a performance-limiting component of a computing system.

13. The data management method of claim 10 , wherein the retrieving of the related data element includes retrieving the related data element from a daemon-level address space.

14. The data management method of claim 13 , wherein the retrieving of the related data element includes providing a Remote Procedure Call (RPC) request for the related data element to a daemon-level program element.

15. The data management method of claim 13 , wherein the retrieving of the related data element includes constructing a batch request for the related data element and at least one other data element.

16. An apparatus comprising: a non-transitory, tangible computer readable storage medium storing a computer program, wherein the computer program has instructions that, when executed by a computer processor, carry out:
identifying a first data element based on at least one of time-dependency, an access time, and a corresponding hierarchical level;
performing a first sequence including:
retrieving the first data element;
storing a copy of the first data element in a memory structure; and
storing an indicator in the memory structure, wherein the indicator indicates a second data element associated with the first data element;

performing a second sequence in parallel with the first sequence, wherein the second sequence includes:
analyzing the memory structure to detect the indicator of the second data element;
retrieving the second data element; and
storing a copy of the second data element in the memory structure.

17. The apparatus of claim 16 , wherein the computer program has further instructions that carry out writing to a non-transitory storage medium the memory structure containing the copy of the first data element and the copy of the second data element.

18. The apparatus of claim 17 , wherein the computer program has further instructions that carry out analyzing the stored memory structure to determine a performance-limiting component of a computing system.

19. The apparatus of claim 16 , wherein the instructions that carry out the retrieving of the second data element retrieve the second data element from a daemon-level address space.

20. The apparatus of claim 19 , wherein the computer program has further instructions that carry out combining a request for the second data element with a request for a third data element from the user-level address space.

Assignees

• Netapp Inc

Inventors

• Truong Dan
• Sideropoulos Alexander
• Cao Michael
• Luk Raymond

Classifications

• G06F11/3034

  where the computing system component is a storage system, e.g. DASD based or network based (digital input from or digital output to record carriers G06F3/06; digital recording or reproducing G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097) · CPC title

• G06F3/0653

  Monitoring storage devices or systems · CPC title

• G06F11/3404

  for parallel or distributed programming · CPC title

• G06F11/3442

  for planning or managing the needed capacity · CPC title

• G06F3/0613

  in relation to throughput · CPC title