Statistics management for scale-out storage

Patent metadata

Field	Value
Publication number	US-2017177273-A1
Application number	US-201615193145-A
Country	US
Kind code	A1
Filing date	Jun 27, 2016
Priority date	Dec 21, 2015
Publication date	Jun 22, 2017
Grant date	—

Abstract

Systems and processes for statistics management in a distributed storage system using a flat cluster architecture. Statistics for managed objects are collected using virtual statistics groups across multiple storage nodes. The systems and processes are compatible with storage systems that utilize microservice architectures.

First claim

What is claimed is:

1 . A method for use with a distributed storage system comprising a plurality of storage devices, the method comprising:
initializing a statistics group on a plurality of storage nodes, the statistics group associated with a managed object; assigning ownership of the managed object to a first one of the storage nodes; collecting statistics values for the managed object on the first one of the storage nodes; changing ownership of the managed object to a second one of the storage nodes; collecting statistics values for the managed object on the second one of the storage nodes; receiving a request for a statistics value within the statistics group; combining the statistics values collected on the first one of the storage nodes and the statistics values collected on the second one of the storage nodes; and returning the combined statistics values.

2 . The method of claim 1 wherein the managed object is a table configured to metadata about storage chunks stored within the storage devices.

3 . The method of claim 1 wherein combining the statistics values collected on the first one of the storage nodes and the statistics values collected on the second one of the storage nodes comprises computing a statistics function over the statistics values collected on the first one of the storage nodes and the statistics values collected on the second one of the storage nodes.

4 . The method of claim 3 wherein computing a statistics function over the statistics values comprises computing a sum of the statistics values, determining a most recent value from the statistics values, determining a maximum value from the statistics values, or determining a minimum value from the statistics values.

5 . The method of claim 1 wherein combining the statistics values collected on the first one of the storage nodes and the statistics values collected on the second one of the storage nodes comprises appending time series data collected on the second one of the storage nodes to time series data collected on the first one of the storage nodes.

6 . The method of claim 1 wherein the distributed storage system employs a microservice architecture.

7 . A distributed storage system, comprising:
a plurality of storage nodes each having a plurality of storage devices and configured to:
initialize a statistics group on a plurality of storage nodes, the statistics group associated with a managed object;
assign ownership of the managed object to a first one of the storage nodes;
collecting statistics values for the managed object on the first one of the storage nodes;
change ownership of the managed object to a second one of the storage nodes;
collect statistics values for the managed object on the second one of the storage nodes;
receive a request for a statistics value within the statistics group;
combine the statistics values collected on the first one of the storage nodes and the statistics values collected on the second one of the storage nodes; and
return the combined statistics values.

8 . The distributed storage system of claim 7 wherein the managed object is a table configured to store metadata about storage chunks stored within the storage devices.

9 . The distributed storage system of claim 7 wherein ones of the plurality of storage nodes are configured to computing a statistics function over the statistics values collected on the first one of the storage nodes and the statistics values collected on the second one of the storage nodes.

10 . The distributed storage system of claim 9 wherein ones of the plurality of storage nodes are configured to compute a sum of the statistics values, to determine a most recent value from the statistics values, to determine a maximum value from the statistics values, or to determine a minimum value from the statistics values.

11 . The distributed storage system of claim 7 wherein ones of the plurality of storage nodes are configured to append time series data collected on the second one of the storage nodes to time series data collected on the first one of the storage nodes.

12 . The distributed storage system of claim 7 wherein each of the storage nodes comprises:
a statistics manager; and
a plurality of statistics clients each configured to maintain statistics for one or more managed objects and to send statistics to the statistics manager.

13 . The distributed storage system of claim 12 wherein the statistics manager is a microservice.

14 . The distributed storage system of claim 12 wherein the statistics manager includes a REST (Representational State Transfer) API configured to process statistics requests from user applications.

15 . The distributed storage system of claim 12 wherein the statistics manager includes a database to store statistics received from the plurality of statistics clients.

Assignees

• Emc Corp

Inventors

• Fomin Andrey
• Danilov Mikhail
• Prikhodko Vladimir
• Trusov Maxim
• Malygin Mikhail

Classifications

• G06F3/064

  Management of blocks · CPC title

• G06F3/0635

  by changing the path, e.g. traffic rerouting, path reconfiguration · CPC title

• G06F3/0604

  Improving or facilitating administration, e.g. storage management · CPC title

• G06F3/0653 Primary

  Monitoring storage devices or systems · CPC title

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title