Connection balancing using attempt counts at distributed storage systems

Patent metadata

Field	Value
Publication number	US-9602424-B1
Application number	US-201414231098-A
Country	US
Kind code	B1
Filing date	Mar 31, 2014
Priority date	Mar 31, 2014
Publication date	Mar 21, 2017
Grant date	Mar 21, 2017

Abstract

A connection request from a client is received at an access subsystem node of a distributed storage service. The connection request includes an attempt count parameter indicative of a number of times an establishment of a connection on behalf of the client has been attempted. A workload threshold level based on the attempt count parameter is identified for use in an acceptance decision for the connection request. In response to a determination that a local workload metric of the access subsystem node is below the workload threshold level, the connection is accepted.

First claim

What is claimed is:

1. A system, comprising:
one or more computing devices configured to:
receive, at an access subsystem node of a distributed multi-tenant storage service, a connection request from a load balancer node on behalf of a particular client of the file storage service, wherein the connection request includes an attempt count parameter indicative of a number of times the load balancer node has attempted to establish a connection on behalf of the particular client;
identify one or more workload threshold levels to be used for an acceptance decision for the connection request, wherein a particular workload threshold level of the one or more workload threshold levels is based at least in part on the attempt count parameter;
in response to a determination that a local workload metric of the access subsystem node is below the particular workload threshold level,
provide an indication of acceptance of the connection to the load balancer node from the access subsystem node;
receive a particular network packet indicative of a storage service request at the load balancer node from the particular client;
transmit a representation of the particular network packet from the load balancer node to a local load balancing module at the access subsystem node; and
transmit an indication of the storage service request from the access subsystem node to one or more other subsystems of the storage service.

2. The system as recited in claim 1 , wherein the one or more workload threshold levels include a first workload threshold level lower than a second workload threshold level, wherein the first workload threshold level is associated with a lower attempt count parameter value than the second workload threshold level.

3. The system as recited in claim 1 , wherein the one or more computing devices are further configured to:
designate, for each resource of a plurality of resources associated with the access subsystem node, a respective workload threshold level to be used for the acceptance decision for a particular attempt count parameter value.

4. The system as recited in claim 3 , wherein a particular resource of the plurality of resources includes one of: (a) a processor, (b) a network, (c) a memory, (d) a storage device, (e) a logical resource represented by a data structure within an operating system.

5. The system as recited in claim 1 , wherein the storage service comprises a plurality of access subsystem nodes, wherein the one or more computing devices are further configured to:
select the access subsystem node from among the plurality of access subsystem nodes based on a random selection policy.

6. A method, comprising:
performing, by one or more computing devices:
receiving, at an access subsystem node of a storage service, a connection request from a load balancer node on behalf of a particular client of a storage service, wherein the connection request includes an attempt count parameter indicative of a number of times the load balancer node has attempted to establish a connection on behalf of the particular client;
identifying a particular workload threshold level to be used for an acceptance decision for the connection request, wherein the particular workload threshold level is based at least in part on the attempt count parameter;
in response to determining that a local workload metric of the access subsystem node is below the particular workload threshold level,
providing an indication of acceptance of the connection to the load balancer node from the access subsystem node;
receiving a representation of a particular network packet, indicative of a storage service request of the client, at the access subsystem node from the load balancer node; and
transmitting an indication of the storage service request from the access subsystem node to one or more other subsystems of the storage service.

7. The method as recited in claim 6 , further comprising performing, by the one or more computing devices:
designating, corresponding to a particular resource associated with the access subsystem node, a plurality of workload threshold levels for connection acceptance decisions at the access subsystem node, wherein each workload threshold level of the plurality of workload threshold levels is associated with a respective attempt count parameter range.

8. The method as recited in claim 7 , wherein the plurality of workload threshold levels includes a first workload threshold level lower than a second workload threshold level, wherein the first workload threshold level is associated with a lower attempt count parameter value than the second workload threshold level.

9. The method as recited in claim 7 , wherein the plurality of workload threshold levels includes a first workload threshold level lower than a second workload threshold level, wherein the first workload threshold level is associated with a higher attempt count parameter value than the second workload threshold level.

10. The method as recited in claim 6 , further comprising performing, by the one or more computing devices:
determining, for each resource of a plurality of resources associated with the access subsystem node, a respective workload threshold level to be used for the acceptance decision for a particular attempt count parameter value.

11. The method as recited in claim 10 , wherein a particular resource of the plurality of resources includes one of: (a) a processor, (b) a network, (c) a memory, (d) a storage device, (e) a logical resource represented by a data structure within an operating system.

12. The method as recited in claim 6 , further comprising performing, by the one or more computing devices:
computing the local metric for a particular point in time based at least in part on a decay function applied to a value of the local metric computed at an earlier point in time.

13. The method as recited in claim 6 , wherein the storage service comprises a plurality of access subsystem nodes, further comprising:
selecting, by the load balancer node, the access subsystem node from among the plurality of access subsystem nodes based on a random selection policy.

14. The method as recited in claim 6 , wherein the access subsystem node is configured to accept service requests in accordance with an industry-standard file system interface.

15. The method as recited in claim 6 , further comprising performing, by the one or more computing devices:
generating said connection request at the load balancer node in response to receiving, at the load balancer node, a request from the particular client to mount a file system.

16. The method as recited in claim 6 , further comprising performing, by the one or more computing devices:
initiating, from the access subsystem node, a termination of a different connection in response to a determination that a re-balancing criterion has been met.

17. A non-transitory computer-accessible storage medium storing program instructions that when executed on one or more processors:
receive, at an access subsystem node of a distributed service, a connection request on behalf of a particular client of the distributed service, wherein the connection request includes an attempt count parameter indicative of a number of times an establishment of a connection on behalf of the particular client has been attempted;
identify a particular workload threshold level to be used for an acceptance decision for the connection request, wherein the particular workload threshold level is based at least in part on the attempt count parameter;
in response to a determination that a local w

Assignees

• Amazon Tech Inc

Inventors

• Vincent Pradeep
• Oikarinen Matti Juhani
• Laurence Douglas Stewart
• Frigo Matteo

Classifications

• H04L67/1097

  for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS] · CPC title

• H04L67/1008 Primary

  based on parameters of servers, e.g. available memory or workload (monitoring of computer activity G06F11/30) · CPC title

• H04L47/70 Primary

  Admission control; Resource allocation · CPC title

• H04L67/1002

  Electricity · mapped topic

• H04L67/1001

  for accessing one among a plurality of replicated servers · CPC title