Adaptive service timeouts

Patent metadata

Field	Value
Publication number	US-2016205010-A1
Application number	US-201615075898-A
Country	US
Kind code	A1
Filing date	Mar 21, 2016
Priority date	Sep 18, 2012
Publication date	Jul 14, 2016
Grant date	—

Abstract

Disclosed are various embodiments for a timeout management application. Latency data for executing services is obtained. The used service capacity is calculated. If the service capacity is outside of a predefined range, the timeout of a selected service is reconfigured.

First claim

1 - 3 . (canceled)

4 . A system, comprising:
at least one computing device configured to at least:
monitor a plurality of latencies, individual ones of the plurality of latencies corresponding to one of a plurality of services; and
set a timeout associated with a pair of the plurality of services based at least in part on the plurality of latencies, the timeout defining a maximum time to complete a call to a first service of the pair of the plurality of services when called by a second service of the pair of the plurality of services.

5 . The system of claim 4 , wherein the at least one computing device is further configured to at least calculate an aggregate latency relative to a time interval based at least in part on the plurality of latencies, and the timeout is further based at least in part on the aggregate latency.

6 . The system of claim 4 , wherein the timeout is further based at least in part on an amount of used service capacity.

7 . The system of claim 6 , wherein the timeout is increased in response to the amount of used service capacity relative to a total service capacity falling below a threshold.

8 . The system of claim 6 , wherein the timeout is decreased in response to the amount of used service capacity relative to a total service capacity exceeding a threshold.

9 . The system of claim 6 , wherein the at least one computing device is further configured to at least select the first service of the pair of the plurality of services based at least in part on a subset of the amount of used system resources used by the selected service.

10 . The system of claim 4 , wherein the at least one computing device is further configured to at least select the first service of the pair of the plurality of services based at least in part on a service priority list, and the timeout is associated with the selected one of the services.

11 . The system of claim 4 , wherein the at least one computing device is further configured to at least select the first service of the pair of the plurality of services based at least in part on a reliability threshold.

12 . The system of claim 4 , wherein monitoring the plurality of latencies further comprises obtaining log data from the services.

13 . A method, comprising:
monitoring, by at least one computing device, a plurality of latencies, individual ones of the plurality of latencies corresponding to one of a plurality of services; and setting, by the at least one computing device, a timeout associated with a pair of the plurality of services based at least in part on the plurality of latencies, the timeout defining a maximum time to complete a call to a first service of the pair of the plurality of services when called by a second service of the pair of the plurality of services.

14 . The method of claim 13 , further comprising calculating, by the at least one computing device, an aggregate latency relative to a time interval based at least in part on the plurality of latencies, and the timeout is further based at least in part on the aggregate latency.

15 . The method of claim 13 , wherein the timeout is further based at least in part on an amount of used service capacity.

16 . The method of claim 15 , wherein the timeout is increased in response to the amount of used service capacity relative to a total service capacity falling below a threshold.

17 . The method of claim 15 , wherein the timeout is decreased in response to the amount of used service capacity relative to a total service capacity exceeding a threshold.

18 . The method of claim 15 , further comprising selecting, by the at least one computing device, the first service of the pair of the plurality of services based at least in part on a subset of the amount of used system resources used by the selected service.

19 . The method of claim 13 , further comprising selecting, by the at least one computing device, the first service of the pair of the plurality of services based at least in part on a service priority list, and the timeout is associated with the selected one of the services.

20 . The method of claim 13 , further comprising selecting, by the at least one computing device, the first service of the pair of the plurality of services based at least in part on a reliability threshold.

21 . A non-transitory computer-readable medium embodying a program executable in at least one computing device, the program, when executed, causing the at least one computing device to at least:
obtain information from at least a first service and a second service, the information indicating at least latency data associated with processing requests and current capacity of the first and second service; determine, for a time interval, time out values for the first and second service based at least in part on the obtained information; and send, for the time interval, the time out values to the first and second service, wherein the first and second service are configured to adjust respective time out values for connections based at least in part on the time out values.

22 . The non-transitory computer-readable medium of claim 21 , wherein the program further causes the at least one computing device to select the first service or the second service based at least in part on a reliability threshold.

23 . The non-transitory computer-readable medium of claim 21 , wherein the timeout values are based at least in part on an amount of used service capacity.

Assignees

• Amazon Tech Inc

Inventors

• Kraev Kaloyan K

Classifications

• G06F9/5022 Primary

  Mechanisms to release resources · CPC title

• H04L43/16 Primary

  Threshold monitoring · CPC title

• H04L43/024

  by adaptive sampling · CPC title

• H04L43/106

  using time related information in packets, e.g. by adding timestamps · CPC title

• G06F1/14 Primary

  Time supervision arrangements, e.g. real time clock · CPC title