Customer resource monitoring for versatile scaling service scaling policy recommendations

Patent metadata

Field	Value
Publication number	US-10409642-B1
Application number	US-201615359535-A
Country	US
Kind code	B1
Filing date	Nov 22, 2016
Priority date	Nov 22, 2016
Publication date	Sep 10, 2019
Grant date	Sep 10, 2019

Abstract

A notification for an application stack is received, where the application stack includes a plurality of resource types. At least one policy associated with the notification is obtained, with the first policy being a policy for scaling a first resource of a first resource type and a second resource of a second resource type of the application stack. A first capacity for the first resource and a second capacity for the second resource is determined based at least in part on the at least one policy. The first resource and the second resource are caused to be scaled according to the first capacity and the second capacity respectively.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
determining, for an application stack comprising a first resource type and a second resource type, a utilization pattern between utilization of a first resource of the first resource type and utilization of a second resource of the second resource type, the second resource type different from the first resource type, the utilization pattern associated with at least historical data for an application stack such that the historical data of a particular age is weighted relative to a time interval;
determining first criteria and second criteria based at least in part on the utilization pattern;
setting at least one alarm to trigger in response to a first usage level fulfilling the first criteria, the at least one alarm associated with a first scaling policy and a second scaling policy, where the first scaling policy includes scaling information for the first resource type and the scaling information is linked to a second scaling information for the second resource type;
receiving at least one alarm notification indicating that the at least one alarm has been triggered;
obtaining the first scaling policy and the second scaling policy;
computing a first new capacity based at least in part on the first scaling policy and a second new capacity based at least in part on the second scaling policy; and
causing a resource of the first resource type to scale in accordance with the first new capacity and a resource of the second resource type to scale in accordance with the second new capacity.

2. The computer-implemented method of claim 1 , wherein determining the utilization pattern includes determining that a change in demand for a resource of the first resource type affects the utilization associated with the second resource type.

3. The computer-implemented method of claim 1 , wherein:
the method further comprises receiving a selection of a tracking metric and a desired range for the tracking metric; and
the first criteria and the second criteria are further determined based at least in part on the tracking metric and the desired range.

4. The computer-implemented method of claim 1 , wherein the first criteria includes:
an alarm threshold for determining that the at least one alarm has been triggered; and
criteria for determining how much to scale a resource of the first resource type.

5. The computer-implemented method of claim 1 , wherein:
the method further comprises selecting for a scaling plan, the scaling plan being a member of a plurality of scaling plans; and
the first criteria and the second criteria are determined based at least in part on the scaling plan selected.

6. A system, comprising:
one or more processors; and
memory including instructions that, as a result of execution by the one or more processors, cause the system to:
determine a first criteria for a first resource type of an application stack and a second criteria for a second resource type of the application stack, the application stack including a plurality of resource types, wherein at least the first resource type is different from a second resource type;
receive at least one notification when at least one of the first criteria and the second criteria are met for an application stack;
obtain at least one policy associated with the at least one notification, the at least one policy being a policy for scaling a first resource of the first resource type in relation to a second resource of the second resource type, the at least one policy including scaling information for the first resource type and the scaling information is linked to a second scaling information for the second resource type, wherein scaling of the first resource and the second resource is weighted by historical data of utilization of the first resource and the second resource such that more recent utilization is weighted more than less recent utilization;
determine, based at least in part on the at least one policy, a first capacity for the first resource and a second capacity for the second resource;
cause the first resource to be scaled according to the first capacity; and
cause the second resource to be scaled according to the second capacity.

7. The system of claim 6 , wherein the instructions further cause the system to determine a relationship between a usage level of the first resource corresponding to at least a usage level of the second resource in the application stack.

8. The system of claim 6 , wherein the instructions further cause the system to determine the first capacity further based at least in part on a current capacity of the first resource in the application stack.

9. The system of claim 6 , wherein the plurality of resource types include at least two of:
an in-memory cache,
a relational database,
a non-relational database, or
a group of virtual machines.

10. The system of claim 6 , wherein the instructions further cause the system to:
receive a selection that indicates an alarm threshold value; and
configure an alarm to trigger as a result of usage measurement data reaching a value relative to the alarm threshold value; and
the at least one notification is received as a result of the alarm being triggered.

11. The system of claim 10 , wherein the instructions include further instructions that cause the system to:
determine, based at least in part on an analysis of historical usage data of the application stack, a recommended alarm threshold value for the first resource type; and
provide the recommended alarm threshold value for selection in a user interface.

12. The system of claim 6 , wherein the instructions include further instructions that cause the system to:
determine, based at least in part on historical usage data, a utilization pattern of resources of the first resource type;
determine, based at least in part on the utilization pattern, a future time to invoke the at least one policy; and
schedule the at least one notification to be sent at the future time; and
the instructions that cause the computer system to receive the at least one notification include instructions that cause the computer system to receive the at least one notification as a result of the at least one notification being scheduled.

13. The instructions of claim 12 , wherein:
the utilization pattern indicates a likelihood of resource utilization of the first resource type to be at a certain level during a particular time period; and
the future time is a time determined for preemptively scaling one or more resources of the first resource type prior to the particular time period.

14. A non-transitory computer-readable storage medium comprising executable instructions that, as a result of being executed by one or more processors of a computer system, cause the computer system to at least:
determine, for an application using a first resource type and a second resource type, a utilization pattern between historical utilization of the first resource type and historical utilization of the second resource type, the first resource type and the second resource type being of different types, the utilization pattern giving more weight to more recent utilization of the first resource type and utilization of the second resource type and less weight to less recent utilizations;
determine, based at least in part on the utilization pattern, first criteria for the first resource type and second criteria for the second resource type;
receive at least one notification indicating that criteria for determining whether to scale a first resource of the first resource type and a second resource of the second reso

Assignees

• Amazon Tech Inc

Inventors

• Tang Kai Fan
• Khalid Ahmed Usman

Classifications

• G06F9/5005 Primary

  to service a request · CPC title

• G06F9/5061 Primary

  Partitioning or combining of resources · CPC title