Systems and methods for autoscaling instance groups of computing platforms

Patent metadata

Field	Value
Publication number	US-11340947-B2
Application number	US-201916398435-A
Country	US
Kind code	B2
Filing date	Apr 30, 2019
Priority date	Dec 11, 2018
Publication date	May 24, 2022
Grant date	May 24, 2022

Abstract

System and method for terminating instances and autoscaling instance groups of computing platforms. For example, a method includes determining whether an instance of an instance group is identified as eligible for termination. The method further includes, in response to determining that the instance of the instance group is identified as eligible for termination, terminating the eligible instance. The terminating the eligible instance includes, in response to a runtime of the eligible instance being equal to or larger than a predetermined maximum lifetime, terminating the eligible instance. The terminating the eligible instance further includes, in response to the runtime being smaller than the predetermined maximum lifetime, detaching the eligible instance from the instance group to allow a new instance to be associated with the instance group, and in response to the eligible instance being detached from the instance group: waiting for the new instance to be associated with the instance group, and evicting each pod associated with the detached instance. The method is performed using one or more processors.

First claim

What is claimed is:

1. A computer-implemented system for scaling up an instance group of a computing platform, the system comprising:
one or more processors; and
a memory storing instructions, the instructions, when executed by the one or more processors, causing the system to perform:
receiving a request to schedule one or more schedulable pods on instances associated with an instance group of a computing platform, the one or more schedulable pods configured to run on the instances;
determining a first sum equal to demanded resources to be used by the one or more schedulable pods plus scheduled resources used by the instance group, wherein the demanded resources comprise resources required by the one or more schedulable pods to be scheduled on instances associated with instance group and the scheduled resources of the instance group comprise a sum of all resources already allocated to one or more pods associated with each instance of the instance group;
determining a number of new instances associated with the instance group based at least in part on the first sum;
evaluating an average utilization percentage of the instance group to determine whether to scale up a number of instances for the instance group, wherein the average utilization percentage is equal to the first sum divided by a second sum equal to allocatable resources of the instance group plus allocatable resources of the new instances; and
in response to the average utilization percentage being larger than a predetermined scale-up threshold, increasing a desired instance number associated with the instance group by the determined number of new instances.

2. The system of claim 1 wherein the memory stores the instructions, the instructions, when executed by the one or more processors, causing the system to further perform:
in response to the desired instance number exceeding a predetermined maximum instance number associated with the instance group, changing the desired instance number to the predetermined maximum instance number.

3. The system of claim 1 wherein the average utilization percentage is equal to an average of a utilization percentage for each instance associated with the instance group.

4. The system of claim 1 wherein the determining a number of new instances associated with the instance group includes bin packing the one or more schedulable pods into the instances associated with the instance group.

5. The system of claim 4 wherein the memory stores the instructions, the instructions, when executed by the one or more processors, causing the system to further perform:
in response to not being able to schedule the one or more schedulable pods on existing instances associated with the instance group by bin packing the one or more schedulable pods into the existing instances, increasing the number of new instances.

6. The system of claim 4 wherein the memory stores the instructions, the instructions, when executed by the one or more processors, causing the system to further perform:
in response to being able to schedule the one or more schedulable pods on unschedulable instances associated with the instance group by bin packing the one or more schedulable pods into the unschedulable instances, not increasing the number of new instances.

7. The system of claim 6 wherein the memory stores the instructions, the instructions, when executed by the one or more processors, causing the system to further perform:
in response to being able to schedule the one or more schedulable pods on the unschedulable instances, preferably scheduling the one or more schedulable pods on younger instances of the unschedulable instances.

8. The system of claim 7 wherein a first instance is younger than a second instance if a runtime of the first instance is shorter than a runtime of the second instance.

9. The system of claim 1 wherein the increasing a desired instance number associated with the instance group by the determined number of new instances includes increasing the desired instance number in response to a duration for which the request to schedule the one or more schedulable pods is pending exceeding a maximum pending threshold.

Assignees

• Palantir Technologies Inc

Inventors

• Abdelsalam Mahmoud
• Mcnamara Ryan
• Jain Ashray
• Dearment Greg
• Ma Jason
• Xu Guodong
• Lakshmanan Vivek

Classifications

• G06F9/5077

  Logical partitioning of resources; Management or configuration of virtualized resources (specific details on emulation or internal functioning of virtual machines G06F9/455) · CPC title

• G06F9/5072

  Grid computing · CPC title

• G06F9/5061 Primary

  Partitioning or combining of resources · CPC title

• G06F8/65

  Updates (security arrangements therefor G06F21/57) · CPC title

• G06F9/5027 Primary

  the resource being a machine, e.g. CPUs, Servers, Terminals · CPC title