Estimating resource requests for workloads to offload to host systems in a computing environment

Patent metadata

Field	Value
Publication number	US-10956221-B2
Application number	US-201816199850-A
Country	US
Kind code	B2
Filing date	Nov 26, 2018
Priority date	Nov 26, 2018
Publication date	Mar 23, 2021
Grant date	Mar 23, 2021

Abstract

Provided are a computer program product, system, and method for estimating resource requests for workloads to offload to host systems in a computing environment. A calculation is made required resources of computational resources required to complete processing a plurality of unfinished workloads that have not completed. A determination is made of allocated resources that are not yet provisioned to workloads. The required resources are reduced by the allocated resources not yet provisioned to determine resources to provision. The resources to provision for the unfinished workloads are requested.

First claim

What is claimed is:

1. A computer program product for allocating computing resources to workloads, wherein the computer program product comprises a computer-readable storage medium having computer readable program instructions executed by a processor to perform operations, the operations comprising:
calculating required resources of computational resources required to complete processing a plurality of unfinished workloads comprising workloads having a status indicating not completed;
determining allocated resources that are not yet provisioned to workloads;
reducing the required resources by the allocated resources not yet provisioned to determine resources to provision; and
requesting the resources to provision for the unfinished workloads to offload the unfinished workloads to the requested resources to provision.

2. The computer program product of claim 1 , wherein the unfinished workloads execute in a cluster comprising a local computing system and an allocatable computing system accessible to the local computing system, wherein the requesting the resources to provision comprises:
submitting a request to a resource service, providing resources in the allocatable computing system, for the resources to provision in the allocatable computing system.

3. The computer program product of claim 2 , wherein the allocatable computing system and the resource service are accessible to the local computing system over a network.

4. The computer program product of claim 2 , wherein the operations further comprise:
determining unfinished workloads in the cluster that are eligible to execute with resources in the allocatable computing system, wherein the unfinished workloads for which required resources are calculated comprise the unfinished workloads in the cluster that are determined to be eligible to execute in the allocatable computing system.

5. The computer program product of claim 4 , wherein the operations further comprise:
determining workloads that have been waiting for more than a threshold duration, all waiting workloads, and all waiting and running workloads in a waiting state for more than a wait duration threshold, wherein the determined workloads are eligible to execute with resources in the allocatable computing system.

6. The computer program product of claim 1 , wherein the unfinished workloads for which required resources are calculated have at least one workload state of workload states comprising waiting for processing, running, and waiting for processing more than a specified amount of time.

7. The computer program product of claim 1 , wherein the calculating the required resources for a specific unfinished workload that is included in the calculated required resources for the unfinished workloads comprises:
determining a timing multiplier as a function of an average completion duration for completed workloads and a maximum bound on a processing duration for the specific unfinished workload; and
multiplying the timing multiplier by average consumed resources comprising average resources consumed by a workload to determine required resources for the specific unfinished workload.

8. The computer program product of claim 7 , wherein the average completion duration and the average consumed resources are maintained for each workload class of a plurality of workload classes assigned to a cluster, wherein each workload class has similar processing behaviors, wherein the calculated required resources are provisioned to the cluster to be available for all workload classes executing in the cluster.

9. The computer program product of claim 7 , wherein the function for determining the timing multiplier comprises dividing the average completion duration by a divisor comprising the maximum bound on the processing duration for the specific unfinished workload.

10. The computer program product of claim 1 , wherein the calculating the required resources for a specific unfinished workload that is waiting to be processed and that is included in the calculated required resources for the unfinished workloads comprises:
determining a timing multiplier by dividing an average completion duration for completed workloads by a divisor including a requested completion duration for the specific unfinished workload minus a wait duration the specific unfinished workload has been waiting to be processed since being submitted for processing; and
multiplying the timing multiplier by average consumed resources comprising average resources consumed by workloads to determine the required resources for the specific unfinished workload.

11. The computer program product of claim 10 , wherein the divisor is further reduced by an estimated provisioning duration to provision resources from a host system.

12. The computer program product of claim 1 , wherein the calculating the required resources for a specific unfinished workload that is currently running and that is included in the calculated required resources for the unfinished workloads comprises:
determining a timing multiplier by dividing an average completion duration for completed workloads by a divisor including a requested completion duration for the specific unfinished workload; and
multiplying the timing multiplier by average consumed resources comprising average resources consumed by workloads to determine the required resources for the specific unfinished workload.

13. The computer program product of claim 12 , wherein the divisor is further reduced by an estimated provisioning duration to provision resources to the unfinished workloads from the requested completion duration for the specific unfinished workload.

14. The computer program product of claim 12 , wherein the operations further comprise:
subtracting resources currently allocated to the specific unfinished workload from a result of the multiplying to determine the required resources for the specific unfinished workload.

15. A system in communication with a service provider, comprising:
a processor; and
a computer-readable storage medium having computer readable program instructions executed by the processor to perform operations, the operations comprising:
calculating required resources of computational resources required to complete processing a plurality of unfinished workloads comprising workloads having a status indicating not completed;
determining allocated resources that are not yet provisioned to workloads;
reducing the required resources by the allocated resources not yet provisioned to determine resources to provision; and
requesting, from the service provider, the resources to provision for the unfinished workloads to offload the unfinished workloads to the requested resources to provision.

16. The system of claim 15 , further in communication with a cluster comprising a local computing system and an allocatable computing system, managed by the service provider, accessible to the local computing system, wherein the unfinished workloads execute in the cluster, and wherein the requesting the resources to provision comprises:
submitting a request to a resource service, providing resources in the allocatable computing system, for the resources to provision in the allocatable computing system.

17. The system of claim 16 , wherein the operations further comprise:
determining unfinished workloads in the cluster that are eligible to execute with resources in the allocatable computing system, wherein the unfinished workloads for which required resources are calculated comprise the unfinished workloads in the cluster that are determined to be eligible to execu

Assignees

• IBM

Inventors

• Aronovich Lior
• Unnikrishnan Priya

Classifications

• G06Q10/06315

  Needs-based resource requirements planning or analysis · CPC title

• G06F2209/509

  Offload · CPC title

• G06F9/505 Primary

  considering the load · CPC title

• G06F9/5038

  considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration (scheduling strategies G06F9/4881 and subgroups) · CPC title

• G06F2209/505

  Clust · CPC title