Resource utilization efficiency based job scheduling

Patent metadata

Field	Value
Publication number	US-2023289231-A1
Application number	US-202217654425-A
Country	US
Kind code	A1
Filing date	Mar 11, 2022
Priority date	Mar 11, 2022
Publication date	Sep 14, 2023
Grant date	—

Abstract

Computer-implemented methods, systems and computer program products for job scheduling in a computing system are provided. The computing resources of the computing system is allocated to one or more users of the computing system using a predefined policy. The method comprises receiving, by a job scheduler associated with the computing system one or more resource utilization scores of the one or more users, each of the one or more resource utilization scores indicating resource utilization efficiency over time at a job level for the one or more users. The method comprises receiving, by the job scheduler, one or more jobs submitted by the one or more users. The method further comprises scheduling, by the job scheduler, the received one or more jobs based on the predefined policy and further on the received one or more resource utilization scores of the one or more users.

First claim

What is claimed is:

1 . A computer-implemented method for job scheduling in a computing system, wherein computing resources of the computing system is allocated to one or more users of the computing system using a predefined policy, the method comprising:
receiving, by a job scheduler of the computing system, one or more resource utilization scores of the one or more users, each of the one or more resource utilization scores indicating resource utilization efficiency over time at a job level for the one or more users; receiving, by the job scheduler, one or more jobs submitted by the one or more users; and scheduling, by the job scheduler, the received one or more jobs based on the predefined policy and further on the received one or more resource utilization scores of the one or more users.

2 . The computer-implemented method of claim 1 , wherein the one or more resource utilization scores of the one or more users are calculated based on respective resource utilization efficiencies of successfully completed jobs of the one or more users.

3 . The computer-implemented method of claim 2 , wherein the respective resource utilization efficiencies of successfully completed jobs of the one or more users are calculated based on collected metadata for the successfully completed jobs including job run time and corresponding resource allocation information.

4 . The computer-implemented method of claim 2 , wherein the one or more resource utilization scores of the one or more users are calculated further based on respective attenuations over time.

5 . The computer-implemented method of claim 2 , further comprising:
assigning a resource utilization efficiency to a job in response to the job failing, or the job failing to run for corresponding assigned resource(s).

6 . The computer-implemented method of claim 1 , wherein the scheduling of the received one or more jobs comprises:
allocating, by the job scheduler, resources for the received one or more jobs further based on the received one or more resource utilization scores of the one or more users to avoid over-allocation or starvation.

7 . The computer-implemented method of claim 6 , wherein the scheduling of the received one or more jobs comprises:
adjusting, by the job scheduler, the predefined policy with the received one or more resource utilization scores.

8 . A job scheduler for job scheduling in a computing system, wherein computing resources of the computing system is allocated to one or more users of the computing system using a predefined policy, the job scheduler comprising:
program instructions, when executed by one or more processing units in the computing system, causing the one or more processing units to:
receive one or more resource utilization scores of the one or more users, each of the one or more resource utilization scores indicating resource utilization efficiency over time at a job level for the one or more users;
receive one or more jobs submitted by the one or more users; and
schedule the received one or more jobs based on the predefined policy and further on the received one or more resource utilization scores of the one or more users.

9 . The job scheduler of claim 8 , wherein the one or more resource utilization scores of the one or more users are calculated based on respective resource utilization efficiencies of successfully completed jobs of the one or more users.

10 . The job scheduler of claim 9 , wherein the respective resource utilization efficiencies of successfully completed jobs of the one or more users are calculated based on collected metadata for the successfully completed jobs including job run time and corresponding resource allocation information.

11 . The job scheduler of claim 9 , wherein the one or more resource utilization scores of the one or more users are calculated further based on respective attenuations over time.

12 . The job scheduler of claim 9 , further comprising:
assigning a resource utilization efficiency to a job in response to the job failing, or the job failing to run for corresponding assigned resource(s).

13 . The job scheduler of claim 8 , wherein the scheduling of the received one or more jobs comprises:
allocating resources for the received one or more jobs further based on the received one or more resource utilization scores of the one or more users to avoid over-allocation or starvation.

14 . The job scheduler of claim 13 , wherein the scheduling of the received one or more jobs comprises:
adjusting the predefined policy with the received one or more resource utilization scores.

15 . A computer program product for job scheduling in a computing system, wherein computing resources of the computing system is allocated to one or more users of the computing system using a predefined policy, the computer program product comprising a non-transitory computer readable storage having program instructions embodied therewith and the program instructions comprising:
program codes configured to receive, by a job scheduler of the computing system one or more resource utilization scores of the one or more users, each of the one or more resource utilization scores indicating resource utilization efficiency over time at a job level for the one or more users; program codes configured to receive, by the job scheduler, one or more jobs submitted by the one or more users; and program codes configured to schedule, by the job scheduler, the received one or more jobs based on the predefined policy and further on the received one or more resource utilization scores of the one or more users.

16 . The computer program product of claim 15 , wherein the one or more resource utilization scores of the one or more users are calculated based on respective resource utilization efficiencies of successfully completed jobs of the one or more users.

17 . The computer program product of claim 16 , wherein the respective resource utilization efficiencies of successfully completed jobs of the one or more users are calculated based on collected metadata for the successfully completed jobs including job run time and corresponding resource allocation information.

18 . The computer program product of claim 16 , wherein the one or more resource utilization scores of the one or more users are calculated further based on respective attenuations over time.

19 . The computer program product of claim 16 , further comprising:
assigning a resource utilization efficiency to a job in response to the job failing, or the job failing to run for corresponding assigned resource(s).

20 . The computer program product of claim 15 , wherein the program instructions comprising:
program codes configured to allocate resources for the received one or more jobs further based on the received one or more resource utilization scores of the one or more users to avoid over-allocation or starvation.

Assignees

• IBM

Inventors

• Wang Xiao Dong
• Fang Pei Ci
• Zheng Xiao Ping
• Liao Jia Bin

Classifications

• G06F9/5038 Primary

  considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration (scheduling strategies G06F9/4881 and subgroups) · CPC title

• G06F9/5077

  Logical partitioning of resources; Management or configuration of virtualized resources (specific details on emulation or internal functioning of virtual machines G06F9/455) · CPC title

• G06F2209/501

  Performance criteria · CPC title

• G06F11/3409 Primary

  for performance assessment · CPC title

• G06F2209/508

  Monitor · CPC title