Light weight workload management server integration

Patent metadata

Field	Value
Publication number	US-9262210-B2
Application number	US-201213538854-A
Country	US
Kind code	B2
Filing date	Jun 29, 2012
Priority date	Jun 29, 2012
Publication date	Feb 16, 2016
Grant date	Feb 16, 2016

Abstract

A method, computer program product and system for workload management for an Extract, Transform, and Load (ETL) system. A priority of each workload in a set of workloads is determined using a priority rule. In response to determining that the priority of a workload to be checked has a highest priority, it is indicated that the workload has the highest priority. It is determined whether at least one logical resource representing an ETL metric is available for executing the workload. In response to determining that the workload has the highest priority and that the at least one logical resource is available, it is determined that the workload is runnable.

First claim

The invention claimed is:

1. A method for workload management for an Extract, Transform, and Load (ETL) system, comprising:
determining a priority of each workload in multiple queues using a priority rule and giving a higher priority to a first workload type over a second workload type, wherein each of the multiple queues is associated with a resource policy;
forming a set of workloads by selecting a first workload from each of the multiple queues;
selecting a workload from the set of workloads that has a highest priority;
identifying the resource policy associated with a queue from the multiple queues that had stored the workload;
identifying an ETL metric at a system level, the ETL metric at a queue level, and at least one physical resource using the identified resource policy; and
in response to determining that the workload has the highest priority, that the ETL metric at the system level and the ETL metric at the queue level have been met, and that the at least one physical resource is available, determining that the workload is runnable.

2. The method of claim 1 , further comprising:
determining workload execution order based on user-specified scheduling using a submit workload command followed by a check workload command.

3. The method of claim 1 , further comprising:
determining workload execution order based on user-specified scheduling using a begin workload command.

4. The method of claim 1 , further comprising:
defining how another ETL metric is to be shared among workloads.

5. The method of claim 1 , wherein the resource policy has a two-level hierarchical representation that defines the ETL metric at the system level, the ETL metric at the queue level, and the at least one physical resource and how the at least one physical resource is distributed among different queues of the multiple queues, wherein the different queues share the resource policy and have different resource distributions.

6. The method of claim 1 , wherein the priority rule is selected from a group comprising: an elapsed time rule, a priority weight rule, and a workload run ratio rule.

7. The method of claim 1 , further comprising:
providing an asynchronous queuing mechanism.

8. The method of claim 1 , wherein Software as a Service (SaaS) is configured to perform the method operations.

9. A computer system for workload management for an Extract, Transform, and Load (ETL) system, comprising:
a processor; and
a storage device connected to the processor, wherein the storage device has stored thereon a program, and wherein the processor is configured to execute instructions of the program to perform operations, wherein the operations comprise:
determining a priority of each workload in multiple queues using a priority rule and giving a higher priority to a first workload type over a second workload type, wherein each of the multiple queues is associated with a resource policy;
forming a set of workloads by selecting a first workload from each of the multiple queues;
selecting a workload from the set of workloads that has a highest priority;
identifying the resource policy associated with a queue from the multiple queues that had stored the workloads;
identifying an ETL metric at a system level, the ETL metric at a queue level, and at least one physical resource using the identified resource policy; and
in response to determining that the workload has the highest priority, that the ETL metric at the system level and the ETL metric at the queue level have been met, and that the at least one physical resource is available, determining that the workload is runnable.

10. The computer system of claim 9 , wherein the operations further comprise:
determining workload execution order based on user-specified scheduling using a submit workload command followed by a check workload command.

11. The computer system of claim 9 , wherein the operations further comprise:
determining workload execution order based on user-specified scheduling using a begin workload command.

12. The computer system of claim 9 , wherein the operations further comprise:
defining how another ETL metric is to be shared among workloads.

13. The computer system of claim 9 , wherein the resource policy has a two-level hierarchical representation that defines the ETL metric at the system level, the ETL metric at the queue level, and the at least one physical resource and how the at least one physical resource is distributed among different queues of the multiple queues, wherein the different queues share the resource policy and have different resource distributions.

14. The computer system of claim 9 , wherein the priority rule is selected from a group comprising: an elapsed time rule, a priority weight rule, and a workload run ratio rule.

15. The computer system of claim 9 , wherein the operations further comprise:
providing an asynchronous queuing mechanism.

16. The computer system of claim 9 , wherein software is provided as a service in a cloud environment.

17. A computer program product for workload management for an Extract, Transform, and Load (ETL) system, the computer program product comprising:
a non-transitory computer readable storage medium having computer readable program code embodied therewith, wherein the computer readable program code, when executed by a processor of a computer, is configured to perform:
determining a priority of each workload in multiple queues using a priority rule and giving a higher priority to a first workload type over a second workload type, wherein each of the multiple queues is associated with a resource policy;
forming a set of workloads by selecting a first workload from each of the multiple queues;
selecting a workload from the set of workloads that has a highest priority;
identifying the resource policy associated with a queue from the multiple queues that had stored the workload;
identifying an ETL metric at a system level, the ETL metric at a queue level, and at least one physical resource using the identified resource policy; and
in response to determining that the workload has the highest priority, that the ETL metric at the system level and the ETL metric at the queue level have been met, and that the at least one physical resource is available, determining that the workload is runnable.

18. The computer program product of claim 17 , wherein the computer readable program code, when executed by a processor of a computer, is configured to perform:
determining workload execution order based on user-specified scheduling using a submit workload command followed by a check workload command.

19. The computer program product of claim 17 , wherein the computer readable program code, when executed by a processor of a computer, is configured to perform:
determining workload execution order based on user-specified scheduling using a begin workload command.

20. The computer program product of claim 17 , wherein the computer readable program code, when executed by a processor of a computer, is configured to perform:
defining how another ETL metric is to be shared among workloads.

21. The computer program product of claim 17 , wherein the resource policy has a two-level hierarchical representation that defines the ETL metric at the system level, the ETL metric at the queue level, and the at least one physical resource and how the at least one physical resource is distributed among different queues of the multiple queues, wherein the different queues share the resource policy

Assignees

• Caufield Brian K
• Li Yong
• Pu Xiaoyan
• IBM

Inventors

• Caufield Brian K
• Li Yong
• Pu Xiaoyan

Classifications

• G06F9/4843 Primary

  by program, e.g. task dispatcher, supervisor, operating system · CPC title

• G06F2209/503

  Resource availability · CPC title

• G06F9/505

  considering the load · CPC title