Job scheduling and monitoring in a distributed computing environment

Patent metadata

Field	Value
Publication number	US-9684546-B2
Application number	US-201414572745-A
Country	US
Kind code	B2
Filing date	Dec 16, 2014
Priority date	Dec 16, 2014
Publication date	Jun 20, 2017
Grant date	Jun 20, 2017

Abstract

A view of data transformation jobs can be presented by way of a user interface. Related jobs can subsequently be identified automatically after a job is selected based on data dependencies between jobs. Execution status can also be determined and presented such that successful and failed execution of jobs, for example, can be differentiated. Furthermore, selection of a job run that failed to execute successfully can trigger identification of related jobs runs that failed or are predicted to fail to execute successfully.

First claim

What is claimed is:

1. A method performed by a system comprising at least one processor coupled to a memory storing machine-executable instructions, which, when executed by the processor, control the system to perform acts comprising:
conveying, for display on a display device, a view of one or more data transformation jobs, wherein execution of the one or more data transformation jobs is scheduled, in progress, or completed;
receiving a first signal from a user selecting a job from the one or more data transformation jobs in the view;
determining one or more related jobs to the user selected job automatically based on data dependencies between jobs, wherein the one or more related jobs comprise at least one of one or more jobs that depend from the user selected job or one or more jobs from which the user selected job depends; and
conveying, for display on the display device, a visualization for the user selected job and the one or more related jobs visually distinct from one or more other jobs in the view.

2. The method of claim 1 further comprises conveying, for display on the display device, one or more jobs scheduled for execution.

3. The method of claim 1 further comprises conveying, for display on the display device, one or more previously executed.

4. The method of claim 1 further comprises conveying, for display on the display device, previously executed jobs visually distinct from scheduled jobs.

5. The method of claim 1 further comprises:
determining compute load during execution of the one or more jobs; and
conveying, for display on the display device, the compute load aligned with the one or more jobs.

6. The method of claim 1 further comprises conveying, for display on the display device, an indication that at least one job failed to execute successfully.

7. The method of claim 6 further comprises:
receiving a second signal selecting one of at least one job run that failed to execute successfully;
determining automatically one or more related job runs related to a selected job run that failed to execute successfully and are predicted to fail based on dependency on a job run that failed to execute successfully; and
conveying, for display on the display device, a highlighted version of the selected job run and the one or more related job runs.

8. The method of claim 6 further comprises:
receiving a second signal selecting one of the at least one job that failed to execute successfully; and
rescheduling execution of the at least one job in response to the second signal.

9. The method of claim 1 further comprises conveying, for display on the display device, the selected job and the one or more related jobs in a job authoring diagram comprising representations of jobs and data sets as well as connections between the jobs and data sets.

10. A method performed by a system comprising at least one processor coupled to a memory storing machine-executable instructions, which, when executed by the processor, control the system to perform acts comprising:
detecting selection of one of one or more data transformation jobs presented by a graphical user interface;
determining one or more related jobs automatically based on data dependencies between jobs in response to detecting selection of the job,
wherein the one or more related jobs comprise at least one of one or more jobs that depend from the selected job or one or more jobs from which the selected job depends; and
presenting the selected job and the one or more related jobs visually distinct from other jobs displayed by the graphical user interface.

11. The method of claim 10 further comprises:
monitoring computer resource utilization in conjunction with job execution; and
presenting a visualization of the resource utilization aligned with one or more respective jobs.

12. The method of claim 10 further comprises:
determining success or failure of execution of job runs; and
presenting failed execution runs different from successful execution runs.

13. The method of claim 10 further comprises rescheduling execution of a job run based on a signal received with respect to the job run that failed to execute successfully.

14. The method of claim 10 further comprises highlighting a select failed job run and one or more related failed job runs or runs predicted to fail based on dependency on a failed job run after receipt of a signal identifying the select failed job run.

15. The method of claim 10 further comprises presenting the selected job and the one or more related jobs in a diagram comprising representations of jobs and data sets and connections between the jobs and data sets.

16. A system comprising:
a processor coupled to a memory, the processor configured to execute computer-executable instructions stored in the memory that when executed perform acts comprising:
scheduling a data transformation job for execution based on requirements specified by the job;
conveying, for display on a display device, the job on a timeline diagram in accordance with the schedule;
receiving a signal that identifies a select job on the timeline diagram; and
conveying, for display on the display device, a highlighted version, on the timeline diagram, of a select job and one or more jobs related to a select job based on data dependency in response to the signal, wherein the one or more related jobs related to the select job comprise at least one of one or more jobs that depend from the select job or one or more jobs from which the select job depends.

17. The system of claim 16 , the acts further comprise detecting if job execution is successful or unsuccessful.

18. The system of claim 17 , the acts further comprise conveying, for display on the display device, a highlighted version of unsuccessful job execution or predicted unsuccessful job execution based on dependency on an unsuccessful job execution in response to selection of a representation of unsuccessful job execution on the timeline diagram.

19. A system comprising:
means for generating a view of a set of data transformation jobs;
means for receiving a user selection of a job, a selected job, from the set of data transformation jobs in the view;
means for determining automatically one or more related jobs to the selected job based on dependency information, wherein the one or more related jobs comprise at least one of one or more jobs that depend from the selected job or one or more jobs from which the selected job depends; and
means for highlighting the selected job and the one or more related jobs in the view.

20. The system of claim 19 further comprises means for generating a schedule for execution of the set of data transformation jobs.

21. The system of claim 20 , the means for generating the view generates a view of the schedule.

22. The system of claim 20 further comprises means for executing one of the set of data transformation jobs in accordance with the schedule.

23. The system of claim 22 further comprises means for detecting success or failure of a run of the one of the set of data transformation jobs.

24. The system of claim 23 the means for generating the view generates a view of the schedule including identification of job run success or failure.

25. The system of claim 24 , the means for receiving the selection receives selection of a failed job run and the means for highlighting highlights one or more related job runs that failed or are predicted to fail

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Peacock Andrew J
• Couris Cheryl
• Storm Christina
• Netz Amir
• Cheung Chiu Ying
• Flasko Michael J
• Grealish Kevin
• Della-Libera Giovanni M
• Carlson Sonia P
• Heninger Mark W
• Bach Paula M
• Nettleton David J

Classifications

• G06Q10/06311 Primary

  Scheduling, planning or task assignment for a person or group · CPC title

• G06F3/04842 Primary

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06F9/52 Primary

  Program synchronisation; Mutual exclusion, e.g. by means of semaphores · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title