Managing highly scalable continuous delivery pipelines

Patent metadata

Field	Value
Publication number	US-2017115976-A1
Application number	US-201615255048-A
Country	US
Kind code	A1
Filing date	Sep 1, 2016
Priority date	Oct 23, 2015
Publication date	Apr 27, 2017
Grant date	—

Abstract

Systems and methods are provided for managing and tracking process pipelines and other flows in a way that reduces the requirement for a central controlling process to manage every step of the associated pipeline flow and the state associated with each running instance. Job information and pipeline state are tracked by each worker involved in the pipeline. This enables some key capabilities within these process pipelines such as dynamic process re-writing and cross security domain job execution.

First claim

What is claimed is:

1 . A method, comprising:
sending, by a computing system, a job package to a first build worker in response to launching a build pipeline, an entire plan for the build pipeline being written into the job package; receiving, by the computing system, first results of a first job in the build pipeline performed by the first build worker, a first transactional record associated with the first results being maintained within a first build record held by the first build worker; receiving, by the computing system, second results of a second job in the build pipeline performed by a second build worker, a second transactional record associated with the second results being maintained within a second build record held by the second build worker; and updating, by the computing system, the first build record held by the first build worker with the second results of the second job in the build pipeline performed by the second build worker.

2 . The method of claim 1 , wherein sending the job package to the first build worker comprises sending job information and a pipeline blockchain.

3 . The method of claim 1 , further comprising:
storing, by the computing system, the second results of the second job in a central transaction record; and determining, by the computing system, whether to reconcile the second results of the second job with the first build record held by the first build worker.

4 . The method of claim 1 , wherein updating the first build record held by the first build worker with the second results of the second job in the build pipeline performed by a second build worker comprises updating a build state associated with a portion of the entire plan for the build pipeline held at the first build worker.

5 . The method of claim 1 , further comprising:
receiving, by the computing system, a change to the build pipeline; and propagating, by the computing system, the change to the first build worker and the second build worker.

6 . The method of claim 1 , wherein sending the job package to the first build worker comprises sending version information associated with the build pipeline.

7 . The method of claim 1 , wherein sending the job package to the first build worker comprises sending the job package to a build server behind a corporate firewall used for signing application code.

8 . The method of claim 1 , further comprising receiving, by the computing system, build artifacts associated with the first job.

9 . A computer-readable medium storing computer-executable code that, when executed by a processor, cause the processor to perform operations comprising:
sending a job package to a first build worker in response to launching a build pipeline, an entire plan for the build pipeline being written into the job package; receiving first results of a first job in the build pipeline performed by the first build worker, a first transactional record associated with the first results being maintained within a first build record held by the first build worker; receiving second results of a second job in the build pipeline performed by a second build worker, a second transactional record associated with the second results being maintained within a second build record held by the second build worker; and updating the first build record held by the first build worker with the second results of the second job in the build pipeline performed by the second build worker.

10 . The computer-readable medium of claim 9 , wherein sending the job package to the first build worker comprises sending job information and a pipeline blockchain.

11 . The computer-readable medium of claim 9 , wherein the operations further comprise:
storing the second results of the second job in a central transaction record; and determining whether to reconcile the second results of the second job with the first build record held by the first build worker.

12 . The computer-readable medium of claim 9 , wherein updating the first build record held by the first build worker with the second results of the second job in the build pipeline performed by a second build worker comprises updating a build state associated with a portion of the entire plan for the build pipeline held at the first build worker.

13 . The computer-readable medium of claim 9 , wherein the operations further comprise:
receiving a change to the build pipeline; and propagating the change to the first build worker and the second build worker.

14 . The computer-readable medium of claim 9 , wherein sending the job package to the first build worker comprises sending version information associated with the build pipeline.

15 . A system, comprising:
a processor; and a memory storing a set of instructions that, when executed by the processor, cause the processor to:
send a job package to a first build worker in response to launching a build pipeline, an entire plan for the build pipeline being written into the job package;
receive first results of a first job in the build pipeline performed by the first build worker, a first transactional record associated with the first results being maintained within a first build record held by the first build worker;
receive second results of a second job in the build pipeline performed by a second build worker, a second transactional record associated with the second results being maintained within a second build record held by the second build worker; and
update the first build record held by the first build worker with the second results of the second job in the build pipeline performed by the second build worker.

16 . The system of claim 15 , wherein sending the job package to the first build worker comprises sending job information and a pipeline blockchain.

17 . The system of claim 15 , wherein updating the first build record held by the first build worker with the second results of the second job in the build pipeline performed by a second build worker comprises updating a build state associated with a portion of the entire plan for the build pipeline held at the first build worker.

18 . The system of claim 15 , wherein sending the job package to the first build worker comprises sending version information associated with the build pipeline.

19 . The system of claim 15 , wherein sending the job package to the first build worker comprises sending the job package to a build server behind a corporate firewall used for signing application code.

20 . The system of claim 15 , wherein the set of instructions further cause the processor to receive build artifacts associated with the first job.

Assignees

• Oracle Int Corp

Inventors

• Mills Duncan Richard

Classifications

• G06F8/71 Primary

  Version control (security arrangements therefor G06F21/57); Configuration management · CPC title

• G06Q10/06

  Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling · CPC title

• G06F8/60 Primary

  Software deployment · CPC title

• G06F9/46

  Multiprogramming arrangements · CPC title