Container orchestration framework

Patent metadata

Field	Value
Publication number	US-12260203-B2
Application number	US-202217891876-A
Country	US
Kind code	B2
Filing date	Aug 19, 2022
Priority date	Jul 23, 2019
Publication date	Mar 25, 2025
Grant date	Mar 25, 2025

Abstract

Methods and systems are presented for providing a container orchestration framework for facilitating development and deployment of software applications across different operating environments within an enterprise system. Upon receiving a service request for processing a set of data is received, the container orchestration framework determines one or more machines that store the set of data. Instead of processing the set of data remotely, the container orchestration framework deploys a container that encapsulates an application on the one or more machines. Each application instance running on the one or more machines are executed to process a corresponding subset of data stored on the machine locally. The container orchestration framework obtains the output data from executing the applications on each of the one or more machines, and present the output data as a response to the service request.

First claim

What is claimed is:

1. A system, comprising:
a non-transitory memory; and
one or more hardware processors coupled with the non-transitory memory and configured to read instructions from the non-transitory memory to cause the system to perform operations comprising:
receiving a request for a computer service from a user device;
determining that the computer service comprises a plurality of tasks, wherein a first task of the plurality of tasks is associated with processing a first set of data by a first application, and wherein a second task of the plurality of tasks is associated with processing a second set of data by a second application;
determining that the first set of data is distributed across a first set of computer devices and that the second set of data is distributed across a second set of computer devices;
in response to determining that the first set of data is distributed across the first set of computer devices and that the second set of data is distributed across the second set of computer devices, deploying instances of the first application to the first set of computer devices and deploying instances of the second application to the second set of computer devices, wherein a respective instance of the first application is deployed on a corresponding one of the first set of computer devices, and wherein a respective instance of the second application is deployed on a corresponding one of the second set of computer devices;
configuring the instances of the first application deployed on the first set of computer devices to perform the first task of the computer service, wherein the instances of the first application are configured to process corresponding portions of the first set of data stored on the first set of computer devices and to generate corresponding intermediate data based on the processing the corresponding portions of the first set of data;
configuring the instances of the second application deployed on the second set of computer devices to perform the second task of the computer service, wherein the instances of the second application are configured to suspend processing the second set of data before receiving an indication that the corresponding intermediate data generated by each of the instances of the first application is ready;
receiving the indication that the corresponding intermediate data generated by each of the instances of the first application is ready;
in response to receiving the indication, causing the instances of the second application deployed on the second set of computer devices to produce output data based on processing the corresponding intermediate data generated by the instances of the first application and corresponding portions of the second set of data stored on the second set of computer devices; and
providing a response to the request for the computer service based on the output data.

2. The system of claim 1 , wherein the first set of computer devices and the second set of computer devices comprise one or more overlapping computer devices.

3. The system of claim 1 , wherein the first set of computer devices is different from the second set of computer devices, and wherein the first set of computer devices is further configured to transmit the corresponding intermediate data to the second set of computer devices.

4. The system of claim 1 , wherein the operations further comprise:
analyzing the output data; and
generating analytical data based on the analyzing the output data, wherein the analytical data is provided as the response to the request for the computer service.

5. The system of claim 4 , wherein the output data comprises performance data associated with a machine learning model, and wherein the analyzing the output data comprises determining one or more performance metrics for the machine learning model based on the performance data.

6. The system of claim 1 , wherein the operations further comprise:
determining that the first set of data is stored on a computer device;
dividing the first set of data into the corresponding portions of the first set of data; and
distributing the corresponding portions of the first set of data across the first set of computer devices.

7. The system of claim 1 , wherein the operations further comprise:
determining that the first task of the computer service has been completed; and
in response to determining that the first task has been completed, removing the instances of the first application from the first set of computer devices.

8. A method, comprising:
receiving a request for a computer service from a user device, wherein the computer service comprises a first task associated with a first set of data and a second task associated with a second set of data;
determining, by a computer system, that the first set of data is stored on a first set of computer devices and that the second set of data is stored on a second set of computer devices;
in response to determining that the first set of data is stored on the first set of computer devices and that the second set of data is stored on the second set of computer devices, deploying instances of the first application to the first set of computer devices and deploying instances of the second application to the second set of computer devices, wherein a respective instance of the first application is deployed on a corresponding one of the first set of computer devices, and wherein a respective instance of the second application is deployed on a corresponding one of the second set of computer devices;
accessing, by the computer system, the instances of a first application deployed on the first set of computer devices, wherein the instances of the first application are configured to perform the first task of the computer service, wherein performing the first task comprises processing corresponding portions of the first set of data stored on the first set of computer devices and generating corresponding intermediate data based on the processing the corresponding portions of the first set of data;
accessing, by the computer system, the instances of a second application deployed on the second set of computer devices, wherein the instances of the second application are configured to perform the second task of the computer service, wherein the performing the second task comprises suspending processing the second set of data before the corresponding intermediate data generated by each of the instances of the first application is ready;
detecting that the corresponding intermediate data is ready;
in response to the detecting, causing the instances of the second application deployed on the second set of computer devices to produce output data based on processing the corresponding intermediate data generated by the instances of the first application and corresponding portions of the second set of data stored on the second set of computer devices; and
providing, by the computer system, a response to the request for the computer service based on the output data.

9. The method of claim 8 , further comprising:
determining that the first set of data is stored on a computer device;
dividing the first set of data into the corresponding portions of the first set of data; and
distributing the corresponding portions of the first set of data across the first set of computer devices.

10. The method of claim 9 , further comprising:
determining that a size corresponding to the first set of data exceeds a threshold, wherein the dividing and the distributing is performed in response to the determining that the size exceeds the threshold.

11. The method of claim 8 , wherein the performing the second task further comprises analyzing the output data

Assignees

• Paypal Inc

Inventors

• Manoharan Srinivasan
• Chirakkil Vinesh
• Wu Yuehao
• Zhao Junhua
• Han Xiaoying
• Ho Chun Kiat
• Viswanathan Premila
• Song Lin

Classifications

• G06F9/45558

  Hypervisor-specific management and integration aspects · CPC title

• G06F2009/45591

  Monitoring or debugging support · CPC title

• G06F2009/45562

  Creating, deleting, cloning virtual machine instances · CPC title

• G06F8/41

  Compilation · CPC title

• G06F8/60

  Software deployment · CPC title