Application bundle pulling

Patent metadata

Field	Value
Publication number	US-9965264-B2
Application number	US-201514752850-A
Country	US
Kind code	B2
Filing date	Jun 27, 2015
Priority date	May 21, 2015
Publication date	May 8, 2018
Grant date	May 8, 2018

Abstract

Disclosed aspects include receiving a stream of tuples to be processed by a plurality of processing elements operating on a set of compute nodes. A determination is made to retrieve an application bundle from a second compute node. The determination is made by a first compute node based on a set of application bundle data. The application bundle is installed on the first compute node by the first compute node. Using the application bundle on the first compute node, the stream of tuples is processed. In embodiments, the application bundle is retrieved by the first compute node in response to determining to retrieve the application bundle from the second compute node.

First claim

What is claimed is:

1. A system for processing a stream of tuples using an application bundle, the system comprising:
a memory having a set of computer readable computer instructions, and
a processor for executing the set of computer readable instructions, the set of computer readable instructions including:
receiving the stream of tuples to be processed by a plurality of processing elements operating on a set of compute nodes;
determining, by a first compute node based on a set of application bundle data, to retrieve the application bundle from a second compute node, wherein the determination includes examining the set of application bundle data for the application bundle, detecting the second compute node has the application bundle, and determining, using at least one source criterion, to retrieve the application bundle from the second compute node;
retrieving, by the first compute node in response to determining to retrieve the application bundle from the second compute node, the application bundle;
installing, by the first compute node, the application bundle on the first compute node;
processing, using the application bundle on the first compute node, the stream of tuples;
detecting a staleness factor with respect to the application bundle on the first compute node;
maintaining or removing the application bundle based on the detected staleness factor and the at least one source criterion;
updating the set of application bundle data to include that the first compute node has the application bundle, wherein first compute node communicates directly to the application bundle directory to update status, and wherein the direct communication consists of transmitting a status notification to the application bundle directory for updating or editing the set of application bundle data;
determining, by a third compute node based on the set of application bundle data, to retrieve the application bundle from the first compute node; and
installing, by the third compute node, the application bundle on the third compute node.

2. The system of claim 1 , wherein determining, by the first compute node based on the set of application bundle data, to retrieve the application bundle from the second compute node includes:
analyzing the set of application bundle data; and
identifying a criterion which indicates to retrieve the application bundle from the second compute node.

3. The system of claim 1 , wherein determining, by the first compute node based on the set of application bundle data, to retrieve the application bundle from the second compute node includes:
using a physical proximity criterion of the second compute node with respect to the first compute node.

4. The system of claim 1 , wherein determining, by the first compute node based on the set of application bundle data, to retrieve the application bundle from the second compute node includes:
using an expected resource burden criterion when downloading the application bundle to the first compute node from the second compute node.

5. The system of claim 1 , wherein determining, by the first compute node based on the set of application bundle data, to retrieve the application bundle from the second compute node includes:
using a utilization frequency criterion of the second compute node.

6. The system of claim 1 , wherein determining, by the first compute node based on the set of application bundle data, to retrieve the application bundle from the second compute node includes:
using a random selection criterion of the second compute node.

7. The system of claim 1 , wherein the set of application bundle data is stored separate from both the first compute node and the second compute node.

8. The system of claim 1 , wherein the set of application bundle data indicates to utilize the application bundle to process the stream of tuples.

9. The system of claim 1 , further comprising:
locating, in the set of application bundle data, the application bundle to process information in tuples expected to be received for processing within a temporal period.

10. The system of claim 1 , further comprising:
inspecting the set of application bundle data to find a listing of nodes having the application bundle.

11. The system of claim 1 , further comprising:
indicating, by the set of application bundle data, possession of the application bundle by one or more compute nodes including the second compute node.

12. The system of claim 1 , further comprising:
retrieving the application bundle which includes an executable code image to process one or more tuples of the stream of tuples.

13. The system of claim 1 , further comprising:
retrieving, by the first compute node for load-balancing in a cloud environment, the application bundle to process one or more tuples of the stream of tuples.

14. The system of claim 1 , further comprising:
retrieving, by the first compute node in response to a failover of a host in a cloud environment, the application bundle to process one or more tuples of the stream of tuples.

15. A computer program product for processing a stream of tuples using an application bundle, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions executable by a processor to cause the processor to perform a method comprising:
receiving, in the stream computing environment, the stream of tuples to be processed by a plurality of processing elements operating on a set of compute nodes;
analyzing, in the stream computing environment by a first compute node, the set of application bundle data which indicates to utilize the application bundle to process the stream of tuples; and
identifying a criterion which indicates to retrieve the application bundle from the second compute node;
determining, in the stream computing environment by the first compute node based on the set of application bundle data and the criterion which indicates to retrieve the application bundle from the second compute node, to retrieve the application bundle from a second compute node, wherein the determination includes examining the set of application bundle data for the application bundle, detecting the second compute node has the application bundle, and determining, using at least one source criterion, to retrieve the application bundle from the second compute node;
retrieving, in the stream computing environment by the first compute node in response to determining to retrieve the application bundle from the second compute node, the application bundle which includes an executable code image to process one or more tuples of the stream of tuples;
installing, in the stream computing environment by the first compute node, the application bundle on the first compute node
processing, in the stream computing environment using the application bundle on the first compute node, the stream of tuples;
detecting a staleness factor with respect to the application bundle on the first compute node;
maintaining or removing the application bundle based on the detected staleness factor and the at least one source criterion;
updating, in the stream computing environment by the first compute node, the set of application bundle data to include that the first compute node has the application bundle, wherein first compute node communicates directly to the application bundle directory to update status, and wherein the direct communication consists of transmitting a status notification to the application bundle directory for updati

Assignees

• IBM
• Interational Business Machines Corp

Inventors

• Fawcett Bradley W

Classifications

• H04L67/34

  involving the movement of software or configuration parameters  (network booting or remote initial program loading [RIPL] G06F9/4416) · CPC title

• G06F8/61 Primary

  Installation · CPC title

• G06F16/24568

  Data stream processing; Continuous queries · CPC title

• G06F16/22

  Indexing; Data structures therefor; Storage structures · CPC title

• G06F8/41

  Compilation · CPC title