Hybrid flows containing a continous flow

Patent metadata

Field	Value
Publication number	US-2016283610-A1
Application number	US-201315034241-A
Country	US
Kind code	A1
Filing date	Dec 19, 2013
Priority date	Dec 19, 2013
Publication date	Sep 29, 2016
Grant date	—

Abstract

Processing a hybrid flow containing a continuous flow can include connecting a continuous flow to a finite flow of a hybrid flow using a continuous connector operator, and processing the data flow graph of the hybrid flow.

First claim

What is claimed:

1 . A system for processing hybrid flows containing a continuous flow, comprising:
a conversion engine to:
convert a hybrid flow to a data flow graph, wherein the hybrid flow includes a continuous flow and a finite flow; and
connect an output of the continuous flow to an input of the finite in the data flow graph using a continuous connector operator; and
a hybrid flow engine to process the data flow graph of the hybrid flow.

2 . The system of claim 1 , wherein the hybrid flow engine optimize the data flow graph of the hybrid flow.

3 . The system of claim 1 , wherein the conversion engine adds the continuous connector operator to the data flow graph of the hybrid flow.

4 . The system of claim 1 , wherein the hybrid flow engine adds a new flow to the data flow graph of the hybrid flow.

5 . The system of claim 1 , including a continuous connector operator engine to:
aggregate input data from the continuous flow; and send the aggregate input data to the finite flow as a data block.

6 . The system of claim 5 , further including a finite flow engine to analyze data from the continuous flow that is aggregated.

7 . The system of claim 1 , further including a continuous flow engine to:
execute an operation on continuously collected data; and send the data to the continuous connector operator.

8 . A non-transitory computer readable medium storing instructions executable by a processing resource to cause a computer to:
subscribe a continuous connector, operator to a continuous flow of a hybrid flow to connect the continuous flow to a finite flow of the hybrid flow; aggregate data from the continuous flow using the continuous connector operator; send the aggregated data to the finite flow of the hybrid flow; and terminate the subscription of the continuous connector operator to the continuous flow based on a termination condition.

9 . The non-transistory computer-readable medium of claim 8 , wherein the instructions executable by the processing resource to subscribe to the continuous flow include instructions executable to subscribe in response to identification of an output of the continuous flow as an input to the finite flow.

10 . The non-transitory computer-readable medium of claim 8 , including instructions executable by the processing resource to:
convert a plurality of task flows of the hybrid flow, including the continuous flow and the finite flow, to a data flow graph that contains control and data flow characteristics of the hybrid flow.

11 . The non-transitory computer-readable medium of claim 10 , including instructions executable by the processing resource to process the data flow graph including instructions executable to optimize the data flow graph including the continuous connector operator.

12 . A method for processing a hybrid flow containing a continuous flow comprising:
annotating a continuous flow as continuous and a finite flow as finite in a data flow graph of a hybrid flow; adding a continuous connector operator to the data flow graph of the hybrid flow to connect an output of the continuous flow to an input of the finite flow in response to identifying the annotated finite flow is a consumer of the annotated continuous flow; aggregating data from the continuous flow using the continuous connector operator; analyzing the aggregated data along the finite flow; revising the data flow graph of the hybrid flow to include a new flow and a new continuous connector operator based on the analysis of the aggregated data; and processing the revised data flow graph of the hybrid flow.

13 . The method of claim 12 , wherein revising the data flow graph to include the new flow and the new continuous connector operator includes creating the new flow in the data flow graph of the hybrid flow.

14 . The method of claim 12 , wherein revising the data flow graph to include the new flow and the new continuous connector operator includes creating the new continuous connector operator to replicate input data to the continuous data flow.

15 . The method of claim 12 , wherein processing the revised data flow graph of the hybrid flow includes outputting an alternative data flow graph of the hybrid flow with the lowest relative cost of a set of alternative data flow graphs based on an optimization objective.

Assignees

• Hewlett Packard Entpr Dev Lp

Inventors

• Simitsis Alkiviadis
• Wilkinson William K

Classifications

• G06F16/9024 Primary

  Graphs; Linked lists (G06F16/9027 takes precedence) · CPC title

• G06F16/258

  Data format conversion from or to a database · CPC title

• G06F8/433

  Dependency analysis; Data or control flow analysis · CPC title

• G06F17/30569

  Physics · mapped topic

• G06F17/30958 Primary

  Physics · mapped topic