Database insertions in a stream database environment

Patent metadata

Field	Value
Publication number	US-9514159-B2
Application number	US-91346010-A
Country	US
Kind code	B2
Filing date	Oct 27, 2010
Priority date	Oct 27, 2010
Publication date	Dec 6, 2016
Grant date	Dec 6, 2016

Abstract

Methods and systems for storing stream data in a stream application are disclosed. The stream application is composed from a plurality of processing elements executing on one or more compute nodes. The plurality of processing elements is communicatively coupled to a management system. The management system is configured to monitor and control operations of the plurality of processing elements. A trigger rule, which includes a trigger condition, is loaded on a selected processing element in the plurality of process elements. The stream data is then monitored at the first processing element to determine if the trigger condition relative to the stream data has occurred. The stream data is stored in a database when the trigger condition occurs. The stream data is stored in the database according to the trigger rule.

First claim

What is claimed is:

1. A method, comprising:
receiving a data stream to be processed in a data streaming environment comprising a plurality of processing elements interconnected by an operator graph, and wherein each of the processing elements is configured to receive an incoming tuple and perform a respective one or more processing operations on the incoming tuple, and wherein at least one of the plurality of processing elements is configured to generate, as a result of the respective one or more processing operations, an output tuple and to transmit the output tuple, based on the operator graph, to at least one downstream processing element in the plurality of processing elements;
loading a trigger rule on both a first processing element and a second processing element in the plurality of processing elements, wherein the trigger rule includes a trigger condition and defines a processing action to be performed upon satisfaction of the trigger condition on both the first processing element and the second processing element;
upon determining that a first tuple received at the first processing element satisfies the trigger condition and that a second tuple received at the second processing element satisfies the trigger condition, performing the processing action defined by the trigger rule on at least one of the first tuple, the second tuple and information related to the data stream;
storing at least one of information related to the data stream at the time the trigger condition was satisfied and the first tuple in a database, wherein the storing includes formatting the at least one of the information related to the data stream and the first tuple according to a predefined format in the trigger rule;
wherein the plurality of processing elements are communicatively coupled to a management system configured to monitor and control operations of the plurality of processing elements, wherein the management system is further configured to monitor a database to detect occurrences of a pre-defined event defined by a second trigger rule, and to perform a second processing action defined by the second trigger rule upon detecting an occurrence of the pre-defined event.

2. The method of claim 1 , wherein the processing action includes sending the at least one of the information related to the data stream and the first tuple to an application that is external to the data streaming environment.

3. The method of claim 1 , wherein the processing action includes sending the at least one of the information related to the data stream and the first tuple to a selected processing element in the plurality of processing elements.

4. The method of claim 1 , wherein the trigger condition is satisfied when an incoming tuple rate at the first processing element exceeds a selected threshold value.

5. The method of claim 1 , wherein the trigger condition is satisfied when an incoming tuple rate at the first processing element falls below a selected threshold value.

6. The method of claim 1 , further comprising:
wherein the performing the processing action is performed only when the trigger condition is satisfied on the first processing element and the second processing element within a pre-configured window of time.

7. The method of claim 1 , wherein the first processing element buffers the first tuple with other tuples received from the data stream, and wherein the processing action specifies to write one or more attributes related to the buffered tuples to a database.

8. The method of claim 1 , wherein the trigger condition is satisfied when one of a period of time, a tuple rate, an attribute count, and an attribute deviation exceeds a predefined threshold on both the first processing element and the second processing element.

9. A non-transitory computer readable device containing a program which, when executed, performs an operation comprising:
receiving a data stream to be processed in a data streaming environment comprising a plurality of processing elements interconnected by an operator graph, and wherein each of the processing elements is configured to receive an incoming tuple and perform a respective one or more processing operations on the incoming tuple, and wherein at least one of the plurality of processing elements is configured to generate, as a result of the respective one or more processing operations, an output tuple and to transmit the output tuple, based on the operator graph, to at least one downstream processing element in the plurality of processing elements;
loading a trigger rule on both a first processing element and a second processing element in the plurality of processing elements, wherein the trigger rule includes a trigger condition and defines a processing action to be performed upon satisfaction of the trigger condition on both the first processing element and the second processing element;
upon determining that a first tuple received at the first processing element satisfies the trigger condition and that a second tuple received at the second processing element satisfies the trigger condition, performing the processing action defined by the trigger rule on at least one of the first tuple, the second tuple and information related to the data stream;
storing at least one of information related to the data stream at the time the trigger condition was satisfied and the first tuple in a database, wherein the storing includes formatting the at least one of the information related to the data stream and the first tuple according to a predefined format in the trigger rule;
wherein the plurality of processing elements are communicatively coupled to a management system configured to monitor and control operations of the plurality of processing elements, wherein the management system is further configured to monitor a database to detect occurrences of a pre-defined event defined by a second trigger rule, and to perform a second processing action defined by the second trigger rule upon detecting an occurrence of the pre-defined event.

10. The non-transitory computer readable device of claim 1 , wherein performing the processing action defined by the trigger rule includes formatting the at least one of the information related to the data stream and the first tuple according to a predefined format in the trigger rule.

11. The non-transitory computer readable device of claim 9 , wherein the processing action includes sending the at least one of the information related to the data stream and the first tuple to an application that is external to the data streaming environment.

12. The non-transitory computer readable device of claim 9 , wherein the processing action includes sending the at least one of the information related to the data stream and the first tuple to a selected processing element in the plurality of processing elements.

13. The non-transitory computer readable device of claim 9 , wherein the trigger condition is satisfied when an incoming tuple rate at the first processing element exceeds a selected threshold value.

14. The non-transitory computer readable device of claim 9 , wherein the trigger condition is satisfied when an incoming tuple rate at the first processing element falls below a selected threshold value.

15. The non-transitory computer readable device of claim 9 , wherein the operation further comprising:
wherein the performing the processing action is performed only when the trigger condition is satisfied on the first processing element and the second processing element within a pre-configured window of time.

16. The non-transitory computer readable device of claim 9 , wherein the

Assignees

• Barsness Eric L
• Santosuosso John M
• IBM

Inventors

• Barsness Eric L
• Santosuosso John M

Classifications

• G06F16/21 Primary

  Design, administration or maintenance of databases · CPC title

• G06F17/30289 Primary

  Physics · mapped topic