System and method for using an event window for testing an event processing system

Patent metadata

Field	Value
Publication number	US-9753825-B2
Application number	US-201514617526-A
Country	US
Kind code	B2
Filing date	Feb 9, 2015
Priority date	Jun 4, 2008
Publication date	Sep 5, 2017
Grant date	Sep 5, 2017

Abstract

Systems and methods can use a testing framework for testing an event processing system. The testing framework operates to send one or more input events in an event stream to an event processing system, wherein each said input event is associated with a timestamp. Also, the testing framework can receive one or more actual output events from the event processing system, wherein each said actual output event is associated with a timestamp. Furthermore, the testing framework can compare said one or more actual output events in an event window with one or more expected output events for the event window.

First claim

What is claimed is:

1. A method for testing an event processing system, comprising:
reading in, by a testing framework, input events data, output events data, and a processing rule from a test file, wherein the test file is associated with a test schema that is designed for testing the event processing system;
converting, by the testing framework, the input events data into a plurality of input event objects, wherein an event type of the event objects is specified in the test file;
sending each of the input event objects in an event stream to an event processing system, wherein each said input event object is associated with a timestamp, and wherein the event stream is specified in the test file;
providing, by the testing framework and to the event processing system, logic specified in a rule section of the test file;
receiving, by the testing framework, an actual output event from the event processing system, wherein the actual output event is associated with a timestamp;
constructing a corresponding internal representation object for the actual output event, wherein the internal representation object includes, as properties, the actual output event and the timestamp associated with the actual output event; and
comparing the internal representation object in an event window with one or more expected output events for the event window.

2. The method of claim 1 , further comprising:
organizing one or more tests in a tree structure.

3. The method of claim 1 , wherein the input events data defines input events that are one of a class based event and a map based event, and wherein each input event is associated with one or more pseudo properties, which are used for input and verification.

4. The method of claim 1 , wherein the event stream is one of an application timestamped stream and a system timestamped stream.

5. The method of claim 1 , wherein at least one event in the event stream is a temporal event.

6. The method of claim 1 , wherein the test file is an XML file, and wherein the test schema is an XML schema.

7. The method of claim 6 , wherein the test file includes a plurality of asserts, wherein each assert defines one or more input events and an expected output event.

8. The method of claim 6 , further comprising:
sharing data among different tests defined in the test file.

9. The method of claim 7 , further comprising:
using an individual verification strategy to verify each said assert based on the one or more actual output events and the expected output event.

10. The method of claim 9 , wherein the individual verification strategy is based on at least one of
input-output verification,
stepped input-output verification,
event-by-event verification,
prepared data in event window, and
multiple streams input.

11. A system for handling various database state notifications in a transactional middleware machine environment, comprising:
one or more microprocessors;
a testing framework, running on the one or more microprocessors, wherein the testing framework operates to
read in input events data, output events data, and a processing rule from a test file, wherein the test file is associated with a test schema that is designed for testing the event processing system;
convert the input events data into a plurality of input event objects, wherein an event type of the event objects is specified in the test file;
send each of the input event objects in an event stream to an event processing system, wherein each said input event object is associated with a timestamp, and wherein the event stream is specified in the test file;
providing, by the testing framework and to the event processing system, logic specified in a rule section of the test file;
receive one or more actual output events from the event processing system, wherein each said actual output event is associated with a timestamp; and
receive an actual output event from the event processing system, wherein the actual output event is associated with a timestamp;
construct a corresponding internal representation object for the actual output event, wherein the internal representation object includes, as properties, the actual output event and the timestamp associated with the actual output event; and
compare the internal representation object in an event window with one or more expected output events for the event window.

12. The system according to claim 11 , wherein:
one or more tests are organized in a tree structure.

13. The system according to claim 11 , wherein:
the input events data defines input events that are one of a class based event and a map based event, and wherein each input event is associated with one or more pseudo properties, which are used for input and verification.

14. The system according to claim 11 , wherein:
the event stream is one of an application timestamped stream and a system timestamped stream.

15. The system according to claim 11 , wherein:
at least one event in the event stream is a temporal event.

16. The system according to claim 11 , wherein:
the test file is an XML file, and wherein the test schema is an XML schema.

17. The system according to claim 16 , wherein:
the test file includes a plurality of asserts, wherein each assert defines one or more input events and an expected output event.

18. The system according to claim 16 , wherein:
the testing framework operates to share data among different tests.

19. The system according to claim 17 , wherein:
the testing framework operates to use an individual verification strategy to verify each said assert based on the one or more actual output events and the expected output event, wherein the individual verification strategy is based on at least one of
input-output verification,
stepped input-output verification,
event-by-event verification,
prepared data in event window, and
multiple streams input.

20. A non-transitory machine readable storage medium having instructions stored thereon that when executed cause a system to perform the steps comprising:
reading in, by a testing framework, input events data, output events data, and a processing rule from a test file, wherein the test file is associated with a test schema that is designed for testing the event processing system;
converting, by the testing framework, the input events data into a plurality of input event objects, wherein an event type of the event objects is specified in the test file;
sending each of the input event objects in an event stream to an event processing system, wherein each said input event object is associated with a timestamp, and wherein the event stream is specified in the test file;
providing, by the testing framework and to the event processing system, logic specified in a rule section of the test file;
receiving, by the testing framework, an actual output event from the event processing system, wherein the actual output event is associated with a timestamp;
constructing a corresponding internal representation object for the actual output event, wherein the internal representation object includes, as properties, the actual output event and the timestamp associated with the actual output event; and
comparing the internal representation object in an event window with one or more expected output events for the event window.

Assignees

• Oracle Int Corp

Inventors

• He Guan Nan
• Xi Ying

Classifications

• G06F11/277

  with comparison between actual response and known fault-free response · CPC title

• G06F11/273

  Tester hardware, i.e. output processing circuits {(G06F11/263 takes precedence)} · CPC title

• G06F11/263 Primary

  Generation of test inputs, e.g. test vectors, patterns or sequences {; with adaptation of the tested hardware for testability with external testers} · CPC title