Extensible indexing framework using data cartridges

Patent metadata

Field	Value
Publication number	US-9305057-B2
Application number	US-91363610-A
Country	US
Kind code	B2
Filing date	Oct 27, 2010
Priority date	Dec 28, 2009
Publication date	Apr 5, 2016
Grant date	Apr 5, 2016

Abstract

A framework or infrastructure (extensibility framework/infrastructure) for extending the indexing capabilities of an event processing system. The capabilities of an event processing system may be extended to support indexing schemes, including related data types and operations, which are not natively supported by the event processing system. The extensibility is enabled by one or more plug-in extension components called data cartridges.

First claim

What is claimed is:

1. A system comprising:
a memory; and
a processor coupled to the memory, the processor configured to:
determine that a query includes a first function for whose evaluation an index is not natively provided by an event processing system that is to compile the query;
provide a data cartridge to the event processing system, the data cartridge providing an indexing scheme for evaluating the first function of the query; and
use, by the event processing system, the indexing scheme provided by the data cartridge to evaluate the first function of the query, wherein the processor is further configured to:
determine an occurrence of a link definition in the query, the link definition identifying the first function and the data cartridge;
determine a list of input arguments to the first function, wherein the list of input arguments comprises a collection;
determine whether the data cartridge provides an index for evaluation of the first function with the set of input arguments;
compile the query using information provided by the data cartridge to generate executable code, the executable code comprising an index instance generated using the information provided by the data cartridge, the index instance being generated for evaluation of the first function; and

execute the executable code, wherein the execution causes execution of the first function provided by the data cartridge related to the index instance.

2. The system of claim 1 wherein the processor is configured to:
communicate, to the data cartridge, information identifying the first function;
communicate, to the data cartridge, a position of the collection in the list of input arguments;
receive metadata information from the data cartridge, the metadata information identifying an index type to be used for evaluating the first function for the collection; and
generate the index instance based upon the index type.

3. The system of claim 2 wherein:
the metadata information comprises context information, the context information comprising information identifying the first function provided by the data cartridge; and
the processor is configured to communicate the information identifying the function to the data cartridge during execution of the executable code.

4. The system of claim 1 wherein the processor is configured to:
categorize, based on mappings that map various functions to various categories, the first function into one of a first category, a second category, or a third category, wherein categorization of the first function into the first category indicates that the system provides an index for evaluation of the first function, wherein categorization of the first function into the second category indicates that the data cartridge provides an index for evaluation of the first function, and wherein categorization of the first function into the third category indicates that no index is provided for evaluation of the first function;
wherein the data cartridge manages all metadata for the index instance;
wherein metadata for the index instance is not stored in memory of the event processing system.

5. The system of claim 1 wherein the processor is configured to:
use the index instance to evaluate a second function, wherein the collection is provided as an input argument for both the first function and the second function and the index instance is generated for the collection.

6. The system of claim 1 wherein:
the collection comprising a plurality of elements is provided as an input argument to the first function;
the first function provided by the data cartridge is an index scan function using the index instance; and
the processor is configured to receive a result set from execution of the first function provided by the data cartridge, the result set resulting from evaluation of the first function and comprising a set of items from the collection.

7. The system of claim 1 wherein:
the collection comprising a plurality of elements is provided as an input argument to the first function;
the first function provided by the data cartridge is an index scan function using the index instance;
the processor is configured to:
receive a result set from execution of the first function provided by the data cartridge, the result set comprising a set of items from the collection resulting from evaluation of the first function and also additional one or more items from the collection; and
determine the set of items resulting from evaluation of the first function from the result set.

8. The system of claim 1 wherein the processor is configured to:
execute the executable code upon receiving an event via an event stream, the event comprising data and a time stamp;
wherein the processor is configured to compile the query using the information provided by the data cartridge without using a user-defined function designed to interact specifically with a particular application that consumes results of execution of the executable code.

9. A non-transitory computer-readable storage medium storing a plurality of instructions for controlling a computer system, the plurality of instructions comprising:
instructions that cause the computer system to determine that a query includes a first function for whose evaluation an index is not natively provided by an event processing system that is to compile the query;
instructions that cause the computer system to provide a data cartridge to the event processing system, the data cartridge providing an indexing scheme for evaluating the first function of the query; and
instructions that cause the computer system to use the indexing scheme provided by the data cartridge to evaluate the first function of the query, wherein the instructions further comprise:
instructions that cause the computer system to determine an occurrence of a link definition in the query, the link definition identifying the first function and the data cartridge;
instructions that cause the computer system to determine a list of input arguments to the first function, wherein the list of input arguments comprises a collection;
instructions that cause the computer system to determine whether the data cartridge provides an index for evaluation of the first function with the set of input arguments;
instructions that cause the computer system to compile the query using information provided by the data cartridge to generate executable code, the executable code comprising an index instance generated using the information provided by the data cartridge, the index instance being generated for evaluation of the first function; and
instructions that cause the computer system to execute the executable code, wherein the execution causes execution of the first function provided by the data cartridge related to the index instance.

10. The non-transitory computer-readable storage medium of claim 9 wherein the instructions that cause the computer system to compile the query comprise:
instructions that cause the computer system to communicate information to the data cartridge identifying the first function;
instructions that cause the computer system to communicate to the data cartridge a position of the collection in the list of input arguments;
instructions that cause the computer system to receive metadata information from the data cartridge, the metadata information identifying an index type to be used for evaluating the first function for the collection; and
instructions that cause the computer system to generate the index instance based upon the index type.

11. The non-transitory computer-readable storage medium of claim 10 wherein:
the metadata information comprises context information,

Assignees

• De Castro Alves Alexandre
• Deshmukh Unmesh
• Park Hoyong
• Mishra Shailendra
• Srinivasan Anand
• Oracle Int Corp

Inventors

• De Castro Alves Alexandre
• Deshmukh Unmesh
• Park Hoyong
• Mishra Shailendra
• Srinivasan Anand

Classifications

• G06F17/30557

  Physics · mapped topic

• G06F17/30516 Primary

  Physics · mapped topic

• G06F16/25 Primary

  Integrating or interfacing systems involving database management systems · CPC title

• G06F16/24568 Primary

  Data stream processing; Continuous queries · CPC title