Dyanmic data-driven generation and modification of input schemas for data analysis

Patent metadata

Field	Value
Publication number	US-9817851-B2
Application number	US-201414151175-A
Country	US
Kind code	B2
Filing date	Jan 9, 2014
Priority date	Jan 9, 2014
Publication date	Nov 14, 2017
Grant date	Nov 14, 2017

Abstract

The present disclosure describes methods, systems, and computer program products for dynamic generation and modification of input schemas. One computer-implemented method includes receiving event data from a data source with an event collector, the data source registered with the event collector to transmit event data to the event collector, transmitting the received event data for analysis, saving the transmitted event data, determining whether to create or update a business intelligence view, determining whether to create or update an input schema based on the saved event data, and providing, by a computer, an input schema describing how data is represented in the database to a query generation engine.

First claim

What is claimed is:

1. A computer-implemented method comprising:
receiving a first set of event data in a first event structure from a remote computing data source with an event collector, wherein the remote computing data source is registered with the event collector to transmit event data to the event collector;
transmitting the received first set of event data for analysis;
saving the transmitted first set of event data;
determining whether to create or update a business intelligence view based on the saved first set of event data;
creating an input schema based on the saved first set of event data; and
providing, by a computer and for storage, the created input schema derived from the saved first set of event data and proactively describing how data is represented in the database and what type of queries can be performed on the database and required particular language formalisms to a query generation engine for later use in retrieving data from the database upon receipt of a high-level query request from the remote computing data source or another remote computing data source, wherein the query generation engine dynamically generates a query generation engine expression corresponding to the input schema, and wherein the query generation engine provides computing services to generate low-level native database queries from the high-level query request for compatibility with the database;
receiving a second set of event data in a second event structure from the remote computing data source, the second event structure different from the first event structure;
transmitting the received second set of event data for analysis;
saving the transmitted second set of event data;
dynamically modifying the input schema in response to a determination that the second event structure of the saved second set of event data differs from the structure of the created input schema; and
providing, by the computer and for storage, an updated input schema as modified based on the saved second set of event data.

2. The method of claim 1 , further comprising pre-processing the received event data before transmitting the sets of event data for analysis.

3. The method of claim 1 , further comprising analyzing the transmitted event data to determine whether to create database tables to save the event data.

4. The method of claim 1 , further comprising creating or updating a business intelligence view.

5. The method of claim 1 , further comprising transmitting a query to a database, the query generated by the query generation engine based on an input schema associated with the received event data.

6. The method of claim 1 , further comprising translating a received query into a common query format to transmit to the query generation engine.

7. A non-transitory, computer-readable medium storing computer-readable instructions executable by a computer and operable to:
receive a first set of event data in a first event structure from a remote computing data source with an event collector, wherein the remote computing data source is registered with the event collector to transmit event data to the event collector;
transmit the received first set of event data for analysis;
save the transmitted first set of event data;
determine whether to create or update a business intelligence view based on the saved first set of event data;
create an input schema based on the saved first set of event data;
provide for storage the created input schema derived from the saved first set of event data and proactively describing how data is represented in the database and what type of queries can be performed on the database and required particular language formalisms to a query generation engine for later use in retrieving data from the database upon receipt of a high-level query request from the remote computing data source or another remote computing data source, wherein the query generation engine dynamically generates a query generation engine expression corresponding to the input schema, and wherein the query generation engine provides computing services to generate low-level native database queries from the high-level query request for compatibility with the database;
receive a second set of event data in a second event structure from the remote computing data source, the second event structure different from the first event structure;
transmit the received second set of event data for analysis;
save the transmitted second set of event data;
dynamically modify the input schema in response to a determination that the second event structure of the saved second set of event data differs from the structure of the created input schema; and
provide, by the computer and for storage, an updated input schema as modified based on the saved second set of event data.

8. The medium of claim 7 , further comprising instructions operable to pre-process the received sets of event data before transmitting the event data for analysis.

9. The medium of claim 7 , further comprising instructions operable to analyze the transmitted event data to determine whether to create database tables to save the event data.

10. The medium of claim 7 , further comprising instructions operable to create or update a business intelligence view.

11. The medium of claim 7 , further comprising instructions operable to transmit a query to a database, the query generated by the query generation engine based on an input schema associated with the received event data.

12. The medium of claim 7 , further comprising instructions operable to translate a received query into a common query format to transmit to the query generation engine.

13. A system, comprising:
at least one computer interoperably coupled with a memory storage and configured to:
receive a first set of event data in a first event structure from a remote computing data source with an event collector, wherein the remote computing data source is registered with the event collector to transmit event data to the event collector;
transmit the received first set of event data for analysis;
save the transmitted first set of event data;
determine whether to create or update a business intelligence view based on the saved first set of event data;
create an input schema based on the saved first set of event data;
provide for storage the created input schema derived from the saved first set of event data and proactively describing how data is represented in the database and what type of queries can be performed on the database and required particular language formalisms to a query generation engine for later use in retrieving data from the database upon receipt of a high-level query request from the remote computing data source or another remote computing data source, wherein the query generation engine dynamically generates a query generation engine expression corresponding to the input schema, and wherein the query generation engine provides computing services to generate low-level native database queries from the high-level query request for compatibility with the database;
receiving a second set of event data in a second event structure from the remote computing data source, the second event structure different from the first event structure;
transmitting the received second set of event data for analysis;
saving the transmitted second set of event data;
dynamically modifying the input schema in response to a determination that the second event structure of the saved second set of event data differs from the structure of the created input schema; and
providing, by the computer and for storage, an updated input schema as modified based on the saved second s

Assignees

• Dumant Bruno
• Le Biannic Yann
• Business Objects Software Ltd

Inventors

• Dumant Bruno
• Le Biannic Yann

Classifications

• G06F16/211 Primary

  Schema design and management · CPC title

• G06F16/25 Primary

  Integrating or interfacing systems involving database management systems · CPC title

• H04L67/10

  in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) · CPC title

• G06F16/213

  with details for schema evolution support · CPC title

• G06F16/21

  Design, administration or maintenance of databases · CPC title