Data export job engine

Patent metadata

Field	Value
Publication number	US-10977262-B2
Application number	US-201715667589-A
Country	US
Kind code	B2
Filing date	Aug 2, 2017
Priority date	Aug 2, 2017
Publication date	Apr 13, 2021
Grant date	Apr 13, 2021

Abstract

In one embodiment, the present disclosure pertains to a data export job engine. A data export architecture may include jobs comprising a plurality of tasks configured in series. In one example embodiment, the jobs may correspond to particular data visualizations to be downloaded. In another embodiment, data visualizations in a user interface display may be created from remote data. Portions of the remote data may be downloaded to a local computer to recreate the data visualizations without the need for remote data requests.

First claim

What is claimed is:

1. A method comprising:
creating, by a first widget on a web browser running on a first computer system, a first data visualization on a first web page using first data stored remotely on one or more second computer systems, wherein the first data visualization is of a first visualization type of a plurality of visualization types, the first widget is optimized for the first visualization type, and the plurality of visualization types include at least one of table, chart, and geospatial data types;
receiving a first input from a user to download a copy of the first data from the second computer systems;
generating, by the first widget, a first data retrieval task, a first data conversion task, and a first data persistence task;
receiving, by the first data retrieval task, a query model that represents a remote query on remote data to retrieve the first data, and in accordance therewith, generating a data request specifying one or more queries on the second computer systems;
converting, by the first data conversion task, arrays of the first data received from the data retrieval task in a first format to a second format;
converting, by the first data persistence task, the first data in the second format to a binary format;
storing the first data in the binary format in memory on the first computer system;
recreating, by the first widget, the first data visualization using the stored first data;
creating, by a second widget on the web browser running on the first computer system, a second data visualization on a second web page using second data stored remotely on the second computer systems, wherein the second data visualization is of a second visualization type of the plurality of visualization types and the second widget is optimized for the second visualization type; and
generating, by the second widget, a second data retrieval task, a second data conversion task, and a second data persistence task responsive to a second user input to store a copy of the second data on the first computer system.

2. The method of claim 1 wherein the receiving the query model and generating the data request further comprises generating a query manager object based on the query model to communicate with the one or more second computer systems, wherein the query manager object generated based on the query model corresponds to a state of another query manager object at a time the request to export data was received.

3. The method of claim 1 wherein the first data retrieval task comprises a query export task that communicates with the second computer systems using a hypertext transfer protocol (HTTP) and data is received by the query export task one page at a time.

4. The method of claim 3 wherein the first data retrieval task further comprises a data parser task coupled to an output of the query export task, wherein the data parser task receives a data structure comprising one or more tables from the query export task, wherein the method further comprises, by the data parser task:
parsing the table;
identifying data values in the table;
accessing formatting information for the data values; and
generating one or more arrays of formatted data.

5. The method of claim 1 wherein the first data retrieval task comprises a data streaming task having an output coupled to the data conversion task, the data streaming task communicating with the second computer systems using a transmission control protocol (TCP) to produce arrays of formatted data as a stream of packets from one or more servers in response to sending the data request.

6. The method of claim 1 wherein the data request comprises a data set identification, a query model, and one or more data filters, wherein
the data set identification identifies one or more remote data sets in the remote data,
the query model represents a remote query on the remote data, and
the data filters are particular filters used to produce the data to be exported.

7. The method of claim 6 wherein the first data retrieval task receives the data set identification, the query model, and the data filters to initiate one or more remote queries.

8. A system comprising:
a processor; and
a memory coupled to the processor, the memory storing instructions executable by the processor to perform a method, the method comprising:
creating, by a first widget on a web browser running on a first computer system, a first data visualization on a first web page using first data stored remotely on one or more second computer systems, wherein the first data visualization is of a first visualization type of a plurality of visualization types, the first widget is optimized for the first visualization type, and the plurality of visualization types include at least one of table, chart, and geospatial data types;
receiving a first input from a user to download a copy of the first data from the second computer systems;
generating, by the first widget, a first data retrieval task, a first data conversion task, and a first data persistence task;
receiving, by the first data retrieval task, a query model that represents a remote query on remote data to retrieve the first data, and in accordance therewith, generating a data request specifying one or more queries on the second computer systems;
converting, by the first data conversion task, arrays of the first data received from the data retrieval task in a first format to a second format;
converting, by the first data persistence task, the first data in the second format to a binary format;
storing the first data in the binary format in memory on the first computer system;
recreating, by the first widget, the first data visualization using the retrieved stored first data;
creating, by a second widget on the web browser running on the first computer system, a second data visualization on a second web page using second data stored remotely on the second computer systems, wherein the second data visualization is of a second visualization type of the plurality of visualization types and the second widget is optimized for the second visualization type; and
generating, by the second widget, a second data retrieval task, a second data conversion task, and a second data persistence task responsive to a second user input to store a copy of the second data on the first computer system.

9. The method of claim 8 further comprising repeating said initiating the first query, receiving the at least one single row of data, determining the number of cells per row, and initiating the second query to retrieve different data from different data sets.

10. The method of claim 8 wherein the second computer systems comprise a cloud computer system.

11. The method of claim 8 wherein the second computer systems comprise an on-prem computer system.

12. The method of claim 8 wherein the first data is visualization data.

13. A non-transitory machine-readable medium storing a program executable by at least one processing unit of a device, the program comprising sets of instructions for:
creating, by a first widget on a web browser running on a first computer system, a first data visualization on a first web page using first data stored remotely on one or more second computer systems, wherein the first data visualization is of a first visualization type of a plurality of visualization types, the first widget is optimized for the first visualization type, and the plurality of visualization types include at least one of table, chart, and geospatial data types;
receiving a first input from a user to download a copy of the first data from the second computer systems;
generating, by the first widget, a fi

Assignees

• Sap Se

Inventors

• Bolognese Christopher
• Kohan Anthony
• Tiu Jonathan
• Om Sae-Won

Classifications

• H04L67/131 Primary

  Protocols for games, networked simulations or virtual reality · CPC title

• G06F16/26

  Visual data mining; Browsing structured data · CPC title

• G06F16/258

  Data format conversion from or to a database · CPC title

• G06F16/22

  Indexing; Data structures therefor; Storage structures · CPC title

• G06F16/2455

  Query execution · CPC title