Data extraction with user-configurable extract templates

Patent metadata

Field	Value
Publication number	US-2022207034-A1
Application number	US-202017135289-A
Country	US
Kind code	A1
Filing date	Dec 28, 2020
Priority date	Dec 28, 2020
Publication date	Jun 30, 2022
Grant date	—

Abstract

The described technology relates to systems and techniques for providing efficient and easy-to-use user-customizable extract templates for running queries against databases. The user-customizable extract templates enable customization of the same predefined query according to the requirements and privileges of respective users. In particular, embodiments enable customization of queries by users themselves, reducing or altogether eliminating having developers to modify the query or associated extract templates while still allowing the data owners or administrators to control access to the data.

First claim

1 . A system comprising:
at least one memory device configured to store an extract template for accessing data in a database, each extract template comprising a query to be run on the database, a set of input parameters and a set of output columns; and at least one processor configured to access the at least one memory device and to execute a data extract service program code, wherein the data extract service program code includes instructions which, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
in response to a first request message from a first client device, accessing the extract template in the at least one memory device and transmitting a first response message including information for displaying a first user interface enabling selection of a subset of the set of input parameters of the extract template;
receiving first configuration information including at least a selected subset of the set of input parameters from the first client device;
saving, in the at least one memory device, said first configuration information as an extract job template associated with the extract template;
publishing an application program interface (API) endpoint for a second client device to access the saved extract job template;
in response to a second request message from the second client device received via the published API endpoint, running said query with client-specified values for one or more input parameters in the selected subset of input parameters; and
outputting results of said running of said query, the results including one or more output columns from the set of output columns in the extract template.

2 . The system according to claim 1 , wherein the first configuration information includes parameter requirement information associating a mandatory configuration setting and a dynamic configuration setting with at least one input parameter from the subset of input parameters, and wherein the operations further comprise, in response to the second request message, verifying said client-specified values against the parameter requirement information corresponding to each input parameter of the subset of input parameters.

3 . The system according to claim 2 , in response to receiving said client-specified values, performing said running said query only when, for each input parameter in the subset of input parameters for which the corresponding mandatory configuration setting indicates that parameter as a mandatory parameter, a valid value is provided, and, for each input parameter in the subset of input parameters for which the corresponding dynamic configuration setting indicates that parameter as a non-dynamic parameter, using a value set in the extract job template.

4 . The system according to claim 1 , wherein the operations further comprise, in response to the second request message, accessing the extract job template and transmitting a second response message including information for enabling the second client device to provide said client-specified values to the subset of the input parameters.

5 . The system according to claim 1 , wherein the operations further comprise, in response to the second request message:
accessing the extract job template based on a first identifier for the API endpoint, wherein the first identifier is included in the second request message; validating at least one of said client-specified values for one or more input parameters in the selected subset of input parameters based on the extract job template; accessing the extract template based on a second identifier for the extract template, wherein the second identifier is included in the extract job template; and, before said running the query, generating the query using said validated client-specified values.

6 . The system according to claim 5 , wherein the running said query is performed with a system-specified value for at least one input parameter in the subset of input parameters.

7 . The system according to claim 5 , wherein the validating comprises, for each input parameter in the subset of input parameters for which a corresponding mandatory configuration setting in the extract job template indicates that parameter as a mandatory parameter, a valid value is provided, and, for each input parameter in the subset of input parameters for which a corresponding dynamic configuration setting in the extract job template indicates that parameter as a non-dynamic parameter, using a value set in the extract job template.

8 . The system according to claim 5 , wherein the generating comprises accessing the query in the extract template and injecting said validated client-specified values as input parameters of the query.

9 . The system according to claim 1 , wherein the set of input parameters and the set of output columns have one or more parameters in common.

10 . The system according to claim 1 , wherein the at least one memory device includes stored permission information comprising a first level of permission, a second level of permission that is lower than the first level of permission, and a third level of permission that is lower than the second level of permission, wherein at least the first level of permission is required for a client device to modify the one or more extract templates, and at least the second level of permissions is required for the client device to display the first user interface.

11 . The system according to claim 10 , wherein the operations further comprise, in response to receiving the first request message, checking user permission information stored in the at least one memory device to determine whether the first client device and/or a user of the first client device is assigned permissions sufficient to save the configuration information.

12 . The system according to claim 1 , wherein the extract job template includes an identifier of the extract template.

13 . The system according to claim 1 , wherein the outputting results comprises, in response to one or more polling request messages from a client device, transmitting the results to the second client device.

14 . The system according to claim 1 , wherein the outputting results comprises storing the results or providing the results to another application.

15 . The system according to claim 1 , wherein the first user interface includes user-selectable inputs for said saving, said publishing, and unpublishing published API endpoints.

16 . The system according to claim 1 , wherein each said first request message and the second request message are received by an application programming interface (API) gateway service before being processed by the extract service program code.

17 . A method comprising:
at a system that includes at least one memory device, at least one processor, and at least one network interface device:
in response to a first request message from a first client device, accessing an extract template and transmitting a first response message including information for displaying a first user interface enabling selection of a subset of the set of input parameters of the extract template, wherein the at least one memory device stores one or more data extract templates for accessing data in a database, each data extract template comprising a query to be run on the database, a set of input parameters and a set of output parameters;
receiving first configuration information including at least a selected subset of the set of input parameters from the first client device;
saving, in the at least one memory device, said first con

Assignees

• Nasdaq Tech Ab

Inventors

• Norrby Magnus
• Asllan Saker
• Havriuk Yulia
• Nilsson Mikael R

Classifications

• G06F16/245

  Query processing · CPC title

• G06F16/2379

  Updates performed during online database operations; commit processing · CPC title

• G06F16/2457 Primary

  with adaptation to user needs · CPC title

• G06F16/2428 Primary

  Query predicate definition using graphical user interfaces, including menus and forms (G06F16/2423 takes precedence) · CPC title

• G06F16/252

  between a Database Management System and a front-end application · CPC title