Data extraction with user-configurable extract templates

Patent metadata

Field	Value
Publication number	US-2024095250-A1
Application number	US-202318517196-A
Country	US
Kind code	A1
Filing date	Nov 22, 2023
Priority date	Dec 28, 2020
Publication date	Mar 21, 2024
Grant date	—

Abstract

The described technology relates to systems and techniques for providing efficient and easy-to-use user-customizable extract templates for running queries against databases. The user-customizable extract templates enable customization of the same predefined query according to the requirements and privileges of respective users. In particular, embodiments enable customization of queries by users themselves, reducing or altogether eliminating having developers to modify the query or associated extract templates while still allowing the data owners or administrators to control access to the data.

First claim

1 . A system comprising:
at least one memory device configured to store an extract template for accessing data in a database, each extract template comprising a query to be run on the database, a set of input parameters and a set of output columns; and at least one processor configured to access the at least one memory device and to execute a data extract service program code, wherein the data extract service program code includes instructions which, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
receiving first configuration information from a first client device, wherein the first configuration information includes a subset, selected via a first user interface displayed by the first client device, of a set of input parameters of the extract template;
storing, in the at least one memory device, said first configuration information as an extract job template associated with the extract template;
publishing an application program interface (API) endpoint for a second client device to access the stored extract job template;
in response to a request message from the second client device received via the published API endpoint:
accessing the selected subset of the input parameters in the stored extract job template and transmitting a response message including information for displaying a second user interface enabling the second client device to obtain client-specified values to the selected subset of the input parameters;
receiving, from the second client device, client-specified values for one or more input parameters in the selected subset of the input parameters;
injecting, into the query, at least some of the received client-specified values to corresponding input parameters in the selected subset of the input parameters; and
running said query with the injected client-specified values; and
outputting results of said running of said query, the results including one or more output columns from the set of output columns in the extract template.

2 . The system according to claim 1 , wherein the first configuration information includes parameter requirement information associating a mandatory configuration setting and a dynamic configuration setting with at least one input parameter from the subset of input parameters, wherein the mandatory configuration setting associated with the at least one input parameter indicates whether it is mandatory to have a value for the at least one input parameter and the dynamic configuration setting associated with the at least one input parameter indicates whether the at least one input parameter is restricted to a corresponding value set in the extract job template, and wherein the operations further comprise, in response to the second request message, verifying said client-specified values against the parameter requirement information corresponding to each input parameter of the subset of input parameters.

3 . The system according to claim 2 , in response to the receiving said client-specified values, performing said running said query only when, for each input parameter in the subset of input parameters for which the corresponding mandatory configuration setting indicates that parameter as a mandatory parameter, a valid value is provided, and, for each input parameter in the subset of input parameters for which the corresponding dynamic configuration setting indicates that parameter as a non-dynamic parameter, using a value set for that parameter in the stored extract job template.

4 . The system according to claim 1 , wherein each said first request message and the second request message are received by an application programming interface (API) gateway service before being processed by the extract service program code.

5 . The system according to claim 1 , wherein the operations further comprise, in response to the second request message:
accessing the stored extract job template based on a first identifier for the API endpoint, wherein the first identifier is included in the second request message; validating at least one of said client-specified values for one or more input parameters in the selected subset of input parameters based on the stored extract job template; accessing the extract template based on a second identifier for the extract template, wherein the second identifier is included in the stored extract job template; and, before said running the query, using said validated client-specified values for the injecting.

6 . The system according to claim 5 , wherein the running said query is performed with a system-specified value for at least one input parameter in the selected subset of input parameters.

7 . The system according to claim 5 , wherein the validating comprises, for each input parameter in the selected subset of input parameters for which a corresponding mandatory configuration setting in the stored extract job template indicates that parameter as a mandatory parameter, a valid value is provided, and, for each input parameter in the subset of input parameters for which a corresponding dynamic configuration setting in the extract job template indicates that parameter as a non-dynamic parameter, using a value set for that parameter in the stored extract job template.

8 . The system according to claim 5 , wherein the using said validated client-specified values for the injecting comprises accessing the query in the extract template and injecting said validated client-specified values as input parameters of the query.

9 . The system according to claim 1 , wherein the set of input parameters and the set of output columns have one or more parameters in common.

10 . The system according to claim 1 , wherein the at least one memory device includes stored permission information comprising a first level of permission, a second level of permission that is lower than the first level of permission, and a third level of permission that is lower than the second level of permission, wherein at least the first level of permission is required for a client device to modify the one or more extract templates, and at least the second level of permissions is required for the client device to display the first user interface.

11 . The system according to claim 10 , wherein the operations further comprise, in response to receiving the first request message, checking user permission information stored in the at least one memory device to determine whether the first client device and/or a user of the first client device is assigned permissions sufficient to save the first configuration information.

12 . The system according to claim 1 , wherein the stored extract job template includes an identifier of the extract template.

13 . The system according to claim 1 , wherein the outputting results comprises, in response to one or more polling request messages from a client device, transmitting the results to the second client device.

14 . The system according to claim 1 , wherein the outputting results comprises storing the results or providing the results to another application.

15 . The system according to claim 1 , wherein the first user interface includes user-selectable inputs for said saving, said publishing, and unpublishing published API endpoints.

16 . The system according to claim 1 , wherein at least one of the input parameters in the set of input parameters is absent in the selected subset.

17 . A method comprising:
at a system that includes at least one processor, at least one network interface device, at least one memory device configured to store an

Assignees

• Nasdaq Tech Ab

Inventors

• Norrby Magnus
• Asllan Saker
• Havriuk Yulia
• Nilsson Mikael R

Classifications

• G06F16/2457 Primary

  with adaptation to user needs · CPC title

• G06F16/2379

  Updates performed during online database operations; commit processing · CPC title

• G06F16/2428 Primary

  Query predicate definition using graphical user interfaces, including menus and forms (G06F16/2423 takes precedence) · CPC title

• G06F16/252

  between a Database Management System and a front-end application · CPC title

• G06F16/245

  Query processing · CPC title