Converting a language type of a query

Patent metadata

Field	Value
Publication number	US-11755560-B2
Application number	US-201816105308-A
Country	US
Kind code	B2
Filing date	Aug 20, 2018
Priority date	Dec 16, 2015
Publication date	Sep 12, 2023
Grant date	Sep 12, 2023

Abstract

A system may receive a query configured to access a column in a data table. The data table may be in a flat file in a big data storage format. The system may detect the language type of the query and validate the query against the syntax of the language type. The system may also validate an access permission for data in the data table. The access permission may be stored in a permissions database. The system may generate a temporary table including the column with the temporary table configured to support the language type. The system may execute the query against the temporary table to generate a query result based on the temporary table as though it were the underlying data table. The system may enforce column-level or row-level access permissions by excluding columns or rows from the temporary table.

First claim

What is claimed is:

1. A method comprising:
detecting, by a computing device, a first language type of a query configured to access a column in a data table, wherein the query is requested by a user;
determining, by the computing device, that the first language type does not conform with a data storage format of the data table;
converting, by the computing device, the query from the first language type to a second language type that conforms with the data storage format of the data table;
after converting the query to the second language type, generating, by the computing device, a temporary table including the column and excluding restricted data for which the user does not have an access permission by formatting the temporary table to support the second language type and be compliant with the access permission;
executing, by the computing device, the query against the temporary table to generate a query result; and
deleting, by the computing device, the temporary table after execution of the query against the temporary table.

2. The method of claim 1 , further comprising:
populating, by the computing device and in a permissions database, personally identifying information (PII) permissions based on a user role, a business group, and a user access demands; and
retrieving, by the computing device, the PII permissions from the permissions database, wherein the PII permissions indicate that a user executing the query has masked the PII permissions.

3. The method of claim 2 , further comprising masking, by the computing device, PII data included in the query result in response to the query result containing PII.

4. The method of claim 1 , further comprising retrieving, by the computing device, a row-level permission for a user submitting the query from a permissions database.

5. The method of claim 4 , wherein the temporary table excludes a row from the data table in response to the row-level permission.

6. The method of claim 1 , further comprising checking, by the computing device, that raw data ingestion is complete to maintain atomicity, consistency, isolation, and durability (ACID).

7. The method of claim 1 , further comprising:
determining, by the computing device, the column is unavailable in source data; and
populating, by the computing device, the column in the temporary table with null values.

8. The method of claim 1 , further comprising adding, by the computing device, at least one of a row or the column to the data table.

9. The method of claim 1 , further comprising updating, by the computing device, the access permission based on content of at least one of a row or the column added to the data table.

10. The method of claim 1 , further comprising receiving, by the computing device, the query configured to access the column in the data table.

11. The method of claim 1 , wherein the converting uses a query interpreter.

12. The method of claim 1 , wherein the second language type is supported by a unified data generation.

13. The method of claim 1 , wherein the generating the query result uses a unified data generation.

14. The method of claim 1 , wherein the access permission includes at least one of row-level permissions, column-level permissions, table-level permissions, file-level permissions or data-type-level permissions.

15. The method of claim 1 , further comprising validating, by the computing device, the access permission for data in the data table, wherein the access permission is stored in a permissions database.

16. The method of claim 1 , wherein the data table comprises flat files.

17. A computer-based system, comprising:
a processor; and
a tangible, non-transitory memory configured to communicate with the processor, the tangible, non-transitory memory having instructions stored thereon that, in response to execution by the processor, the processor to perform operations comprising:
detecting, by the processor, a first language type of a query configured to access a column in a data table, wherein the query is requested by a user;
determining, by the processor, that the first language type does not conform with a data storage format of the data table;
converting, by the processor, the query from the first language type to a second language type that conforms with the data storage format of the data table;
after converting the query to the second language type, generating, by the processor, a temporary table including the column and excluding restricted data for which the user does not have an access permission by formatting the temporary table to support the second language type and be compliant with the access permission;
executing, by the processor, the query against the temporary table to generate a query result; and
deleting, by the processor, the temporary table after execution of the query against the temporary table.

18. The system of claim 17 , further comprising updating, by the processor, the access permission based on content of at least one of a row or the column added to the data table.

19. The system of claim 17 , further comprising receiving, by the processor, the query configured to access the column in the data table.

20. An article of manufacture including a non-transitory, tangible computer readable storage medium having instructions stored thereon that, in response to execution by a processor, cause the processor to perform operations comprising:
detecting, by the processor, a first language type of a query configured to access a column in a data table, wherein the query is requested by a user;
determining, by the processor, that the first language type does not conform with a data storage format of the data table;
converting, by the processor, the query from the first language type to a second language type that conforms with the data storage format of the data table;
after converting the query to the second language type, generating, by the processor, a temporary table including the column and excluding restricted data for which the user does not have an access permission by formatting the temporary table to support the second language type and be compliant with the access permission;
executing, by the processor, the query against the temporary table to generate a query result; and
deleting, by the processor, the temporary table after execution of the query against the temporary table.

Assignees

• American Express Travel Related Services Co Inc

Inventors

• Arora Shubham
• Balaraman Balaji
• Bose Sandeep
• Chatterjee Arindam
• Durvasula Sastry
• Rana Manoj Kumar
• Sharma Nitish

Classifications

• G06F21/6227 Primary

  where protection concerns the structure of data, e.g. records, types, queries · CPC title

• G06F16/2365 Primary

  Ensuring data consistency and integrity · CPC title

• G06F16/248

  Presentation of query results · CPC title

• G06F16/176

  Support for shared access to files; File sharing support · CPC title

• G06F16/435

  Filtering based on additional data, e.g. user or group profiles · CPC title