Machine language query management for low-latency database analysis system

Patent metadata

Field	Value
Publication number	US-11429607-B2
Application number	US-202017024790-A
Country	US
Kind code	B2
Filing date	Sep 18, 2020
Priority date	Sep 20, 2019
Publication date	Aug 30, 2022
Grant date	Aug 30, 2022

Abstract

Data-query execution with distributed machine-language query management in a low-latency database analysis system may include obtaining, at a distributed in-memory database, a data-query expressing a request for data in a defined structured query language associated with the distributed in-memory database, automatically generating a high-level language query representing at least a portion of the data-query, obtaining a machine language query corresponding to the high-level language query, executing the machine language query to obtain results data, and outputting the results data. Obtaining the machine language query may include determining whether the machine language query is cached, and in response to a determination that the machine language query is unavailable, sending a request for the machine language query to a distributed machine-language-query management instance.

First claim

What is claimed is:

1. A method comprising:
obtaining, at a distributed in-memory database of a low-latency database analysis system, a data-query expressing a request for data in a defined structured query language associated with the distributed in-memory database;
automatically, by an in-memory database instance of the distributed in-memory database, generating a high-level language query representing at least a portion of the data-query;
obtaining, by the in-memory database instance, a machine language query corresponding to the high-level language query, wherein obtaining the machine language query includes:
determining whether a cached machine language query corresponding to the machine language query is available, wherein determining whether the cached machine language query is available includes determining whether the cached machine language query is cached in an in-memory cache of the in-memory database instance;
in response to a determination that the cached machine language query is available, obtaining the cached machine language query as the machine language query;
in response to a determination that the cached machine language query is unavailable, sending a request for the machine language query to a machine-language-query management instance of the low-latency database analysis system;
in response to a determination that the machine language query is available from the machine-language-query management instance, obtaining the machine language query from the machine-language-query management instance; and
in response to a determination that the machine language query is unavailable from the machine-language-query management instance, obtaining the machine language query by generating the machine language query;

executing, by the in-memory database instance, the machine language query to obtain results data; and
outputting the results data.

2. The method of claim 1 , wherein obtaining the cached machine language query includes:
in response to a determination that the in-memory cache of the in-memory database instance includes the cached machine language query, obtaining the cached machine language query from the in-memory cache of the in-memory database instance.

3. The method of claim 1 , wherein:
obtaining the machine language query includes generating, by the in-memory database instance, a hash value for the high-level language query;
determining whether the machine language query is cached in the in-memory cache of the in-memory database instance includes determining whether the machine language query is cached in the in-memory cache of the in-memory database instance using the hash value; and
sending the request includes identifying the machine-language-query management instance using the hash value.

4. The method of claim 1 , wherein obtaining the cached machine language query includes:
in response to a determination that the in-memory cache of the in-memory database instance omits the cached machine language query, sending a request for the cached machine language query to a persistent cache of the low-latency database analysis system; and
in response to a determination that the cached machine language query is available from the persistent cache, obtaining the cached machine language query from the persistent cache.

5. The method of claim 4 , wherein sending the request for the cached machine language query to the persistent cache includes including the high-level language query in the request for the cached machine language query.

6. The method of claim 4 , wherein obtaining the machine language query includes:
in response to a determination that the cached machine language query is unavailable from the persistent cache and in response to obtaining the machine language query, caching the machine language query in the persistent cache, by the in-memory database instance.

7. The method of claim 1 , wherein obtaining the machine language query includes:
in response to a determination that the in-memory cache of the in-memory database instance omits the cached machine language query and in response to obtaining the machine language query, by the in-memory database instance, caching the machine language query in the in-memory cache of the in-memory database instance.

8. The method of claim 1 , wherein sending the request for the machine language query includes sending the request for the machine language query such that:
in response to determining that the request for the machine language query omits a hash value for the high-level language query, the machine-language-query management instance generates the hash value for the high-level language query.

9. The method of claim 1 , wherein sending the request for the machine language query includes sending the request for the machine language query such that:
in response to accessing the request for the machine language query, the machine-language-query management instance:
determines whether the cached machine language query is available, wherein to determine whether the cached machine language query is available, the machine-language-query management instance determines whether the cached machine language query is cached in an in-memory cache of the machine-language-query management instance;
in response to a determination by the machine-language-query management instance that the cached machine language query is available, obtains the cached machine language query as the machine language query;
in response to a determination by the machine-language-query management instance that the cached machine language query is unavailable:
obtains the machine language query by generating the machine language query; and
in response to obtaining the machine language query, caches the machine language query in the in-memory cache of the machine-language-query management instance;

in response to a determination the machine language query is unavailable, outputs a response indicating that the machine language query is unavailable in response to the request for the machine language query; and
in response to obtaining the machine language query, outputs the machine language query in response to the request for the machine language query.

10. The method of claim 9 , wherein sending the request for the machine language query includes sending the request for the machine language query such that:
in response to a determination that the cached machine language query is cached in the in-memory cache of the machine-language-query management instance, the machine-language-query management instance obtains the cached machine language query from the in-memory cache of the machine-language-query management instance.

11. The method of claim 9 , wherein sending the request for the machine language query includes sending the request for the machine language query such that:
to obtain the cached machine language query, the in-memory cache of the machine-language-query management instance:
in response to a determination that the in-memory cache of the machine-language-query management instance omits the cached machine language query, sends a request for the cached machine language query to a persistent cache of the low-latency database analysis system; and
in response to a determination that the cached machine language query is available from the persistent cache, obtains the cached machine language query from the persistent cache.

12. The method of claim 11 , wherein sending the request for the machine language query includes sending the request for the machine language query such that:
to obtain the cached machine language query, the in-memory cache of the machine-language-query management instan

Assignees

• Thoughtspot Inc

Inventors

• Anand Ashok
• Shekhar Satyam
• Gaur Prateek
• Prakash Amit

Classifications

• G06F16/248

  Presentation of query results · CPC title

• G06F16/27

  Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor · CPC title

• G06F16/24539 Primary

  using cached or materialised query results · CPC title

• G06F16/24552

  Database cache management · CPC title

• G06F16/242

  Query formulation · CPC title