Shadow experiments for serverless multi-tenant cloud services

Patent metadata

Field	Value
Publication number	US-12124454-B2
Application number	US-202016984411-A
Country	US
Kind code	B2
Filing date	Aug 4, 2020
Priority date	Aug 4, 2020
Publication date	Oct 22, 2024
Grant date	Oct 22, 2024

Abstract

Aspects of the present invention disclose a method, computer program product, and system for query execution in a multi-tenant cloud service. The method includes one or more processors determining category classes for service queries. The method further includes sending for execution, a selected number of service queries from one of the determined category classes to a shadow query engine. Respective service queries of the categorically classified service queries comprise a different set of configuration parameter values for the shadow query engine. The method further includes recording metadata for the selected number of service queries of the one category class executed on said shadow query engine. The method further includes determining correlations between the recorded metadata. The method further includes determining, from the determined correlations, optimal configuration parameter values comprising optimal configuration parameters for executing the selected number of service queries of the one category classes.

First claim

What is claimed is:

1. A computer-implemented method for query execution in a multi-tenant cloud service, the method comprising:
sending, by one or more processors, for execution, a selected number of service queries from a particular category class of one or more category classes to a shadow query engine, wherein service queries of the selected number of service queries comprise a different set of configuration parameter values;
recording, by the one or more processors, metadata for the selected number of service queries of the particular category class executed on the shadow query engine, wherein the metadata comprises performance data, a query category class, and at least one value of related configuration parameter values;
determining, by the one or more processors, one or more correlations between the metadata;
applying, by the one or more processors, a configuration to an extended set of service queries of a same category class on the shadow query engine based on a determined set of optimal hardware/software configuration parameter values for the first selected number of service queries from the particular category class, wherein the determined set of optimal hardware/software configuration parameter values is based on the determined one or more correlations between the metadata;
responsive to applying the configuration to the extended set of service queries, validating, by the one or more processors, that the configuration applied to the extended set of service queries of the same category class on the shadow query engine has a positive result; and
responsive to validating that the result is positive, executing, by the one or more processors, on an active query engine while the active query engine is in use, future queries of the same category, wherein the active query engine has identical characteristics to the shadow query engine, and is configured with the determined set of optimal hardware/software configuration parameter values of the shadow query engine,
wherein the determined set of optimal hardware/software configuration parameter values are determined by the shadow query engine during idle times of a cloud computing environment associated with the multi-tenant cloud service, and
wherein the determined set of optimal configuration parameter values are the identical characteristics of the active query engine and the shadow query engine.

2. The computer-implemented method of claim 1 , wherein the configuration parameters comprise at least one selected from the group consisting of a memory size, a buffer size, serialization options, a compression parameter value, networking parameter values, scheduling specific values, and execution options values.

3. The computer-implemented method of claim 1 , wherein the service queries are related to a database query.

4. The computer-implemented method of claim 1 , wherein the selected number of service queries of the one category class originates from one group of users.

5. The computer-implemented method of claim 1 , wherein the extended set of service queries originates from more than one group of users.

6. The computer-implemented method of claim 1 , wherein the one or more category classes relate to data definition operations.

7. The computer-implemented method of claim 6 , further comprising:
selecting, by the one or more processors, the shadow query engine out of a set of spare query engines in an over-provisioned cloud computing environment.

8. The computer-implemented method of claim 1 , wherein the optimal configuration hardware/software parameter values reflect at least one operation constraint selected from the group consisting of latency, throughput, and resource usage.

9. The computer-implemented method of claim 1 , further comprising:
determining, by the one or more processors, the one or more category classes by applying a machine-learning based system to a set of historical queries for the query engine.

10. A computer program product for query execution in a multi-tenant cloud service, the computer program product comprising:
one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising:
program instructions to send for execution, a selected number of service queries from a particular category class of one or more category classes to a shadow query engine, wherein service queries of the selected number of service queries comprise a different set of configuration parameter values;
program instructions to record metadata for the selected number of service queries of the particular category class executed on the shadow query engine, wherein the metadata comprises performance data, a query category class, and at least one value of related configuration parameter values;
program instructions to determine one or more correlations between the metadata;
program instructions to apply a configuration to an extended set of service queries of a same category class on the shadow query engine based on a determined set of optimal hardware/software configuration parameter values for the first selected number of service queries from the particular category class, wherein the determined set of optimal hardware/software configuration parameter values is based on the determined one or more correlations between the metadata;
responsive to applying the configuration to the extended set of service queries, program instructions to validate that the configuration applied to the extended set of service queries of the same category class on the shadow query engine has a positive result; and
responsive to validating that the result is positive, program instructions to execute, on an active query engine while the active query engine is in use, future queries of the same category, wherein the active query engine has identical characteristics to the shadow query engine, and is configured with the determined set of optimal hardware/software configuration parameter values of the shadow query engine,
wherein the determined set of optimal hardware/software configuration parameter values are determined by the shadow query engine during idle times of a cloud computing environment associated with the multi-tenant cloud service, and
wherein the determined set of optimal hardware/software configuration parameter values are the identical characteristics of the active query engine and the shadow query engine.

11. The computer program product of claim 10 , wherein the configuration parameters comprise at least one selected from the group consisting of a memory size, a buffer size, serialization options, a compression parameter value, networking parameter values, scheduling specific values, and execution options values.

12. The computer program product of claim 10 , wherein the service queries are related to a database query.

13. A computer system for query execution in a multi-tenant cloud service, the computer system comprising:
one or more computer processors;
one or more computer readable storage media; and
program instructions stored on the computer readable storage media for execution by at least one of the one or more processors, the program instructions comprising:
program instructions to send for execution, a selected number of service queries from a particular category class of one or more category classes to a shadow query engine, wherein service queries of the selected number of service queries comprise a different set of optimal hardware/software configuration parameter values;
program instructions to record metadata for the first selected number of service queries of the particular category class exec

Assignees

• IBM

Inventors

• Möhler Gregor
• Koeth Oliver
• Kussmaul Timo
• Haide Michael
• Steinbach Torsten
• Eckert Alexander
• Vittal Sachin Lingadahalli
• Behrendt Michael
• Kohler Manuela

Classifications

• G06F16/244 Primary

  Grouping and aggregation · CPC title

• G06F16/248

  Presentation of query results · CPC title

• G06F16/284

  Relational databases · CPC title

• G06F16/256

  in federated or virtual databases · CPC title

• G06F16/24573

  using data annotations, e.g. user-defined metadata · CPC title