Runtime data persistency for in-memory database systems

Patent metadata

Field	Value
Publication number	US-10853343-B2
Application number	US-201715596603-A
Country	US
Kind code	B2
Filing date	May 16, 2017
Priority date	May 16, 2017
Publication date	Dec 1, 2020
Grant date	Dec 1, 2020

Abstract

Systems, apparatus, techniques, articles, and methods include a unified table container for storing data and metadata in pages organized in one or more page chains. A determination is made as to whether the query includes a data definition statement. In response to determining that the query includes a data definition statement, in-memory runtime data is persisted to a persistent volume that is configured to be accessed by the database system. The in-memory runtime data includes one or more first data fields and one or more second data fields that are different from the one or more first data fields. Furthermore, the unified table container includes a persistent runtime data descriptor that is associated with the one or more first data fields and persists the first one or more first data fields when persisting the in-memory runtime data.

First claim

What is claimed is:

1. A computer-implemented method for in-memory persistent runtime data within a database system, the method comprising:
receiving a query by at least one data processor of a database system, the database system including a table container, the table container storing data and metadata in pages organized in one or more page chains;
determining, by the at least one data processor, whether the query includes a data definition statement that updates or changes in-memory runtime data;
in response to the determining that the query includes a data definition statement, copying, by the at least one data processor, the in-memory runtime data to a persistent volume, the persistent volume being configured to be accessed by the database system;

wherein:
the in-memory runtime data includes one or more first data fields comprising persistent data fields and one or more second data fields comprising non-persistent data fields, the one or more first data fields being different from the one or more second data fields; and
the table container includes a persistent runtime data descriptor that is associated with the persistent data fields and persists the one or more second data fields by copying each field of the non-persistent data fields to a field associated with the persistent runtime data descriptor.

2. The method of claim 1 , wherein the persisting in-memory runtime data to a persistent volume includes the copying of each field of the one or more first data fields to the field associated with the persistent runtime data descriptor prior to copying the one or more second data fields into the database system.

3. The method of claim 1 , further comprising in response to the copying, generating a redo log or a undo log or both.

4. The method of claim 3 , wherein the redo log is configured to, upon replaying, generate the one or more first data fields of the in-memory runtime data in memory of the system database following a crash of the database system.

5. The method of claim 3 , wherein the undo log is configured to, upon replaying, undo changes to the one or more first data fields of the in-memory runtime data in memory of the database following a rollback of the data definition statement.

6. The method of claim 1 , further comprising loading the one or more first data fields from a disk into in-memory of the database system.

7. The method of claim 1 , further comprising loading the table container for accessing the one or more first data fields loaded in-memory of the database system.

8. The method of claim 1 , wherein the one or more first data fields and the one or more second data fields are used to store statistical table information for a table included in the database system.

9. The method of claim 8 , wherein the runtime statistical table information of a table includes the number of rows in the table, the number of used column ids associated with the table, memory consumption by the table and combinations thereof.

10. The method of claim 1 , wherein the query includes a data definition statement, a data manipulation statement, a data control statement, or a combination thereof.

11. The method of claim 10 , wherein the data definition statement includes a data definition language (DDL) command.

12. The method of claim 1 , wherein the table container includes a persistent column descriptor that includes a bit associated with a column object included in the in-memory runtime data.

13. The method of claim 12 , wherein the bit included in the persistent column descriptor is set to a value when copying the in-memory runtime data, the value denoting that the column object associated with the bit is a single valued column object.

14. The method of claim 1 , further comprising in response to loading a table object into memory, determining whether the loaded table object includes one or more single valued column objects.

15. The method of claim 14 , further comprising in response to determining that the loaded table object includes one or more single valued column objects, extracting a single value from each of the one or more single valued column objects;
storing the extracted single value as a single value field in the in-memory runtime data; and
associating the single value field with the corresponding single valued column object.

16. A computer-implemented system for in-memory persistent runtime data within a database system, the computer-implemented system comprising:
one or more data processors; and
memory storing instructions which, when executed by the one or more data processors, result in operations comprising:
receiving a query by at least one data processor of a database system, the database system including a table container, the table container storing data and metadata in pages organized in one or more page chains;
determining whether the query includes a data definition statement that updates or changes in-memory runtime data;
in response to the determining that the query includes a data definition statement, copying the in-memory runtime data to a persistent volume, the persistent volume being configured to be accessed by the database system;

wherein:
the in-memory runtime data includes one or more first data fields comprising persistent data fields and one or more second data fields comprising non-persistent data fields, the one or more first data fields being different from the one or more second data fields; and
the table container includes a first persistent runtime data descriptor that is associated with the persistent data fields and persists the one or more second data fields by copying each field of the non-persistent data fields to a field associated with the persistent runtime data descriptor.

17. A non-transitory computer program product for in-memory persistent runtime data within a database system, the non-transitory computer program product storing instructions which, when executed by one or more data processors of one or more computing devices, cause at least one data processor to perform operations comprising:
receiving a query by at least one data processor of a database system, the database system including a table container, the table container storing data and metadata in pages organized in one or more page chains;
determining whether the query includes a data definition statement that updates or changes in-memory runtime data;
in response to the determining that the query includes a data definition statement, copying the in-memory runtime data to a persistent volume, the persistent volume being configured to be accessed by the database system;
wherein:
the in-memory runtime data includes one or more first data fields comprising persistent data fields and one or more second data fields comprising non-persistent data fields, the one or more first data fields being different from the one or more second data fields;
the table container includes a persistent runtime data descriptor that is associated with the persistent data fields and persists the one or more second data fields by copying each field of the non-persistent data fields to a field associated with the persistent runtime data descriptor; and
the query is defined in at least one of a multidimensional query language, a graph query and manipulation language, or a structure query language.

18. The computer-implemented system of claim 16 , wherein the table container further comprises a pointer to the persistent runtime data descriptor.

19. The computer-implemented system of claim 16 , wherein (i) the table conta

Assignees

• Sap Se

Inventors

• Muehle Michael
• Gottipati Chaitanya
• Basak Nirvik
• Andrei Mihnea

Classifications

• G06F16/245 Primary

  Query processing · CPC title

• G06F16/2282 Primary

  Tablespace storage structures; Management thereof · CPC title