Hierarchical metadata enhancements for a memory management system

Patent metadata

Field	Value
Publication number	US-11347709-B2
Application number	US-202016878870-A
Country	US
Kind code	B2
Filing date	May 20, 2020
Priority date	Apr 1, 2020
Publication date	May 31, 2022
Grant date	May 31, 2022

Abstract

System, method, and various embodiments for providing a metadata based memory management system are described herein. An embodiment operates by determining metadata of a table of a database indicating whether data of the table is to be stored in memory or disk storage, wherein the table comprises a plurality of columns and a plurality of rows. A first column of the table is identified. A hierarchy of the metadata for the table including a column value, partition value, and table value is determined, wherein the column value is prioritized over the partition value, and wherein the partition value is prioritized over the table value. The data of the table stored in the column is loaded from the disk storage into the memory based on the hierarchy. A query is processed based on the data loaded into the memory.

First claim

What is claimed is:

1. A method comprising:
determining metadata of a table of a database indicating whether data of the table is to be loaded into memory from disk storage using either column load or page load, wherein the table comprises a plurality of columns and a plurality of rows;
identifying a first column of the table;
determining a conflict between metadata of the first column and metadata of the table, wherein the metadata of the first column indicates either the column load or the page load, and the metadata of the table indicates either the column load or the page load different from the metadata of the first column;
determining a hierarchy for resolving the conflict, wherein the metadata of the first column is prioritized over the metadata of the table;
resolving the conflict based on the hierarchy;
loading the data of the table stored in the column from the disk storage into the memory based on the metadata of the first column as indicated based on the resolving; and
processing a query based on the data loaded into the memory.

2. The method of claim 1 , wherein the table is divided into two or more partitions.

3. The method of claim 2 , wherein the loading is based on the partition value corresponding to a particular one of the partitions, wherein the partition value is different from the table value.

4. The method of claim 2 , wherein the partition value for a first one of the two or more partitions is different from a partition value for a second one of the two or more partitions, and wherein the data of the table stored in the column spans both the first partition and the second partition.

5. The method of claim 2 , wherein first partition of the two or more partitions is associated with metadata different from either the metadata of the column or the metadata of the table.

6. The method of claim 1 , wherein the loading is based on the column value corresponding to the first column, wherein the column value is different from the table value.

7. The method of claim 6 , wherein the metadata comprises non-uniform memory access (NUMA) values that indicates a particular node on which to store the data of the table of the column.

8. The method of claim 1 , wherein the metadata comprises a column load value that indicates all of the data of a particular column, partition, or table is moved from the disk storage into memory.

9. The method of claim 7 , wherein the metadata comprises a page load value that indicates only a portion of the data of a particular column, partition, or table is moved from the disk storage into memory.

10. A system comprising:
a memory; and

at least one processor coupled to the memory and configured to perform operations comprising:
determining metadata of a table of a database indicating whether data of the table is to be loaded into memory from disk storage using either column load or page load, wherein the table comprises a plurality of columns and a plurality of rows;
identifying a first column of the table;
determining a conflict between metadata of the first column and metadata of the table, wherein the metadata of the first column indicates either the column load or the page load, and the metadata of the table indicates either the column load or the page load different from the metadata of the first column;
determining a hierarchy for resolving the conflict, wherein the metadata of the first column is prioritized over the metadata of the table;
resolving the conflict based on the hierarchy;
loading the data of the table stored in the column from the disk storage into the memory based on the metadata of the first column as indicated based on the resolving; and
processing a query based on the data loaded into the memory.

11. The system of claim 10 , wherein the table is divided into two or more partitions.

12. The system of claim 11 , wherein the loading is based on the partition value corresponding to a particular one of the partitions, wherein the partition value is different from the table value.

13. The system of claim 11 , wherein the partition value for a first one of the two or more partitions is different from a partition value for a second one of the two or more partitions, and wherein the data of the table stored in the column spans both the first partition and the second partition.

14. The system of claim 10 , wherein the loading is based on the column value corresponding to the first column, wherein the column value is different from the table value.

15. The system of claim 14 , wherein the metadata comprises non-uniform memory access (NUMA) values that indicates a particular node on which to store the data of the table of the column.

16. The system of claim 10 , wherein the metadata comprises a column load value that indicates all of the data of a particular column, partition, or table is moved from the disk storage into memory.

17. The system of claim 16 , wherein the metadata comprises a page load value that indicates only a portion of the data of a particular column, partition, or table is moved from the disk storage into memory.

18. A non-transitory computer-readable device having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:
determining metadata of a table of a database indicating whether data of the table is to be loaded into memory from disk storage using either column load or page load, wherein the table comprises a plurality of columns and a plurality of rows;
identifying a first column of the table;
determining a conflict between metadata of the first column and metadata of the table, wherein the metadata of the first column indicates either the column load or the page load, and the metadata of the table indicates either the column load or the page load different from the metadata of the first column;
determining a hierarchy for resolving the conflict, wherein the metadata of the first column is prioritized over the metadata of the table;
resolving the conflict based on the hierarchy;
loading the data of the table stored in the column from the disk storage into the memory based on the metadata of the first column as indicated based on the resolving; and
processing a query based on the data loaded into the memory.

19. The device of claim 18 , wherein the table is divided into two or more partitions.

20. The device of claim 19 , wherein the loading is based on the partition value corresponding to a particular one of the partitions, wherein the partition value is different from the table value.

Assignees

• Sap Se

Inventors

• Basak Nirvik
• Pal Souvik
• Gottipati Chaitanya
• Saonerkar Amit
• Ghosh Prasanta
• Andrei Mihnea
• May Norman

Classifications

• G06F16/245

  Query processing · CPC title

• G06F16/2282 Primary

  Tablespace storage structures; Management thereof · CPC title