Optimizing tables with too many columns in a database

Patent metadata

Field	Value
Publication number	US-10331639-B2
Application number	US-201815897220-A
Country	US
Kind code	B2
Filing date	Feb 15, 2018
Priority date	May 22, 2015
Publication date	Jun 25, 2019
Grant date	Jun 25, 2019

Abstract

Systems for database optimization include a database rebuild module configured to compact columns in an unoptimized database that co-appear in queries to the unoptimized database into a single hyper-column to form an optimized database. A database interface module is configured to accept queries according to a schema for the unoptimized database and to translate the accepted queries into queries according to a schema for the optimized database.

First claim

The invention claimed is:

1. A system for database optimization, comprising:
a database rebuild module comprising a processor configured to compact a plurality of columns in an unoptimized database that co-appear in queries to the database into a single hyper-column to form an optimized database; and
a database interface module configured to accept queries according to a schema for the unoptimized database and to translate said accepted queries into queries according to a schema for the optimized database.

2. The system of claim 1 , wherein the plurality of columns co-appear in select clauses.

3. The system of claim 1 , wherein the plurality of columns co-appear in where clauses.

4. The system of claim 1 , wherein the database rebuild module is further configured to generate an index for the hyper-column.

5. The system of claim 4 , wherein entries for the hyper-column comprise only numerical data and wherein the index is an R-tree.

6. The system of claim 1 , wherein the database rebuild module is further configured to compress entries in the hyper-column if the entries in the hyper-column consist of textual data.

7. The system of claim 1 , wherein the database rebuild module is further configured to performing clustering across all columns in the database to detect columns that co-appear in queries.

8. The system of claim 7 , wherein the database rebuild module is further configured to perform clustering using an approximation of K-minimum cut.

9. The system of claim 1 , wherein the database interface module is further configured to provide a virtual view of the database according to the schema for the unoptimized database.

10. The system of claim 1 , further comprising representing the columns in the unoptimized database as a undirected graph, with nodes of the graph representing columns and with edges of the graph representing a co-appearing frequency for the connected columns.

11. The system of claim 1 , wherein each entry in the hyper-column comprises data from a corresponding entry in each of the plurality of columns.

12. A computer readable storage medium comprising a computer readable program for database optimization, wherein the computer readable program when executed on a computer causes the computer to perform the steps of:
compacting a plurality of columns in an unoptimized database that co-appear in queries to the database into a single hyper-column using a processor to form an optimized database; and
generating an interface for the optimized database that accepts queries according to a schema for the unoptimized database and translates said accepted queries into queries according to a schema for the optimized database.

Assignees

• IBM

Inventors

• Chen Yaoliang
• Gong Min
• Ma Caiqin
• Wang Yu
• Xu Xiaomin
• Yan Junchi

Classifications

• G06F16/24537

  of operators · CPC title

• H05K999/99

  Electricity · mapped topic

• G06F16/2282

  Tablespace storage structures; Management thereof · CPC title

• G06F16/221 Primary

  Column-oriented storage; Management thereof · CPC title

• G06F16/24544

  Join order optimisation · CPC title