Transaction private log buffering for high performance of transaction processing

Patent metadata

Field	Value
Publication number	US-9558229-B2
Application number	US-201414244686-A
Country	US
Kind code	B2
Filing date	Apr 3, 2014
Priority date	Nov 26, 2013
Publication date	Jan 31, 2017
Grant date	Jan 31, 2017

Abstract

For each data change occurring transaction created as part of a write operation initiated for one or more tables in a main-memory-based DBMS, a transaction log entry can be written to a private log buffer corresponding to the transaction. All transaction log entries in the private log buffer can be flushed to a global log buffer upon completion of the transaction to which the private log buffer corresponds.

First claim

What is claimed is:

1. A computer program product comprising a non-transitory machine-readable medium storing instructions that, when executed by at least one programmable processor, cause the at least one programmable processor to perform operations comprising:
creating one or more transactions as part of a write operation initiated for one or more tables in a main-memory-based database management system, wherein the one or more tables in the main-memory-based database management system are stored in memory;
writing, for each data change occurring during a transaction of the one or more transactions, a transaction log entry to a private log buffer, the private log buffer corresponding to the transaction;
flushing all transaction log entries in the private log buffer to a global log buffer, when the main-memory-based database management system has processed one or more data manipulation language statements comprising the transaction to which the private log buffer corresponds; and
flushing, to a non-volatile storage, all transaction log entries in the global log buffer, the flushing of all the transaction log entries in the global log buffer to the non-volatile storage performed during a commit operation committing the changes relating to the write operation, the flushing of all the transaction log entries in the global log buffer to the non-volatile storage during the commit operation resulting in fewer input/output operations to the non-volatile storage for transaction logging than writing the transaction log entries directly to the non-volatile storage.

2. A computer program product as in claim 1 , wherein the operations further comprise receiving a data manipulation workload from a client machine, the data manipulation workload relating to the write operation.

3. A computer program product as in claim 2 , wherein the data manipulation workload comprises statements in a data manipulation language.

4. A computer program product as in claim 1 , wherein the transaction log entry comprises a redo log entry, and the redo log entry is applied when the redo log entry has a higher savepoint count than a savepoint count of a data page affected by the transaction.

5. A system comprising:
at least one processor; and
at least one memory including program code which when executed by the at least one processor provides operations comprising:
creating one or more transactions as part of a write operation initiated for one or more tables in a main-memory-based database management system, wherein the one or more tables in the main-memory-based database management system are stored in memory;
writing, for each data change occurring during a transaction of the one or more transactions, a transaction log entry to a private log buffer, the private log buffer corresponding to the transaction;
flushing all transaction log entries in the private log buffer to a global log buffer, when the main-memory-based database management system has processed one or more data manipulation language statements comprising the transaction to which the private log buffer corresponds; and
flushing, to a non-volatile storage, all transaction log entries in the global log buffer, the flushing of all the transaction log entries in the global log buffer to the non-volatile storage performed during a commit operation committing the changes relating to the write operation, the flushing of all the transaction log entries in the global log buffer to the non-volatile storage during the commit operation resulting in fewer input/output operations to the non-volatile storage for transaction logging than writing the transaction log entries directly to the non-volatile storage.

6. A system as in claim 5 , wherein the operations further comprise receiving a data manipulation workload from a client machine, the data manipulation workload relating to the write operation.

7. A system as in claim 6 , wherein the data manipulation workload comprises statements in a data manipulation language.

8. A system as in claim 5 , wherein the transaction log entry comprises a redo log entry, and the redo log entry is applied when the redo log entry has a higher savepoint count than a savepoint count of a data page affected by the transaction.

9. A system as in claim 5 , wherein the computer hardware comprises a programmable processor, and a machine-readable medium storing instructions that, when executed by the programmable processor, cause the at least one programmable processor to perform at least some of the operations.

10. A computer-implemented method comprising:
creating one or more transactions as part of a write operation initiated for one or more tables in a main-memory-based database management system, wherein the one or more tables in the main-memory-based database management system are stored in memory;
writing, for each data change occurring during a transaction of the one or more transactions, a transaction log entry to a private log buffer, the private log buffer corresponding to the transaction;
flushing all transaction log entries in the private log buffer to a global log buffer, when the main-memory-based database management system has processed one or more data manipulation language statements comprising the transaction to which the private log buffer corresponds; and
flushing, to a non-volatile storage, all transaction log entries in the global log buffer, the flushing of all the transaction log entries in the global log buffer to the non-volatile storage performed during a commit operation committing the changes relating to the write operation, the flushing of all the transaction log entries in the global log buffer to the non-volatile storage during the commit operation resulting in fewer input/output operations to the non-volatile storage for transaction logging than writing the transaction log entries directly to the non-volatile storage.

11. A computer-implemented method as in claim 10 , further comprising receiving a data manipulation workload from a client machine, the data manipulation workload relating to the write operation.

12. A computer-implemented method as in claim 11 , wherein the data manipulation workload comprises statements in a data manipulation language.

13. A computer-implemented method as in claim 10 , wherein the transaction log entry comprises a redo log entry, and the redo log entry is applied when the redo log entry has a higher savepoint count than a savepoint count of a data page affected by the transaction.

14. A computer-implemented method as in claim 10 , wherein the creating, the writing, the flushing to the global log buffer, and the flushing to the non-volatile memory comprise operations performed by computer hardware.

Assignees

• Lee Juchang
• Kim Beomsoo
• Kim Kyu Hwan
• Noh Jaeyun
• Cha Sang Kyun
• Sap Se

Inventors

• Lee Juchang
• Kim Beomsoo
• Kim Kyu Hwan
• Noh Jaeyun
• Cha Sang Kyun

Classifications

• G06F16/2358 Primary

  Change logging, detection, and notification (replication G06F16/27) · CPC title

• G06F9/466

  Transaction processing · CPC title

• G06F2206/1014

  One time programmable [OTP] memory, e.g. PROM, WORM · CPC title

• G06F12/08

  in hierarchically structured memory systems, e.g. virtual memory systems · CPC title

• G06F17/30368 Primary

  Physics · mapped topic