Method and apparatus for updating data table in keyvalue database

Patent metadata

Field	Value
Publication number	US-10467192-B2
Application number	US-201615054475-A
Country	US
Kind code	B2
Filing date	Feb 26, 2016
Priority date	Nov 12, 2014
Publication date	Nov 5, 2019
Grant date	Nov 5, 2019

Abstract

A method for updating a data table in a KeyValue database is provided. Raw data is received and formatted into a data updating file. An update timestamp is set for each column qualifier in each row of the data updating file. A data deleting file is generated. A delete timestamp is set for each row of the data deleting file. Each row of the data deleting file corresponds to one row of old data in the data table. Each row of the data deleting file includes a row key that is the same as the row key of the corresponding row of old data in the data table. The data updating file and the data deleting file are both imported into the data table. Consequently, timestamp is used to indicate the valid data in the data table. An apparatus configured to perform the method is also provided.

First claim

What is claimed is:

1. A method for updating a data table in a KeyValue database, comprising:
receiving raw data for updating the data table;
formatting the raw data into a data updating file, wherein the data updating file comprises P rows of data, each row comprises one row key and Q column qualifiers, and an update timestamp is set for each column qualifier in each row, wherein P is greater than or equal to 1, and Q is greater than or equal to 1;
generating a data deleting file, wherein the data deleting file comprises M rows, each row of the data deleting file corresponds to one row of existing data in the data table, wherein each row of existing data in the data table comprises one row key and N column qualifiers, each column qualifier has an original timestamp, and wherein each row of the data deleting file comprises a row key that is the same as the row key of the corresponding row of existing data in the data table, and a delete timestamp is set for each row of the data deleting file, wherein M is greater than or equal to 1, and N is greater than or equal to 1;
importing the data updating file into the data table; and
importing the data deleting file into the data table;
wherein a delete timestamp of an R th row of the data deleting file is greater than a maximum value of original timestamps of the column qualifiers in the row of existing data in the data table corresponding to the R th row of the data deleting file;
wherein the delete timestamp of the R th row of the data deleting file is less than a minimum value of update timestamps of the column qualifiers in an S th row of the data updating file; and
wherein the R th row of the data deleting file and the S th row of the data updating file have a same row key, 1≤R≤M, and 1≤S≤P.

2. The method according to claim 1 , wherein the step of generating the data deleting file is performed before the step of formatting the raw data into the data updating file; and
wherein an update timestamp set for each column qualifier in the data updating file is a moment at which the data updating file is generated, and a delete timestamp set for each row of the data deleting file is a moment at which the data deleting file is generated.

3. The method according to claim 1 , wherein the step of importing the data updating file into the data table is performed before the step of importing the data deleting file into the data table.

4. The method according to claim 1 , wherein importing the data updating file into the data table comprises:
changing a save path of the data updating file to a directory of the data table.

5. The method-according to claim 1 , wherein importing the data deleting file into the data table comprises:
changing a save path of the data deleting file to a directory of the data table.

6. The method-according to claim 1 , wherein the steps of importing the data updating file into the data table and importing the data deleting file into the data table comprise:
combining the data updating file and the data deleting file into a table data updating file; and
importing the table data updating file into the data table.

7. The method according to claim 6 , wherein the importing the table data updating file into the data table comprises:
changing a save path of the table data updating file to a directory of the data table.

8. An apparatus comprising a processor and a memory storing instructions for execution by the processor, wherein the instructions, when executed by the processor, cause the apparatus to:
obtain raw data for updating a data table in a KeyValue database;
format the raw data into a data updating file, wherein the data updating file comprises P rows of data, each row comprises one row key and Q column qualifiers, and an update timestamp is set for each column qualifier in each row, wherein P is greater than or equal to 1, and Q is equal to or greater than 1;
generate a data deleting file, wherein the data deleting file comprises M rows, each row of the data deleting file corresponds to one row of existing data in the data table, the row of existing data in the data table comprises one row key and N column qualifiers, each column qualifier has an original timestamp, and wherein each row of the data deleting file comprises a row key that is the same as the row key of the corresponding row of data in the data table, and a delete timestamp is set for each row of the data deleting file, wherein M is greater than or equal to 1, and N is equal to or greater than 1;
import the data updating file into the data table; and
import the data deleting file into the data table;
wherein a delete timestamp of an R th row of the data deleting file is greater than a maximum value of original timestamps of the row of data in the data table corresponding to the R th row;
wherein the delete timestamp of the R th row of the data deleting file is less than a minimum value of the update timestamps of an S th row of the data updating file; and
wherein the R th row of the data deleting file and the S th row of the data updating file have a same row key, 1≤R≤M, and 1≤S≤P.

9. The apparatus according to claim 8 , wherein the instructions cause the apparatus to generate the data deleting file, and then format the raw data into the data updating file;
wherein an update timestamp set for each column qualifier in the data updating file is a moment at which the data updating file is generated, and a delete timestamp set for each row of the data deleting file is a moment at which the data deleting file is generated.

10. The apparatus according to claim 8 , wherein the instructions cause the apparatus to:
import the data updating file into the data table, and then import the data deleting file into the data table.

11. The apparatus according to claim 8 , wherein in importing the data updating file into the data table, the instructions cause the apparatus to:
change a save path of the data updating file to a directory of the data table.

12. The apparatus according to claim 8 , wherein in importing the data deleting file into the data table, the instructions cause the apparatus to:
change a save path of the data deleting file to a directory of the data table.

13. The apparatus according to claim 8 , wherein in importing the data updating file into the data table and importing the data deleting file into the data table, the instructions cause the apparatus to:
combine the data updating file and the data deleting file into a table data updating file; and
import the table data updating file into the data table.

14. The apparatus according to claim 13 , wherein in importing to import the table data updating file into the data table, the instructions cause the apparatus to:
change a save path of the table data updating file to a directory of the data table.

Assignees

• Huawei Tech Co Ltd
• Hauwei Tech Co Ltd

Inventors

• Guo Yijun
• Bi Jieshan

Classifications

• G06F16/162 Primary

  Delete operations (erasing in storage systems G06F3/0652) · CPC title

• G06F16/23

  Updating · CPC title

• G06F16/2282

  Tablespace storage structures; Management thereof · CPC title