Data synchronization method and apparatus, device, and storage medium

Patent metadata

Field	Value
Publication number	US-2026099511-A1
Application number	US-202519415545-A
Country	US
Kind code	A1
Filing date	Dec 10, 2025
Priority date	Jun 13, 2023
Publication date	Apr 9, 2026
Grant date	—

Abstract

This application provides a data synchronization method and apparatus, and relates to the field of data storage technologies. The method includes: obtaining, from an incremental log in a source database, N incremental operation record sets arranged in a chronological order, where N is an integer greater than 1, and an N th incremental operation record set is a current to-be-synchronized incremental operation record set; determining a target incremental operation record set based on a validation code of an incremental operation record set that is before the N th incremental operation record set, where the target incremental operation record set is an incremental operation record set that is successfully synchronized to a last time of a target database; and synchronizing an incremental operation record set in the N incremental operation record sets to the target database, where the incremental operation record set is after the target incremental operation record set.

First claim

What is claimed is:

1 . A method of data synchronization for a database system, the method comprising:
obtaining, from an incremental log in a source database of the database system, N incremental operation record sets arranged in a chronological order, wherein N is an integer greater than 1, and an N th incremental operation record set is a current to-be-synchronized incremental operation record set; determining a target incremental operation record set based on a validation code of an incremental operation record set that is before the N th incremental operation record set, wherein the target incremental operation record set is an incremental operation record set that is successfully synchronized to a last time of a target database of the database system; and synchronizing an incremental operation record set in the N incremental operation record sets to the target database, wherein the incremental operation record set in the N incremental operation record sets is after the target incremental operation record set.

2 . The method according to claim 1 , further comprising:
generating a validation code of the N th incremental operation record set; and sending the validation code of the N th incremental operation record set to the target database after determining that the N th incremental operation record set has been successfully synchronized to the target database.

3 . The method according to claim 1 , wherein determining the target incremental operation record set comprises:
obtaining a comparison validation code from the target database, wherein the comparison validation code is stored in the target database and is a validation code of a latest incremental operation record set that has been successfully synchronized to the target database; searching for a validation code that is same as the comparison validation code and is in the validation code of the incremental operation record set that is before the N th incremental operation record set; and determining the target incremental operation record set based on the validation code that is the same as the comparison validation code and is in the validation code of the incremental operation record set that is before the N th incremental operation record set, wherein a validation code of the target incremental operation record set is the same as the comparison validation code.

4 . The method according to claim 1 , wherein
a type of the source database is different from a type of the target database; the N incremental operation record sets are N intermediate-format incremental operation record sets; and obtaining, from the incremental log in the source database, the N incremental operation record sets arranged in the chronological order comprises: obtaining an N th source-format incremental operation record set from the incremental log in the source database using a parser that matches the type of the source database; and converting the N th source-format incremental operation record set into an N th intermediate-format incremental operation record set.

5 . The method according to claim 4 , wherein synchronizing the incremental operation record set in the N incremental operation record sets to the target database comprises:
converting the N th intermediate-format incremental operation record set into an N th target-format incremental operation record set using an adapter that matches the type of the target database; and sending the N th target-format incremental operation record set to the target database, to cause the target database to perform an incremental operation corresponding to the N th target-format incremental operation record set.

6 . The method according to claim 4 , wherein synchronizing the incremental operation record set in the N incremental operation record sets to the target database comprises:
selecting, from the N th intermediate-format incremental operation record set, an intermediate-format incremental operation record related to a target data table based on an identifier of the target data table; converting the intermediate-format incremental operation record related to the target data table into a target-format incremental operation record related to the target data table; and sending the target-format incremental operation record related to the target data table to the target database, to cause the target database to perform an incremental operation corresponding to the target-format incremental operation record related to the target data table.

7 . The method according to claim 1 , wherein obtaining, from the incremental log in the source database, the N incremental operation record sets arranged in the chronological order comprises:
obtaining, from the incremental log in the source database, the N incremental operation record sets arranged in the chronological order based on an identifier of a target data table.

8 . The method according to claim 1 , wherein synchronizing the incremental operation record set in the N incremental operation record sets to the target database comprises:
selecting, from the N th incremental operation record set, an incremental operation record related to a target data table based on an identifier of the target data table; and sending the incremental operation record related to the target data table to the target database, to cause the target database to perform an incremental operation corresponding to the incremental operation record related to the target data table.

9 . The method according to claim 1 , wherein synchronizing the incremental operation record set in the N incremental operation record sets to the target database comprises:
sending the N th incremental operation record set to the target database, to cause the target database to perform an incremental operation corresponding to the N th incremental operation record set.

10 . The method according to claim 2 , wherein generating the validation code of the N th incremental operation record set comprises:
generating the validation code of the N th incremental operation record set based on a validation code of an (N−1) th incremental operation record set and the N th incremental operation record set.

11 . A data synchronization apparatus used in a database system, the data synchronization apparatus comprising:
at least one processor; and at least one memory coupled to the at least one processor and storing instructions, which when executed by the at least one processor, cause the data synchronization apparatus to: obtain, from an incremental log in a source database of the database system, N incremental operation record sets arranged in a chronological order, wherein N is an integer greater than 1, and an N th incremental operation record set is a current to-be-synchronized incremental operation record set; determine a target incremental operation record set based on a validation code of an incremental operation record set that is before the N th incremental operation record set, wherein the target incremental operation record set is an incremental operation record set that is successfully synchronized to a last time of a target database of the database system; and synchronize an incremental operation record set in the N incremental operation record sets to the target database, wherein the incremental operation record set in the N incremental operation record sets is after the target incremental operation record set.

12 . The data synchronization apparatus according to claim 11 , wherein the data synchronization apparatus is further configured to:
generate a validation code of the N th incremental operation record set; and send th

Assignees

• Huawei Cloud Computing Tech Co Ltd

Inventors

• Tian Wenhao
• Yang Tao
• Yuan Jing

Classifications

• G06F16/2365

  Ensuring data consistency and integrity · CPC title

• G06F16/258

  Data format conversion from or to a database · CPC title

• G06F16/2358

  Change logging, detection, and notification (replication G06F16/27) · CPC title

• G06F16/275

  Synchronous replication · CPC title

• G06F16/273

  Asynchronous replication or reconciliation · CPC title