Method of cross-regional data transmission and system thereof

Patent metadata

Field	Value
Publication number	US-10397125-B2
Application number	US-201715453821-A
Country	US
Kind code	B2
Filing date	Mar 8, 2017
Priority date	Mar 9, 2016
Publication date	Aug 27, 2019
Grant date	Aug 27, 2019

Abstract

The present disclosure is directed to a cross-regional data transmission method and device. Metadata information sent by a corresponding client device is acquired, and the metadata information is sent to a corresponding metadata transmission node device, wherein the metadata information includes data replication progress information of the corresponding client device; to-be-forwarded data information sent by the corresponding metadata transmission node device is acquired, and the to-be-forwarded data information is pushed to the corresponding client device, wherein the to-be-forwarded data information includes data replication progress information of another client device, so that the metadata information sent by the corresponding client device is effectively sent to the corresponding metadata transmission node device; and the acquired to-be-forwarded data information sent by the corresponding metadata transmission node device is pushed to the corresponding client device, to achieve synchronization of the metadata information.

First claim

What is claimed is:

1. A method comprising:
acquiring metadata information sent by a client device, the metadata information including first data replication progress information of the client device;
sending the metadata information to a first metadata transmission node device;
acquiring to-be-forwarded data information sent by the first metadata transmission node device; and
pushing the to-be-forwarded data information to the client device, the to-be-forwarded data information including second data replication progress information of another client device.

2. The method of claim 1 , further comprising:
performing persistence processing on the metadata information.

3. The method of claim 2 , further comprising:
sending persistence acknowledgment information to the client device.

4. The method of claim 1 , further comprising:
sending, when the first metadata transmission node device fails, a first node device configuration request to a device equipped with a protocol for globally distributed consensus;
deleting, based on the first node device configuration request, the first metadata transmission node device from a meta transmission channel; and
adding a second metadata transmission node device with a healthy state in the meta transmission channel.

5. The method of claim 4 , further comprising:
sending the metadata information to the second metadata transmission node device.

6. The method of claim 4 , wherein the protocol for globally distributed consensus is Paxos.

7. A method comprising:
receiving metadata information of a client device sent by a metadata client access device;
sending the metadata information to a metadata transmission node device, the metadata information including first data replication progress information of the client device;
receiving to-be-forwarded data information sent by an upper-level metadata transmission node device;
sending the to-be-forwarded data information to a first lower-level metadata transmission node device, the to-be-forwarded data information including second data replication progress information of another client device; and
forwarding the to-be-forwarded data information to the metadata client access device.

8. The method of claim 7 , further comprising:
sending, when the first lower-level metadata transmission node device fails, a node device configuration request to a device equipped with a protocol for globally distributed consensus;
deleting, based on the node device configuration request, the first lower-level metadata transmission node device from a meta transmission channel; and
adding a second lower-level metadata transmission node device with a healthy state in the meta transmission channel.

9. The method of claim 8 , further comprising:
sending the to-be-forwarded data information to the second lower-level metadata transmission node device.

10. The method of claim 8 , wherein the protocol for globally distributed consensus is Paxos.

11. The method of claim 8 , further comprising:
sending a current node state to the device equipped with a protocol for globally distributed consensus periodically.

12. A system comprising:
a metadata client access device;
a metadata transmission node device; and
a client device,
wherein the metadata client access device includes a first acquisition unit that acquires metadata information sent by the client device, and sends the metadata information to the metadata transmission node device, the metadata information including first data replication progress information of the client device and a pushing unit that acquires to-be-forwarded data information sent by the metadata transmission node device, and pushes the to-be-forwarded data information to the client device, the to-be-forwarded data information including second data replication progress information of another client device.

13. The system of claim 12 , wherein the metadata transmission node device includes:
a first reception unit that receives the metadata information of the client device sent by the metadata client access device, and sends the metadata information to another metadata transmission node device.

14. The system of claim 13 , wherein the metadata transmission node device further includes:
a first forwarding unit that receives the to-be-forwarded data information sent by an upper-level metadata transmission node device, and sends the to-be-forwarded data information to a lower-level metadata transmission node device.

15. The system of claim 14 , wherein the metadata transmission node device further includes:
a second forwarding unit that forwards the to-be-forwarded data information to the metadata client access device.

16. The system of claim 15 , wherein the client device includes:
a third acquisition unit that acquires database data information sent by another client device through a data transmission channel.

17. The system of claim 16 , wherein the client device further includes:
a sending unit that determines the metadata information based on the database data information, and sends the metadata information to the metadata client access device.

18. The system of claim 17 , wherein the client device further includes:
a determination unit that receives the to-be-forwarded data information pushed by the metadata client access device, and determines, based on the to-be-forwarded data information, whether to submit the database data information.

Assignees

• Alibaba Group Holding Ltd

Inventors

• Lu Yijun
• Tao Yunfeng
• Tang Zhiyang
• Zhu Yunfeng
• Cheng Lin
• An Kaige

Classifications

• H04L67/1095 Primary

  Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes · CPC title

• H04L67/06

  specially adapted for file transfer, e.g. file transfer protocol [FTP] · CPC title

• H04L69/40

  for recovering from a failure of a protocol instance or entity, e.g. service redundancy protocols, protocol state redundancy or protocol service redirection (management of faults, events, alarms or notifications in data switching networks H04L41/06) · CPC title

• H04L67/288

  Distributed intermediate devices, i.e. intermediate devices for interaction with other intermediate devices on the same level · CPC title

• H04L47/30 Primary

  in combination with information about buffer occupancy at either end or at transit nodes · CPC title