Video remote-commentary synchronization method and system, and terminal device

Patent metadata

Field	Value
Publication number	US-9924205-B2
Application number	US-201515316327-A
Country	US
Kind code	B2
Filing date	Jun 10, 2015
Priority date	Jun 10, 2014
Publication date	Mar 20, 2018
Grant date	Mar 20, 2018

Abstract

To-be-commented video data is received by a terminal device, and a video sequence number of the to-be-commented video data is determined, which steps further include comprising, by the video data, a first correlation 2-tuple of a global base sequence number and the video sequence number, in which a sequence number of a live voice in the video data is the global base sequence number, and the video sequence number of the video data is determined according to the global base sequence number; and determining a video sequence number of the to-be-commented video data according to the first correlation 2-tuple. The to-be-commented video data is played, a commentary voice is acquired, and a correspondence between a voice sequence number of the commentary voice and the video sequence number is determined. The correspondence between the voice sequence number and the video sequence number is sent to a video playback end.

First claim

What is claimed is:

1. A video remote-commentary synchronization method, comprising:
receiving to-be-commented video data, and determining a video sequence number of the to-be-commented video data;
playing the to-be-commented video data, acquiring a commentary voice, and determining a correspondence between a voice sequence number of the commentary voice and the video sequence number; and
sending, to a video playback end, the correspondence between the voice sequence number and the video sequence number, so that the video playback end plays the commentary voice according to the correspondence between the voice sequence number and the video sequence number while playing a video;
wherein the receiving to-be-commented video data, and determining a video sequence number of the to-be-commented video data comprises:
comprising, by the video data, a first correlation 2-tuple of a global base sequence number and the video sequence number, wherein a sequence number of a live voice in the video data is the global base sequence number, and the video sequence number of the video data is determined according to the global base sequence number; and
determining a video sequence number of the to-be-commented video data according to the first correlation 2-tuple.

2. The method according to claim 1 , wherein the determining a correspondence between a voice sequence number of the commentary voice and the video sequence number comprises:
determining a voice sequence number of a commentary voice according to the global base sequence number in the first correlation 2-tuple; and generating a second correlation 2-tuple comprising the global base sequence number and the voice sequence number.

3. The method according to claim 2 , wherein the sending to a video playback end the correspondence between the voice sequence number and the video sequence number comprises:
sending the first correlation 2-tuple and the second correlation 2-tuple to a video playback end.

4. A video remote-commentary synchronization method, comprising:
acquiring a live video as to-be-commented video data;
extracting a live voice from the video data, using a sequence number of the live voice as a global base sequence number, and determining a video sequence number of the video data according to the global base sequence number; and
generating a first correlation 2-tuple comprising the global base sequence number and the video sequence number, and sending to a video commentary end video data comprising the first correlation 2-tuple.

5. The method according to claim 4 , wherein the using a sequence number of the live voice as a global base sequence number comprises:
segmenting the extracted a live voice into a data slice, so as obtain a sequence number of the live voice as a global base sequence number.

6. A video remote-commentary synchronization method, comprising:
receiving video data and a commentary voice that corresponds to the video data, the video data having a video sequence number and the commentary voice having a voice sequence number;
receiving a correspondence between the voice sequence number and the video sequence number; and
playing the commentary voice according to the correspondence between the voice sequence number and the video sequence number when the video data is played,
wherein there are two or more a commentary voice sources, and the method further comprises:
selecting or switching the currently played a commentary voice according to a preset rule; and
the receiving a correspondence between the voice sequence number and the video sequence number comprises:
receiving a first correlation 2-tuple and a second correlation 2-tuple, wherein the first correlation 2-tuple comprises a global base sequence number and the video sequence number and the second correlation 2-tuple comprises the global base sequence number and the voice sequence number, wherein a sequence number of a live voice in the video data is the global base sequence number, the video sequence number of the video data is determined according to the global base sequence number, and the voice sequence number is determined according to the global base sequence number.

7. The method according to claim 6 , wherein the playing the commentary voice according to the correspondence between the voice sequence number and the video sequence number when the video data is played comprises:
acquiring a sequence number of a current video image when the video data is played, acquiring a global base sequence number corresponding to the sequence number of the current video image according to the first correlation 2-tuple, and acquiring a voice sequence number corresponding to the acquired global base sequence number according to the second correlation 2-tuple;
determining a live voice corresponding to the acquired global base sequence number and determining a commentary voice corresponding to the acquired voice sequence number; and
playing the determined a live voice and the determined a commentary voice when the current video image is played.

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Xu Xiaomin
• Li Junming

Classifications

• H04N21/233

  Processing of audio elementary streams {(monitoring, identification or recognition of audio in broadcast systems H04H60/58)} · CPC title

• H04N21/8455

  involving pointers to the content, e.g. pointers to the I-frames of the video stream · CPC title

• H04N21/2187 Primary

  Live feed · CPC title

• H04N21/8106

  involving special audio data, e.g. different tracks for different languages · CPC title

• H04N21/4307

  Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen · CPC title