Video-based interaction method, terminal, server and system

Patent metadata

Field	Value
Publication number	US-10200763-B2
Application number	US-201615266684-A
Country	US
Kind code	B2
Filing date	Sep 15, 2016
Priority date	May 30, 2014
Publication date	Feb 5, 2019
Grant date	Feb 5, 2019

Abstract

The present disclosure discloses a video-based interaction method, a terminal, a server, and a system, and relates to the field of information processing technologies. The method includes: acquiring an interaction instruction; acquiring multi-media data related to a video according to the interaction instruction; sending the multi-media data; receiving at least one type of interaction page matching with the multi-media data, different interaction pages corresponding to different types of interaction operations; and displaying at least one type of interaction page, and implementing a corresponding type of interaction operation according to each type of interaction page.

First claim

What is claimed is:

1. A video-based interaction method performed by a mobile terminal comprising a processor and memory storing program codes, wherein the processor executes the stored program codes to perform operations comprising:
acquiring an interaction instruction from a user of the mobile terminal;
collecting, according to the interaction instruction, multi-media data of a video over at least one first preset time period, until a total time length of the collected multi-media data reaches a first preset length, wherein the video is broadcast by another electronic device;
determining time information associated with the collected multi-media data when the collecting spans the first preset time period;
sending the multi-media data and the time information to a server through a network, wherein the multi-media data of the video during a time indicated by the time information comprises an audio signal and one or more images, and further wherein:
the server identifies a public identifier of a public person from the audio signal or the one or more images; and
the multi-media data and the time information are matched with a first interaction page by the server, the first interaction page being a chat page associated with the public identifier, wherein the chat page includes a corresponding set of multiple interaction operations;

receiving, from the server, the chat page associated with the public identifier;
displaying the chat page on the mobile terminal; and
while displaying the chat page:
detecting a user selection of one of the multiple interaction operations displayed in the chat page;
sending, to the server, a first response corresponding to the user-selected interaction operation;
receiving, from the server, a second response, wherein the server generates the second response based on the first response corresponding to the user-selected interaction operation; and
updating the chat page according to the second response.

2. The method according to claim 1 , wherein collecting the multi-media data of the video according to the interaction instruction comprises:
generating an audio fingerprint corresponding to the audio signal, and using the audio fingerprint as the multi-media data related to the video.

3. A video-based interaction method performed by a server comprising a processor and memory storing program codes, wherein the processor executes the stored program codes to perform operations, comprising:
acquiring, from a mobile terminal connected to the server through a network, multi-media data of a video and time information associated with the multi-media data, the multi-media data including an audio signal and one or more images, wherein the multi-media data is collected over at least one first preset time period, until a total time length of the collected multi-media data reaches a first preset length;
identifying a public identifier of a public person from the audio signal and the one or more images;
matching the multi-media data and the time information with a first interaction page, the first interaction page being a chat page associated with the public identifier, wherein the chat page includes a corresponding set of multiple interaction operations;
sending, to the mobile terminal, the chat page associated with the public identifier, wherein the mobile terminal displays the chat page upon receiving the chat page from the server;
receiving, from the mobile terminal, a first response corresponding to a user-selected interaction operation among a set of multiple interaction operations corresponding to the collected multi-media data;
generating a second response based on the first response corresponding to the user-selected operations; and
sending the second response to the mobile terminal, the second response including an update to the chat page.

4. The method according to claim 3 , wherein:
identifying the public identifier of the public person comprises:
generating an audio fingerprint according to the audio signal, and identifying the public identifier of the public person that matches with the audio fingerprint.

5. The method according to claim 3 , wherein:
the multi-media data includes audio fingerprint related to the video; and
identifying the public identifier of the public person comprises:
identifying the public identifier of the public person that matches with the audio fingerprint.

6. A mobile terminal, comprising a processor and memory storing program code, wherein the processor executes the stored program code to:
acquire an interaction instruction from a user of the mobile terminal;
collect, according to the interaction instruction, multi-media data of a video over at least one first preset time period, until a total time length of the collected multi-media data reaches a first preset length, wherein the video is broadcast by another electronic device;
determine time information associated with the collected multi-media data when the collecting spans the first preset time period;
send the multi-media data and the time information to a server through a network, wherein the multi-media data of the video during a time indicated by the time information comprises an audio signal and one or more images, and further wherein:
the server identifies a public identifier of a public person the audio signal or the one or more images;
the multi-media data and the time information are matched with a first interaction page by the server, the first interaction page being a chat page associated with the public identifier, wherein the chat page includes a corresponding set of multiple interaction operations;

receive, from the server, the chat page associated with the public identifier;
display the chat page on the mobile terminal; and
while displaying the chat page:
detect a user selection of one of the multiple interaction operations displayed in the chat page;
send, to the server, a first response corresponding to the user-selected interaction operation;
receive, from the server, a second response, wherein the server generates the second response based on the first response corresponding to the user-selected interaction operation; and
update the chat page according to the second response.

7. The mobile terminal according to claim 6 , wherein collecting the multi-media data of the video according to the interaction instruction comprises generating an audio fingerprint corresponding to the audio signal, and using the audio fingerprint as the multi-media data related to the video.

8. A server, comprising a processor and a memory storing program code, wherein the processor executes the stored program code to:
acquire, from a mobile terminal connected to the server through a network, multi-media data of a video and time information associated with the multi-media data, the multi-media data including an audio signal and one or more images, wherein the multi-media data is collected over at least one first preset time period, until a total time length of the collected multi-media data reaches a first present length;
identify a public identifier of a public person from the audio signal and the one or more images;
match the multi-media data and the time information with a first interaction page, the first interaction page being a chat page associated with the public identifier, wherein the chat page includes a corresponding set of multiple interaction operations;
send, to the mobile terminal, the chat page associated with the public identifier, wherein the mobile terminal displays the chat page upon receiving the chat page from the server;
receive, from the mobile terminal, a first response corresponding to a user-selected interaction operation among a set of multiple interaction operations correspo

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Ye Wa
• Wang Hongyang
• Hou Jie
• Xu Zhenyu
• Tang Zhuo
• Wang Rui
• Li Keren
• Zang Jing
• Sun Bo

Classifications

• H04N21/84

  Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)} · CPC title

• H04N21/4722

  for requesting additional data associated with the content · CPC title

• H04N21/845

  Structuring of content, e.g. decomposing content into time segments · CPC title

• H04N21/812

  involving advertisement data (advertising per se G06Q30/02) · CPC title

• H04N21/47815

  Electronic shopping (payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12) · CPC title