Electronic device and method for broadcasting video according to a user's emotive response

Patent metadata

Field	Value
Publication number	US-2019116397-A1
Application number	US-201816047300-A
Country	US
Kind code	A1
Filing date	Jul 27, 2018
Priority date	Oct 13, 2017
Publication date	Apr 18, 2019
Grant date	—

Abstract

An electronic device is configured to broadcast videos according to an emotive response. The electronic device includes a display unit configured to display a video, a camera unit configured to capture gestures and facial expressions of a user, a processor, and a memory. The processor controls the camera unit to detect in real time, during broadcast of the video on the display unit, gestures and facial expressions of a user, confirms an emotive response of the user according to the gestures and facial expressions of the user, selects an emotive image from a number of emotive images stored in the memory according to the emotive response of the user, uploads the selected emotive image to a server, and obtains the selected emotive image from the server and broadcasts the selected emotive image and the video together on the display unit.

First claim

What is claimed is:

1 . A non-transitory storage medium having stored thereon instructions that, when executed by at least one processor of an electronic device, causes the at least one processor to execute instructions of a method for broadcasting videos according to an emotive response, the method comprising:
controlling a camera unit of the electronic device to detect in real time, during broadcast of a video on a display unit of the electronic device, gestures and facial expressions of a user; confirming an emotive response of the user according to the gestures and facial expressions of the user; selecting an emotive image from a plurality of emotive images stored in a memory of the electronic device according to the emotive response of the user; uploading the selected emotive image to a server; and obtaining the selected emotive image from the server and broadcasting the selected emotive image and the video together on the display unit.

2 . The non-transitory storage medium of claim 1 , wherein the memory is configured to pre-store therein a relationship of corresponding gesture images and facial expression images to emotive response types of the user; the emotive response of the user is determined according to a relationship of the gestures and facial expressions captured by the camera unit to the corresponding emotive response type.

3 . The non-transitory storage medium of claim 2 , wherein the emotive response of the user comprises angry, sad, happy, energetic, and low energy.

4 . The non-transitory storage medium of claim 1 , wherein the memory stores a plurality of advertisements, and the method further comprises:
searching the memory for an advertisement corresponding to the emotive response of the user; and broadcasting the advertisement on the display unit after the emotive image is finished being broadcast.

5 . The non-transitory storage medium of claim 1 , wherein the electronic device further comprises a voice acquisition unit, and the method further comprises:
responding to a voice command of the user, during the broadcast of the video, to control the voice acquisition unit to acquire voice input of the user; converting the voice input of the user into text data; and broadcasting the emotive image and the text data on the display unit.

6 . The non-transitory storage medium of claim 5 , wherein the method further comprises:
obtaining a position of the emotive image and text data on the display unit, a broadcast time of the video when the emotive image and text data are displayed, a local date and time, an account name of the user, and an IP address of the electronic device; and displaying, when the electronic device displays the video again, the emotive image and text in the same position, and recording the local date and time, account name of the user, and the IP address of the electronic device.

7 . A method implemented in an electronic device for broadcasting videos according to an emotive response, the method comprising:
controlling a camera unit of the electronic device to detect in real time, during broadcast of a video on a display unit of the electronic device, gestures and facial expressions of a user; confirming an emotive response of the user according to the gestures and facial expressions of the user; selecting an emotive image from a plurality of emotive images stored in a memory of the electronic device according to the emotive response of the user; uploading the selected emotive image to a server; and obtaining the selected emotive image from the server and broadcasting the selected emotive image and the video together on the display unit.

8 . The method of claim 7 , wherein the memory is configured to pre-store therein a relationship of corresponding gesture images and facial expression images to emotive response types of the user; the emotive response of the user is determined according to a relationship of the gestures and facial expressions captured by the camera unit to the corresponding emotive response type.

9 . The method of claim 7 , wherein the memory stores a plurality of advertisements, and the method further comprises:
searching the memory for an advertisement corresponding to the emotive response of the user; and broadcasting the advertisement on the display unit after the emotive image is finished being broadcast.

10 . The method of claim 7 , wherein the electronic device further comprises a voice acquisition unit, and the method further comprises:
responding to a voice command of the user, during the broadcast of the video, to control the voice acquisition unit to acquire voice input of the user; converting the voice input of the user into text data; and broadcasting the emotive image and the text data on the display unit.

11 . The method of claim 10 , wherein the method further comprises:
obtaining a position of the emotive image and text data on the display unit, a broadcast time of the video when the emotive image and text data are displayed, a local date and time, an account name of the user, and an IP address of the electronic device; and displaying, when the electronic device displays the video again, the emotive image and text in the same position, and recording the local date and time, account name of the user, and the IP address of the electronic device.

12 . An electronic device configured to broadcast videos according to an emotive response, the electronic device comprising:
a display unit configured to display a video; a camera unit configured to capture gestures and facial expressions of a user; a processor; and a memory configured to store a plurality of instructions, which when executed by the processor, cause the processor to:
control the camera unit to detect in real time, during broadcast of the video on the display unit, gestures and facial expressions of a user;
confirm an emotive response of the user according to the gestures and facial expressions of the user;
select an emotive image from a plurality of emotive images stored in the memory according to the emotive response of the user;
upload the selected emotive image to a server; and
obtaining the selected emotive image from the server and broadcast the selected emotive image and the video together on the display unit.

13 . The electronic device of claim 12 , wherein the memory is configured to pre-store therein a relationship of corresponding gesture images and facial expression images to emotive response types of the user; the emotive response of the user is determined according to a relationship of the gestures and facial expressions captured by the camera unit to the corresponding emotive response type.

14 . The electronic device of claim 12 , wherein the memory stores a plurality of advertisements, and the processor is further configured to:
search the memory for an advertisement corresponding to the emotive response of the user; and broadcast the advertisement on the display unit after the emotive image is finished being broadcast.

15 . The electronic device of claim 12 , wherein the electronic device further comprises a voice acquisition unit, and the processor is further configured to:
respond to a voice command of the user, during the broadcast of the video, to control the voice acquisition unit to acquire voice input of the user; convert the voice input of the user into text data; and broadcast the emotive image and the text data on the display unit.

16 . The electronic device of claim 15 , wherein the processor is further configured to:
obtain a position of the emotive image and

Assignees

• Hon Hai Prec Ind Co Ltd

Inventors

• Chiu Kuan-Jung
• Lee Hsueh-Wen
• Lin Jui-Fang
• Tsai Hsi-Chi
• Hsu Yi
• Su Jia-Han
• Chen Yu-Cheng
• Huang Ying-Xiong

Classifications

• H04N21/4316

  for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window · CPC title

• H04N21/812

  involving advertisement data (advertising per se G06Q30/02) · CPC title

• H04N21/44218 Primary

  Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45) · CPC title

• H04N21/8153

  comprising still images, e.g. texture, background image · CPC title

• H04N21/4788

  communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)} · CPC title