Video and audio processing devices and video conference system

Patent metadata

Field	Value
Publication number	US-2016205351-A1
Application number	US-201614993092-A
Country	US
Kind code	A1
Filing date	Jan 12, 2016
Priority date	Jan 12, 2015
Publication date	Jul 14, 2016
Grant date	—

Abstract

A video conference system including at least one client device and a host device able to be connected to the client devices and a remote device is provided. The host device obtains at least one piece of candidate video data as well as multiple pieces of to-be-integrated audio data, selects one piece of video data from the candidate video data, integrates the to-be-integrated audio data and sends the selected video data and the integrated audio data to the remote device, where the to-be-integrated audio data includes client audio data and host audio data, the candidate video data includes at least one piece of client video data and host video data. Video and audio processing devices corresponding to the client device and the remote device are also provided.

First claim

1 . A video and audio processing device comprising:
a communication circuit, configured for connecting to another video and audio processing device; an image capturing device, configured for capturing image signals; an audio receiving device, configured for capturing audio signals; a memory, configured for storing file data; and a processor, coupled to the communication circuit, the image capturing device, the audio receiving device, and the memory, and configured for:
receiving a first image signal and a first audio signal respectively from the image capturing device and the audio receiving device to generate first video data and first audio data;
determining whether the first audio data satisfies at least one transmission condition;
if yes, transmitting the first audio data and the first video data to the another video and audio processing device through the communication circuit; and
if no, transmitting only the first audio data to the another video and audio processing device through the communication circuit.

2 . The video and audio processing device according to claim 1 further comprising:
a screen, configured for displaying images; and
an audio playing device, configured for playing audio, wherein the processor is further coupled to the screen and the audio playing device and configured for:
receiving remote video data and remote audio data from the another video and audio processing device through the communication circuit; and
playing the remote video data and the remote audio data respectively through the screen and the audio playing device.

3 . The video and audio processing device according to claim 1 , wherein the first audio data comprises an audio frequency, and wherein the processor is configured for determining whether the first audio data satisfies the at least one transmission condition comprising:
determining whether the audio frequency satisfies a human frequency.

4 . The video and audio processing device according to claim 3 , wherein the first audio data further comprises an audio volume received by the audio receiving device, and wherein the processor is configured for determining whether the first audio data satisfies the at least one transmission condition further comprising:
determining whether the audio volume is greater than a volume threshold.

5 . The video and audio processing device according to claim 3 , wherein the first audio data further comprises an audio signal-to-noise ratio received by the audio receiving device, and wherein the processor is configured for determining whether the first audio data satisfies the at least one transmission condition further comprising:
determining whether the audio signal-to-noise ratio is greater than a signal-to-noise ratio threshold.

6 . An video and audio processing device comprising:
a communication circuit, configured for connecting to at least one other video and audio processing device and a remote device; an image capturing device, configured for capturing image signals; an audio receiving device, configured for capturing audio signals; a memory, configured for storing file data; and a processor, coupled to the communication circuit, the image capturing device, the audio receiving device, and the memory, and configured for:
obtaining at least one piece of candidate video data and a plurality pieces of to-be-integrated audio data, wherein each piece of the candidate video data corresponds to one piece of the to-be-integrated audio data;
selecting one piece of the candidate video data according to the to-be-integrated audio data corresponding to each piece of the candidate video to generate selected video data;
integrating the pieces of the to-be-integrated audio data to generate integrated audio data; and
transmitting the integrated audio data and the selected video data to the remote device through the communication circuit.

7 . The video and audio processing device according to claim 6 , wherein the processor is further configured for:
receiving remote video data and remote audio data from the remote device through the communication circuit; and transmitting the remote video data and remote audio data to each of the at least one other video and audio processing device through the communication circuit.

8 . The video and audio processing device according to claim 7 further comprising:
a screen, configured for displaying images; and
an audio playing device, configured for playing audio, wherein the processor is further coupled to the screen and the audio playing device and is configured for:
playing the remote video data and the remote audio data respectively through the screen and the audio playing device.

9 . The video and audio processing device according to claim 6 , wherein each piece of the to-be-integrated audio data comprises an audio volume, and wherein the processor is configured for selecting one piece of the candidate video data according to the to-be-integrated audio data corresponding to each piece of the candidate video to the generate selected video data comprising:
selecting the candidate video data corresponding to the to-be-integrated audio data with a maximal audio volume to be the selected video data.

10 . The video and audio processing device according to claim 6 , wherein each piece of the to-be-integrated audio data comprises an audio signal-to-noise ratio, and wherein the processor is configured for selecting one piece of the candidate video data according to the to-be-integrated audio data corresponding to each piece of the candidate video to the generate selected video data comprising:
selecting the candidate video data corresponding to the to-be-integrated audio data with a maximal audio signal-to-noise ratio to be the selected video data.

11 . The video and audio processing device according to claim 6 , wherein each piece of the to-be-integrated audio data comprises an audio receiving time period, and wherein the processor is configured for selecting one piece of the candidate video data according to the to-be-integrated audio data corresponding to each piece of the candidate video to the generate selected video data comprising:
selecting the candidate video data corresponding to the to-be-integrated audio data with a longest audio receiving time period to be the selected video data.

12 . The video and audio processing device according to claim 6 , wherein each piece of the to-be-integrated audio data comprises an audio receiving time period, and wherein the processor is configured for selecting one piece of the candidate video data according to the to-be-integrated audio data corresponding to each piece of the candidate video to the generate selected video data comprising:
selecting the candidate video data corresponding to the audio data with the audio receiving time period being greater than a time period threshold as the selected video data.

13 . The video and audio processing device according to claim 6 , wherein the processor is configured for integrating the pieces of to-be-integrated audio data to generate the integrated audio data comprising:
performing audio mixing and/or audio denoising on the to-be-integrated audio data to generate the integrated audio data.

14 . The video and audio processing device according to claim 6 , wherein the processor is further configured for:
receiving a second image signal and a second audio signal respectively from the image capturing device and the audio receiving device to generate second video data and second audio data; determining whether the second audio data satisfies at least one transmission condition; if ye

Assignees

• Chan Chieh-Yu
• Weng Ming-Che
• Compal Electronics Inc

Inventors

• Chan Chieh-Yu
• Weng Ming-Che

Classifications

• H04N23/66

  Remote control of cameras or camera parts, e.g. by remote control devices · CPC title

• H04N7/142

  Constructional details of the terminal equipment, e.g. arrangements of the camera and the display · CPC title

• H04N5/06

  Generation of synchronising signals · CPC title

• H04L67/025

  for remote control or remote monitoring of applications · CPC title

• H04N21/242

  Synchronisation processes, e.g. processing of PCR [Programme Clock References] {(arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18)} · CPC title