Video conference system

Patent metadata

Field	Value
Publication number	US-11258982-B2
Application number	US-201916543397-A
Country	US
Kind code	B2
Filing date	Aug 16, 2019
Priority date	Aug 16, 2019
Publication date	Feb 22, 2022
Grant date	Feb 22, 2022

Abstract

Embodiments of the disclosure provided herein can be used to improve the control, selection and transmission of data to a remote video conferencing environment, by use of a plurality of wired or wirelessly connected electronic devices. In one example, the transmission of data from a local environment can be improved by switching the source of visual inputs (e.g., cameras or display of an electronic device, such as laptop) and/or audio inputs (e.g., microphones) to the one or more appropriate visual and audio sources available within the local environment. The most appropriate visual and audio sources can be the sources that provide the participants in the remote environment the most relevant data giving the remote users the best understanding of the current activities in the local environment.

First claim

What is claimed is:

1. A computer implemented method of selecting one or more content sources to provide content data for transmission to a remote video conferencing location, wherein
the one or more content sources are selected from a plurality of peripheral devices that are positioned in a first environment, one or more of the plurality of peripheral devices are configured as master devices, one or more of the plurality of peripheral devices are configured as slave devices, the plurality of peripheral devices comprise one or more clusters, and the one or more clusters each comprise a master device and one or more slave devices in communication with the master device, the method comprising:
(a) receiving, by the master device in each cluster of the one or more clusters, data confidence levels determined by respective ones of the one or more slave devices in communication with the master device;
(b) comparing data confidence levels determined by at least some peripheral devices of the plurality of peripheral devices, wherein the data confidence levels determined by the at least some peripheral devices include the data confidence levels received by the master device of each of the one or more clusters at (a);
(c) based at least in part on (b), selecting one of the plurality of peripheral devices as a first content source, wherein the first content source is the master device or one of the one or more slave devices in a first cluster of the one or more clusters; and
(d) when the first content source is one of the one or more slave devices of the first cluster, receiving, by the master device in the first cluster, first content data from the first content source and transferring, by the master device in the first cluster, the first content data to a conference hub.

2. The computer implemented method of claim 1 , wherein each one of the data confidence levels compared at (b) is determined by a respective one of the at least some peripheral devices based on an analysis of its captured content data.

3. The computer implemented method of claim 2 , wherein selecting the first content source comprises determining the first content source has a higher data confidence level than other ones of the plurality of peripheral devices.

4. The computer implemented method of claim 1 , wherein when the first content source is one of the one or more slave devices of the first cluster, the first content source transmits the first content data based on a request received from the master device of the first cluster.

5. The computer implemented method of claim 1 , further comprising:
(f) before selecting the first content source at (c), transmitting to the conference hub, by the master device of each of the one or more clusters, metadata comprising data confidence levels determined by the master devices and the one or more slave devices in communication with the master device, wherein
comparing data confidence levels at (b) comprises comparing, by the conference hub, at least some of the data confidence levels in the metadata received from the master devices of the one or more clusters.

6. The computer implemented method of claim 1 , wherein selecting the first content source at (c) comprises:
(i) determining that a first peripheral device of the at least some peripheral devices has the highest data confidence level of the at least some peripheral devices;
(ii) determining that the first peripheral device is receiving an interfering signal;
(iii) determining that a second peripheral device of the at least some peripheral devices has the next highest data confidence level; and
(iv) selecting the second peripheral device as the first content source.

7. The computer implemented method of claim 6 , wherein
the first content data includes at least audio data, and
the interfering signal comprises unwanted audio data captured by the first peripheral device.

8. The computer implemented method of claim 7 , wherein
the unwanted audio data comprises audio data other than audible speech.

9. The computer implemented method of claim 6 , wherein
the first content data comprises at least video data, and
the interfering signal comprises undesirable visual elements captured by the first peripheral device.

10. The computer implemented method of claim 1 , further comprising:
(f) based on the selection of the first data source at (c), transmitting, by one or more of the master devices of the one or more clusters, a signal to one or more non-selected ones of the plurality of peripheral devices to not transmit content data of the first content data.

11. The computer implemented method of claim 1 , wherein the peripheral device selected as the first content source did not have the highest data confidence level, between the compared data confidence levels, for the first content data.

12. The computer implemented method of claim 1 , further comprising (f) based on comparing the data confidence levels at (b), adjusting a resolution of content data to be transmitted from one or more slave devices of the plurality of peripheral devices to the respective master device in communication therewith, wherein the adjusted resolution is one of at least two or more resolutions that can be transmitted from the one or more slave devices.

13. The computer implemented method of claim 1 , wherein comparing the data confidence levels at (b), includes adjusting, by use of a correction factor, at least one of the data confidence levels.

14. The computer implemented method of claim 1 , further comprising (f) before selecting the first content source at (c):
(i) associating a field of view of a first peripheral device of the plurality of peripheral devices with a detection region of a second peripheral device of the plurality of peripheral devices;
(ii) determining that the data confidence level of the first peripheral device is above a threshold value; and
(iii) increasing, by use of a correction factor, the data confidence level of the second one of the plurality of peripheral devices.

15. The computer implemented method of claim 14 , wherein determining the data confidence level of the first peripheral device is above the threshold value comprises determining a gaze or speech of a current speaker in the first environment is directed to the first peripheral device.

16. The computer implemented method of claim 1 , further comprising:
based at least in part on (b), selecting a second content source from the plurality of peripheral devices as an auxiliary source for the first content data; and
transferring, by the master peripheral device in the cluster having the second content source, content data from the second content source to the conference hub.

17. The computer implemented method of claim 1 , further comprising:
(f) when the first content source is the master device of the first cluster, transferring, by the master device of the first cluster, the first content data to the conference hub.

18. The computer implemented method of claim 17 , further comprising:
(g) transmitting, by the conference hub, the first content data received from the master device of the first cluster to the remote video conferencing location.

19. The computer implemented method of claim 1 , wherein comparing the data confidence levels at (b) comprises comparing, by the master device in each cluster of the one or more clusters, the data confidence levels of the peripheral devices in the cluster.

20. A system for selecting a content source in a first environment to provide content d

Assignees

• Logitech Europe Sa

Inventors

• Atkins Andreas Franz William
• Chu Joseph Yao-Hua
• Levak Henry
• Mclintock Kevin

Classifications

• H04N7/147

  Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q) · CPC title

• H04N7/04

  Systems for the transmission of one television signal, i.e. both picture and sound, by a single carrier {(H04N7/084, H04N7/087 take precedence)} · CPC title

• H04N7/15 Primary

  Conference systems · CPC title