Separate representations of videoconference participants that use a shared device

Patent metadata

Field	Value
Publication number	US-12010459-B1
Application number	US-202217710731-A
Country	US
Kind code	B1
Filing date	Mar 31, 2022
Priority date	Mar 31, 2022
Publication date	Jun 11, 2024
Grant date	Jun 11, 2024

Abstract

A plurality of device-sharing participants may be detected that are participating in a videoconference via a shared computing device. The detecting of the plurality of device-sharing participants may be performed based, at least in part, on at least one of an audio analysis of captured audio from one or more microphones or a video analysis of captured video from one or more cameras. A plurality of participant connections corresponding to the plurality of device-sharing participants may be joined to the videoconference. Each of the plurality of participant connections may be identified within the videoconference using a respective name. A plurality of video streams and a plurality of audio streams corresponding to the plurality of participant connections may be transmitted, and the plurality of video streams and the plurality of audio streams may be presented to at least one other conference participant.

First claim

What is claimed is:

1. A computing system comprising:
one or more processors; and
one or more memories having stored therein instructions that, upon execution by the one or more processors, cause the computing system to perform computing operations comprising:
detecting a plurality of device-sharing participants that are participating in a videoconference via a shared computing device, wherein the detecting of the plurality of device-sharing participants is performed based, at least in part, on at least one of an audio analysis of captured audio from one or more microphones connected to the shared computing device or a video analysis of captured video from one or more cameras connected to the shared computing device, and wherein at least one other participant also participates in the videoconference via at least one other computing device;
joining, to the videoconference, a plurality of participant connections corresponding to the plurality of device-sharing participants, wherein each of the plurality of participant connections is identified within the videoconference using a respective name of a respective device-sharing participant of the plurality of device-sharing participants;
transmitting a plurality of video streams corresponding to the plurality of participant connections, wherein each video stream of the plurality of video streams includes a respective part of the captured video corresponding to the respective device-sharing participant; and
transmitting a plurality of audio streams corresponding to the plurality of participant connections, wherein each audio stream of the plurality of audio streams includes a respective part of the captured audio corresponding to the respective device-sharing participant, and wherein the plurality of video streams and the plurality of audio streams are presented to the at least one other participant.

2. The computing system of claim 1 , wherein the audio analysis comprises at least one of a voiceprinting analysis or a speech recognition analysis.

3. The computing system of claim 1 , wherein the video analysis comprises at least one of a facial detection analysis, a facial recognition analysis, or a lip movement detection analysis.

4. The computing system of claim 1 , wherein the operations further comprise:
determining that a first device-sharing participant of the plurality of device-sharing participants is an active talker; and
routing the captured audio via a first audio stream of the plurality of audio streams corresponding to the first device-sharing participant based on the determining that the first device-sharing participant is the active talker.

5. The computing system of claim 1 , wherein the detecting of the plurality of device-sharing participants is performed based, at least in part, on at least one machine learning analysis of at least one of the captured audio or the captured video.

6. A computer-implemented method comprising:
detecting a plurality of device-sharing participants that are participating in a videoconference via a shared computing device, wherein at least one other participant also participates in the videoconference via at least one other computing device;
joining, to the videoconference, a plurality of participant connections corresponding to the plurality of device-sharing participants, wherein each of the plurality of participant connections is identified within the videoconference using a respective name;
transmitting a plurality of video streams corresponding to the plurality of participant connections; and
transmitting a plurality of audio streams corresponding to the plurality of participant connections, wherein the plurality of video streams and the plurality of audio streams are presented to the at least one other participant.

7. The computer-implemented method of claim 6 , wherein each video stream of the plurality of video streams includes video of a respective device-sharing participant of the plurality of device-sharing participants.

8. The computer-implemented method of claim 6 , wherein the detecting of the plurality of device-sharing participants is performed based, at least in part, on an audio analysis of captured audio from one or more microphones connected to the shared computing device.

9. The computer-implemented method of claim 8 , wherein the audio analysis comprises at least one of a voiceprinting analysis or a speech recognition analysis.

10. The computer-implemented method of claim 6 , wherein the detecting of the plurality of device-sharing participants is performed based, at least in part, on a video analysis of captured video from one or more cameras connected to the shared computing device.

11. The computer-implemented method of claim 10 , wherein the video analysis comprises at least one of a facial detection analysis, a facial recognition analysis, or a lip movement detection analysis.

12. The computer-implemented method of claim 6 , further comprising:
determining that a first device-sharing participant of the plurality of device-sharing participants is an active talker.

13. The computer-implemented method of claim 12 , further comprising:
determining a plurality of voiceprints each corresponding to a respective one of the plurality of device-sharing participants.

14. The computer-implemented method of claim 13 , wherein first device-sharing participant is determined to be the active talker based, at least in part, on voice characteristics of the active talker matching a first voiceprint of the plurality of voiceprints that corresponds to the first device-sharing participant.

15. The computer-implemented method of claim 12 , further comprising:
routing audio via a first audio stream of the plurality of audio streams corresponding to the first device-sharing participant based on the determining that the first device-sharing participant is the active talker.

16. One or more non-transitory computer-readable storage media having stored thereon computing instructions that, upon execution by one or more compute nodes, cause the one or more compute nodes to perform computing operations comprising:
detecting a plurality of device-sharing participants that are participating in a videoconference via a shared computing device, wherein at least one other participant also participates in the videoconference via at least one other computing device;
joining, to the videoconference, a plurality of participant connections corresponding to the plurality of device-sharing participants, wherein each of the plurality of participant connections is identified within the videoconference using a respective name; and
transmitting a plurality of video streams corresponding to the plurality of participant connections; and
transmitting a plurality of audio streams corresponding to the plurality of participant connections, wherein the plurality of video streams and the plurality of audio streams are presented to the at least one other participant.

17. The one or more non-transitory computer-readable storage media of claim 16 , wherein the detecting of the plurality of device-sharing participants is performed based, at least in part, on at least one of an audio analysis of captured audio from one or more microphones connected to the shared computing device or a video analysis of captured video from one or more cameras connected to the shared computing device.

18. The one or more non-transitory computer-readable storage media of claim 16 , wherein the operations further comprise:
determining that a first device-sharing participant of the plurality of device-sharing

Assignees

• Amazon Tech Inc

Inventors

• Dunne John Joseph
• Klingbeil Michael
• Goodwin Michael Mark
• Rao Siddhartha Shankara

Classifications

• G10L17/06

  Decision making techniques; Pattern matching strategies · CPC title

• G10L17/00

  Speaker identification or verification techniques · CPC title

• H04N7/152

  Multipoint control units therefor · CPC title

• H04N7/147

  Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q) · CPC title

• G06V40/172

  Classification, e.g. identification · CPC title