Adaptive screen layout for video conferencing

Patent metadata

Field	Value
Publication number	US-9800931-B1
Application number	US-201615176713-A
Country	US
Kind code	B1
Filing date	Jun 8, 2016
Priority date	Jun 8, 2016
Publication date	Oct 24, 2017
Grant date	Oct 24, 2017

Abstract

Adaptively adjusting the layout of a video conference includes receiving, at a first video conference endpoint, a video stream from a second video conference endpoint. Activity in an environment of the first video conference endpoint or an environment of the second video conference endpoint is detected with at least one physical activity sensor. Based on the detected activity, a presentation of the video stream at the first video conference endpoint is dynamically adjusted.

First claim

What is claimed is:

1. A method comprising:
receiving, at a first video conference endpoint, a video stream from a second video conference endpoint;
displaying a presentation of the video stream on a display of the first video conference endpoint;
displaying, on the display of the first video conference endpoint, collaborative content generated by at least one of the first video conference endpoint and the second video conference endpoint;
detecting activity in an environment of the first video conference endpoint or an environment of the second video conference endpoint with one or more physical activity sensors; and
based on the activity detected by the one or more physical activity sensors, dynamically adjusting the presentation of the video stream on the display of the first video conference endpoint with respect to the collaborative content to selectively obscure the collaborative content or the presentation.

2. The method of claim 1 , wherein the video stream is a first video stream, the presentation is a first presentation, and the method further comprises:
receiving a second video stream from a third video conference endpoint;
displaying a second presentation of the second video stream on the display of the first video conference endpoint; and
dynamically adjusting the second presentation of the second video stream based on the activity detected by the one or more physical activity sensors.

3. The method of claim 1 , wherein dynamically adjusting further comprises at least one of:
adjusting a transparency of a window containing the presentation of the video stream; and
adjusting a size of the window.

4. The method of claim 1 , wherein dynamically adjusting further comprises:
adjusting the presentation when the activity detected by the one or more physical activity sensors satisfies a threshold.

5. The method of claim 1 , wherein the one or more physical activity sensors include at least one of a proximity sensor, a microphone, a camera, a display of the first video conference endpoint, and a display of the second video conference endpoint and the activity detected by the one or more physical activity sensors is at least one of:
drawing activity occurring on the display of the first video conference endpoint or on the display of the second video conference endpoint;
audio activity detected by the microphone occurring proximate the first video conference endpoint; and
presenting activity detected by the proximity sensor in the environment of the first video conference endpoint.

6. The method of claim 1 , wherein dynamically adjusting further comprises:
adjusting the presentation incrementally over time.

7. The method of claim 1 , wherein dynamically adjusting further comprises:
adjusting the presentation of the video stream to uncover obscured portions of the collaborative content when the one or more physical activity sensors detect whiteboarding activity in the environment of the first video conference endpoint.

8. An apparatus comprising:
a network interface configured to provide network connectivity on behalf of a first video conference endpoint;
a display;
one or more physical activity sensors configured to detect activity in an environment of the first video conference endpoint; and
a processor coupled to the network interface, the display, and the one or more physical activity sensors, the processor being configured to:
receive a video stream from a second video conference endpoint;
display a presentation of the video stream on the display;
display, on the display, collaborative content generated by at least one of the apparatus and the second video conference endpoint; and
based on the activity detected by the one or more physical activity sensors, dynamically adjust the presentation of the video stream on the display with respect to the collaborative content to selectively obscure the collaborative content or the presentation.

9. The apparatus of claim 8 , wherein the video stream is a first video stream, the presentation is a first presentation, and the processor is further configured to:
receive a second video stream from a third video conference endpoint;
display a second presentation of the second video stream on the display; and
dynamically adjust the second presentation of the second video stream based on the activity detected by the one or more physical activity sensors.

10. The apparatus of claim 8 , wherein in dynamically adjusting, the processor is further configured to:
adjust a transparency of a window containing the presentation of the video stream; and
adjust a size of the window.

11. The apparatus of claim 8 , wherein in dynamically adjusting, the processor is further configured to:
adjust the presentation when the activity detected by the one or more physical activity sensors satisfies a threshold.

12. The apparatus of claim 8 , wherein the one or more physical activity sensors include at least one of a proximity sensor, a microphone, a camera, a display of the first video conference endpoint, and a display of the second video conference endpoint and the activity detected by the one or more physical activity sensors is at least one of:
drawing activity occurring on the display of the first video conference endpoint or on the display of the second video conference endpoint;
audio activity detected by the microphone occurring proximate the first conference endpoint; and
presenting activity detected by the proximity sensor in the environment of the first video conference endpoint.

13. The apparatus of claim 8 , wherein in dynamically adjusting, the processor is further configured to:
adjust the presentation incrementally over time.

14. A non-transitory computer-readable storage media encoded with software comprising computer executable instructions and when the software is executed operable to:
receive, at a first video conference endpoint, a video stream from a second video conference endpoint;
display a presentation of the video stream on a display of the first video conference endpoint;
display, on the display of the first video conference endpoint, collaborative content generated by at least one of the first video conference endpoint and the second video conference endpoint;
detect activity in an environment of the first video conference endpoint or an environment of the second video conference endpoint with one or more physical activity sensors; and
based on the activity detected by the one or more physical activity sensors, dynamically adjust the presentation of the video stream on the display of the first video conference endpoint with respect to the collaborative content to selectively obscure the collaborative content or the presentation.

15. The non-transitory computer-readable storage media of claim 14 , wherein the instructions operable to dynamically adjust the presentation are further operable to:
adjust a transparency of a window containing the presentation of the video stream; and
adjust a size of the window.

16. The non-transitory computer-readable storage media of claim 14 , wherein the video stream is a first video stream, the presentation is a first presentation, and the instructions are further operable to:
receive a second video stream from a third video conference endpoint;
display a second presentation of the second video stream on the display of the first video conference endpoint; and
dynamically adjust the second presentation of the second video stream based on the activity detected by the one or more physical activity sensors.

17. The non-transitory

Assignees

• Cisco Tech Inc

Inventors

• Tangeland Kristian
• Østensen Kristian Magnus Hage
• Schirdewahn Jochen Christof

Classifications

• H04N21/4438 Primary

  Window management, e.g. event handling following interaction with the user interface · CPC title

• H04N7/15

  Conference systems · CPC title

• H04N21/4788

  communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)} · CPC title

• H04N21/42224

  Touch pad or touch panel provided on the remote control · CPC title

• H04N21/44218

  Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45) · CPC title