Panoramic image placement to minimize full image interference

Patent metadata

Field	Value
Publication number	US-9843770-B2
Application number	US-201615252093-A
Country	US
Kind code	B2
Filing date	Aug 30, 2016
Priority date	Oct 5, 2015
Publication date	Dec 12, 2017
Grant date	Dec 12, 2017

Abstract

An automatic process for producing professional, directed, production crew quality, video for videoconferencing is described. Rule based logic is integrated into an automatic process for producing director quality video for videoconferencing. An automatic process can include a method for composing a display for use in a video system having an active talker video stream and a panoramic view video stream having more than one person in video. The method can include determining a region of interest in a panoramic view video using motion detection and presence sensors, and preparing the panoramic view video by centering the region of interest and by zooming towards the region of interest, based upon the location of persons in the panoramic view video. The method includes determining placement of panoramic view video on a composite display to prevent the panoramic view video overlaying display of an active talker on the active talker video stream.

First claim

What is claimed is:

1. A method for composing a display for use in a video system having an active talker video stream and a panoramic view video stream having more than one person in video, the method comprising:
determining, using a processor, a region of interest in a panoramic view video using motion detection and presence sensors;
preparing, using the processor, the panoramic view video by centering the region of interest and by zooming towards the region of interest, based upon location of persons in the panoramic view video; and
determining, using the processor and responsive to a change in position of an active talker, where to place the panoramic view video on a composite display to prevent the panoramic view video from overlaying display of the active talker in the active talker video stream while maintaining a scale of the active talker video stream.

2. The method of claim 1 wherein the step of determining where to place the panoramic view video comprises:
determining the location of the active talker and placing the panoramic view video at bottom of a display.

3. The method of claim 1 wherein the step of determining where to place the panoramic view video comprises:
placing the panoramic view video at top of display.

4. The method of claim 1 wherein the step of determining where to place the panoramic view video comprises removing the panoramic view video from display.

5. The method of claim 1 further comprising shifting the active talker video stream lower so that an upper portion of the active talker video stream is cropped.

6. The method of claim 1 further comprising shifting the active talker video stream higher so that a lower portion of the active talker video stream is cropped.

7. A multipoint control unit (MCU) for intelligently displaying an active talker video stream and a panoramic view video stream having more than one person in video, the MCU comprising:
at least one display device;
at least one camera coupled to the at least one display device;
a processor coupled to the at least one camera and the at least one display device, the processor having a set of computer readable instructions associated therewith, the processor configured to, upon execution of the instructions, cause the MCU to:
determine a region of interest in a panoramic view video using motion detection and presence sensors;
prepare the panoramic view video by centering the region of interest and by zooming towards the region of interest, based upon location of persons in the panoramic view video; and
determine, responsive to a detection of a change in position of an active talker within the active talker video stream, where to display the panoramic view video on a composite display rendered on the at least one display device to prevent the panoramic view video from overlaying display of the active talker on the active talker video stream, while keeping constant scaling of the active talker video stream.

8. The MCU of claim 7 wherein the instructions further comprise instructions to determine where to place the panoramic view video based on determining the location of the active talker and placing the panoramic view video at bottom of the at least one display device.

9. The MCU of claim 7 wherein determining where to place the panoramic view video comprises:
placing the panoramic view video at top of the at least one display device.

10. The MCU of claim 7 wherein determining where to place the panoramic view video comprises removing the panoramic view video from the at least one display device.

11. The MCU of claim 7 ; further configured to shift the position of the active talker video stream lower so that an upper portion of the active talker video stream is cropped.

12. The MCU of claim 7 , further configured to shift the active talker video stream higher so that a lower portion of the active talker video stream is cropped.

13. A method for composing a display for use in a video system having an active talker video stream and a panoramic view video stream having more than one person in video, the method comprising:
determining a region of interest in a panoramic view video using motion detection and presence sensors;
preparing for display the panoramic view video including centering the region of interest and zooming towards location of one or more persons in the panoramic view video; and
automatically arranging a composite display on a display device, the composite display including both the active talker video stream and the prepared panoramic view video, wherein the panoramic view video overlays a portion of the active talker video stream and does not overlay a display of an active talker in the active talker video stream, and scaling of the active talker video stream is constant throughout any change of position of the active talker therein.

14. The method of claim 13 wherein the active talker is centrally displayed on the display device.

15. The method of claim 13 wherein arranging a composite display comprises shifting display of active talker video stream lower on the display device.

16. The method of claim 13 wherein arranging a display further comprises shifting display of the active talker video stream higher on the display device.

17. A multipoint control unit (MCU) for intelligently displaying an active talker video stream and a panoramic view video stream having more than one person in video, the MCU comprising:
at least one display device;
at least one camera coupled to the display device;
a processor coupled to the camera and display device, the processor having a set of computer readable instructions associated therewith, the processor configured to, upon execution of the instructions, control the MCU to:
determine a region of interest in a panoramic view video using motion detection and presence sensors;
prepare for display the panoramic view video including centering the region of interest and zooming towards location of one or more persons in the panoramic view video; and
arrange a composite display on the display device, the composite display including both the active talker video stream and the prepared panoramic view video, wherein the panoramic view video overlays a portion of the active talker video stream and does not overlay a display of an active talker in the active talker video stream, and scaling of the active talker video stream is constant throughout any change of position of the active talker therein.

18. The MCU of claim 17 wherein the instructions further comprise instructions to control the MCU to centrally display the active talker on the display device.

19. The MCU of claim 17 wherein arranging a composite display comprises shifting lower display of active talker video lower on the display device.

20. The MCU of claim 17 wherein the panoramic view includes at least one of closed captioning information, pre-recorded video, or other graphical information.

Assignees

• Polycom Inc

Inventors

• Nimri Alain Elon
• Gao Shu
• Schaefer Stephen
• Murphy Robert

Classifications

• H04N7/152 Primary

  Multipoint control units therefor · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• G10L21/028

  using properties of sound source · CPC title

• G10L25/72

  for transmitting results of analysis · CPC title