System and method for providing images and video having high dynamic range

Patent metadata

Field	Value
Publication number	US-10264193-B2
Application number	US-201615371031-A
Country	US
Kind code	B2
Filing date	Dec 6, 2016
Priority date	Dec 6, 2016
Publication date	Apr 16, 2019
Grant date	Apr 16, 2019

Abstract

Apparatuses, computer readable media, and methods are disclosed for providing composite images and/or videos having a high dynamic range. The apparatus includes a video capture module for capturing video images of a scene at a differing exposure levels. The apparatus further includes a region identification module for identifying regions in the captured video images of the scene that may benefit from being individually optimally-exposed. The apparatus further includes a region adjustment module for updating the positions of the various identified regions within the scene and a region exposure adjustment module for determining optimal exposure settings for the various identified regions of the scene. A video subsystem composites and encodes the various optimally-exposed regions of the scene onto a video image of a static portion of the scene having a high dynamic range that was, e.g., captured at a different moment in time than the various optimally-exposed regions of the scene.

First claim

What is claimed is:

1. A method, comprising:
segmenting a scene into one or more static regions and one or more dynamic regions;
capturing a first video image of the one or more static regions of the scene at a first exposure level;
capturing a second video image of the one or more static regions of the scene at a second exposure level;
combining at least a portion of the first captured video image with at least a portion of the second captured video image to provide a high dynamic range video image of the one or more static regions of the scene;
capturing a third video image of at least one of the one or more dynamic regions of the scene at a third exposure level; and
compositing the third video image onto the high dynamic range video image of the one or more static regions of the scene to form a composite high dynamic range image.

2. The method of claim 1 , wherein:
at least one of the one or more static regions comprises a background region of the scene.

3. The method of claim 1 , further comprising:
moving at least a portion of the one or more static regions of the scene to the one or more dynamic regions of the scene; or
moving at least a portion of the one or more dynamic regions of the scene to the one or more static regions of the scene.

4. The method of claim 1 , wherein:
the first exposure level is lower than the second exposure level; and
the first exposure level and second exposure level are configured to provide a high dynamic range capture of the one or more static regions of the scene at a first moment in time.

5. The method of claim 1 , wherein:
the third exposure level is configured to provide an optimal exposure of at least one of the one or more dynamic regions of the scene.

6. The method of claim 1 , wherein:
the first video image and the second video image are each captured at a different moment in time than the third video image is captured at.

7. The method of claim 1 , wherein:
the first video image and the second video image are captured with a first camera; and
the third video image is captured with a second camera.

8. The method of claim 1 , further comprising:
capturing a fourth video image of at least one of the one or more dynamic regions of the scene at a fourth exposure level; and
compositing the fourth video image onto the high dynamic range video image of the one or more static regions of the scene,
wherein the third video image and the fourth video image capture different dynamic regions of the scene,
wherein the third video image is captured with a first camera, and
wherein the fourth video image is captured with a second camera.

9. An apparatus for providing a high dynamic range video image of a scene, comprising:
one or more video sensors for:
capturing a first video image of the scene at a first exposure level;
capturing a second video image of the scene at a second exposure level; and
capturing a third video image of the scene at a third exposure level; and

a processing unit programmed with software instructions that when executed by the processing unit cause the processing unit to:
segment the scene into one or more static regions and one or more dynamic regions, wherein the first video image comprises a capture of one or more static regions of the scene, wherein the second video image comprises a capture of the one or more static regions of the scene, and wherein the third video image comprises a capture of one or more dynamic regions of the scene;
combine at least a portion of the first captured video image with at least a portion of the second captured video image to provide a high dynamic range video image of the one or more static regions of the scene; and
composite the third video image onto the high dynamic range video image of the one or more static regions of the scene to form a composite high dynamic range image.

10. The apparatus of claim 9 , wherein the software instructions, when executed by the processing unit, further cause the processing unit to:
identify that at least one of the one or more static regions comprises a background region of the scene.

11. The apparatus of claim 9 , wherein the software instructions, when executed by the processing unit, further cause the processing unit to:
move at least a portion of the one or more static regions of the scene to the one or more dynamic regions of the scene; or
move at least a portion of the one or more dynamic regions of the scene to the one or more static regions of the scene.

12. The apparatus of claim 9 , wherein:
the first exposure level is lower than the second exposure level; and
the first exposure level and second exposure level are configured to provide a high dynamic range capture of the one or more static regions of the scene at a first moment in time.

13. The apparatus of claim 9 , wherein:
the third exposure level is configured to provide an optimal exposure of at least one of the one or more dynamic regions of the scene.

14. The apparatus of claim 9 , wherein the software instructions, when executed by the processing unit, further cause the processing unit to:
capture the first video image and the second video image at a different moment in time than the third video image is captured.

15. The apparatus of claim 9 , wherein:
the first video image and the second video image are captured with a first video sensor; and
the third video image is captured with a second video sensor.

16. The apparatus of claim 9 , wherein the software instructions, when executed by the processing unit, further cause the processing unit to:
initiate a capture of a fourth video image of at least one of the one or more dynamic regions of the scene at a fourth exposure level; and
composite the fourth video image onto the high dynamic range video image of the one or more static regions of the scene,
wherein the third video image and the fourth video image capture different dynamic regions of the scene,
wherein the third video image is captured with a first video sensor, and
wherein the fourth video image is captured with a second video sensor.

17. A non-transitory program storage device, readable by a programmable control device, comprising instructions stored thereon that, when executed, cause the programmable control device to:
segment a scene into one or more static regions and one or more dynamic regions;
initiate a capture of a first video image of the one or more static regions of the scene at a first exposure level;
initiate a capture of a second video image of the one or more static regions of the scene at a second exposure level;
combine at least a portion of the first captured video image with at least a portion of the second captured video image to provide a high dynamic range video image of the one or more static regions of the scene;
initiate a capture of a third video image of at least one of the one or more dynamic regions of the scene at a third exposure level; and
composite the third video image onto the high dynamic range video image of the one or more static regions of the scene to form a composite high dynamic range image.

18. The non-transitory program storage device of claim 17 , wherein:
at least one of the one or more static regions comprises a background region of the scene.

19. The non-transitory program storage device of claim 17 , further comprising instructions stored thereon that, when executed, cause the programmable control device to:
move at least a portion of the one or more static regions of the scene to the one or more dynami

Assignees

• Polycom Inc

Inventors

• Schaefer Stephen

Classifications

• H04N23/741

  by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors · CPC title

• H04N23/73 Primary

  by influencing the exposure time · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• H04N7/147 Primary

  Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q) · CPC title

• G06T2207/20208

  High dynamic range [HDR] image processing · CPC title