High dynamic range light-field imaging

Patent metadata

Field	Value
Publication number	US-2017332000-A1
Application number	US-201615150679-A
Country	US
Kind code	A1
Filing date	May 10, 2016
Priority date	May 10, 2016
Publication date	Nov 16, 2017
Grant date	—

Abstract

A high dynamic range light-field image may be captured through the use of a light-field imaging system. In a first sensor of the light-field imaging system, first image data may be captured at a first exposure level. In the first sensor or in a second sensor of the light-field imaging system, second imaging data may be captured at a second exposure level greater than the first exposure level. In a data store, the first image data and the second image data may be received. In a processor, the first image data and the second image data may be combined to generate a light-field image with high dynamic range.

First claim

What is claimed is:

1 . A method for capturing a light-field image, the method comprising:
in a first sensor of a light-field imaging system, capturing first image data at a first exposure level; in an element selected from the group consisting of the first sensor and a second sensor of the light-field imaging system, capturing second image data at a second exposure level different from the first exposure level; in a data store, receiving the first image data and the second image data; and in a processor, combining the first image data and the second image data to generate a light-field image.

2 . The method of claim 1 , wherein:
the element comprises the first sensor; and the light-field imaging system comprises a plenoptic light-field camera comprising the first sensor, an aperture through which light enters the plenoptic light-field camera, and a microlens array positioned to direct the light onto the first sensor.

3 . The method of claim 2 , wherein the plenoptic light-field camera is configured to carry out color differentiation through use of one or more color differentiation elements positioned at the first sensor.

4 . The method of claim 2 , wherein the plenoptic light-field camera is configured to carry out color differentiation through use of one or more color differentiation elements positioned at the aperture.

5 . The method of claim 2 , wherein the plenoptic light-field camera is configured to carry out color differentiation through use of one or more color differentiation elements positioned at the microlens array.

6 . The method of claim 2 , wherein the plenoptic light-field camera is configured to carry out exposure differentiation through use of one or more exposure differentiation elements positioned at the first sensor.

7 . The method of claim 2 , wherein the plenoptic light-field camera is configured to carry out exposure differentiation through use of one or more exposure differentiation elements positioned at the aperture.

8 . The method of claim 2 , wherein the plenoptic light-field camera is configured to carry out exposure differentiation through use of one or more exposure differentiation elements positioned at the microlens array.

9 . The method of claim 1 , wherein:
the light-field imaging system comprises a camera array comprising a plurality of cameras comprising at least a first camera having the first sensor and a second camera having a second sensor; and the element comprises the second sensor.

10 . The method of claim 9 , wherein the second camera has a second exposure setting different from a first exposure setting of the first camera.

11 . The method of claim 1 , wherein:
the light-field imaging system comprises at least a first camera comprising the first sensor; the element comprises the first sensor; capturing the second image data comprises capturing the second image data non-simultaneously with capture of the first image data; and the method further comprises changing a first camera exposure level of the first camera after capture of one of the first image data and the second image data, and before capture of the other of the first image data and the second image data.

12 . The method of claim 11 , wherein changing the first camera exposure level comprises using an exposure differentiation element that electronically controls the first sensor to change the first camera exposure level between the first exposure level and the second exposure level.

13 . The method of claim 11 , wherein changing the first camera exposure level comprises using an exposure differentiation element that modifies transmissivity of an optical pathway within the first camera to control a proportion of light entering the first camera that is received by the first sensor to change the first camera exposure level between the first exposure level and the second exposure level.

14 . The method of claim 11 , wherein:
changing the first camera exposure level comprises using a first exposure differentiation element that electronically controls the first sensor to change the first camera exposure level between the first exposure level and the second exposure level; and changing the first camera exposure level further comprises using a second exposure differentiation element that modifies transmissivity of an optical pathway within the first camera to control a proportion of light entering the first camera that is received by the first sensor to change the first camera exposure level between the first exposure level and the second exposure level.

15 . A non-transitory computer-readable medium for capturing a light-field image, comprising instructions stored thereon, that when executed by a processor, perform the steps of:
causing a first sensor of a light-field imaging system to capture first image data at a first exposure level; causing an element selected from the group consisting of the first sensor and a second sensor of the light-field imaging system to capture second image data at a second exposure level different from the first exposure level; causing a data store to receive the first image data and the second image data; and combining the first image data and the second image data to generate a light-field image.

16 . The non-transitory computer-readable medium of claim 15 , wherein:
the element comprises the first sensor; and the light-field imaging system comprises a plenoptic light-field camera comprising the first sensor, an aperture through which light enters the plenoptic light-field camera, and a microlens array positioned to direct the light onto the first sensor.

17 . The non-transitory computer-readable medium of claim 16 , wherein the plenoptic light-field camera is configured to carry out color differentiation through use of one or more color differentiation elements positioned at one or more of the first sensor, the aperture, and the microlens array.

18 . The non-transitory computer-readable medium of claim 16 , wherein the plenoptic light-field camera is configured to carry out exposure differentiation through use of one or more exposure differentiation elements positioned at one or more of the first sensor, the aperture, and the microlens array.

19 . The non-transitory computer-readable medium of claim 15 , wherein:
the light-field imaging system comprises a camera array comprising a plurality of cameras comprising at least a first camera having the first sensor and a second camera having a second sensor; the element comprises the second sensor; and the second camera has a second exposure setting different from a first exposure setting of the first camera.

20 . The non-transitory computer-readable medium of claim 15 , wherein:
the light-field imaging system comprises at least a first camera comprising the first sensor; the element comprises the first sensor; capturing the second image data comprises capturing the second image data non-simultaneously with capture of the first image data; and the non-transitory computer-readable medium further comprises instructions stored thereon, that when executed by a processor, change a first camera exposure level of the first camera after capture of one of the first image data and the second image data, and before capture of the other of the first image data and the second image data.

21 . The non-transitory computer-readable medium of claim 20 , wherein changing the first camera exposure level comprises causing an exposure differentiation element to electr

Assignees

• Lytro Inc

Inventors

• Wang Zejing
• Akeley Kurt
• Pitts Colvin
• Karafin Jon

Classifications

• H04N23/957

  Light-field or plenoptic cameras or camera modules · CPC title

• H04N23/741 Primary

  by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors · CPC title

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title

• H04N23/743

  Bracketing, i.e. taking a series of images with varying exposure conditions · CPC title

• H04N13/232 Primary

  using fly-eye lenses, e.g. arrangements of circular lenses · CPC title