Image capture with digital light path length modulation

Patent metadata

Field	Value
Publication number	US-10057488-B2
Application number	US-201715398705-A
Country	US
Kind code	B2
Filing date	Jan 4, 2017
Priority date	Aug 12, 2016
Publication date	Aug 21, 2018
Grant date	Aug 21, 2018

Abstract

An image capture system comprising an optical path length extender (OPLE) to direct the light having a first polarization through a first light path through the OPLE, and to direct the light having a second polarization through a second light path through the OPLE, the first and second light paths having different light path lengths. The image capture system further comprising an image sensor to capture a plurality of image portions at a plurality of focal distances.

First claim

We claim:

1. An image capture system comprising:
a lens directed at a scene to be captured;
a modulation stack comprising one or more digital light path length modulators, a digital light path length modulator comprising:
a polarization modulator to receive light and to selectively modulate a polarization of the light; and
an optical path length extender (OPLE) to direct the light having a first polarization through a first light path through the OPLE, and to direct the light having a second polarization through a second light path through the OPLE, the first and second light paths having different light path lengths;

wherein the modulation stack adjusts the path length of the light by altering the polarization of the light between the one or more digital light path length modulators to create a plurality of light path lengths; and
an image sensor to capture a plurality of image portions at a plurality of focal distances, from the data captured by the modulation stack, wherein a number of focal distances depends on the number of the one or more digital light path length modulators.

2. The image capture system of claim 1 , wherein a farthest virtual object distance is infinity, and the focal distances move in discrete steps.

3. The image capture system of claim 1 , further comprising:
a digital correction system to separate simultaneously captured image portions with different focal distances.

4. The image capture system of claim 1 , wherein the polarization modulator alters the path length on a time sequential basis, enabling the image sensor to capture a time sequential series of images at a plurality of focal distances.

5. The image capture system of claim 1 , further comprising:
an auxiliary control system to enable selection of the plurality of focal distances for the image capture.

6. The image capture system of claim 1 , further comprising:
a display system to display the plurality of image portions at the plurality of focal distances.

7. The image capture system of claim 1 , further comprising:
a last OPLE in the modulation stack, the last OPLE including a plurality of stripes, to enable simultaneous capture of image elements at two focal distances with the image capture device.

8. The image capture system of claim 1 , further comprising:
a camera body including the image sensor and a lens; and
the modulation stack implemented in a camera lens assembly, enabling retrofitting of an existing camera for multi-focal image capture.

9. The image capture system of claim 1 , further comprising:
a processor to process captured data from the image sensor, the processor to enable one or more of: reconstructing the captured data based on one of polarization or wavelength, perform wavelength-based analysis, reconstructing a light field based on two or more images at different focal distances, generating a 3D scan based on a plurality of images at a plurality of focal distances, and creating a multi-focal 360 degree photo.

10. The image capture system of claim 1 , wherein the image captured is video, and the system continuously captures video frames at a plurality of focal distances.

11. The image capture system of claim 10 , wherein the plurality of focal distances are adjustable during the image capture.

12. An image capture system comprising:
a modulation stack comprising one or more digital light path length modulators, a digital light path length modulator comprising:
a polarization modulator to receive light and to selectively modulate a polarization of the light, wherein the polarization modulator alters the path length on a time sequential basis, enabling the image capture device to capture a time sequential series of images at a plurality of focal distances; and
an optical path length extender (OPLE) to direct the light having a first polarization through a first light path through the OPLE, and to direct the light having a second polarization through a second light path through the OPLE, the first and second light paths having different light path lengths; and

an image capture device to capture a plurality of image portions at a plurality of focal distances.

13. The image capture system of claim 12 , further comprising:
an auxiliary control system to enable selection of a focal distance for the image capture.

14. The image capture system of claim 13 , wherein the auxiliary control system includes content-based focal distance selection to automatically identify one or more focal distances for capture.

15. The image capture system of claim 12 , comprising:
a last OPLE in the modulation stack, the last OPLE including a plurality of stripes, to enable simultaneous capture of image elements at two focal distances with the image capture device.

16. The image capture system of claim 12 , wherein the modulation stack is implemented in a camera lens assembly, enabling retrofitting of an existing camera for multi-focal image capture.

17. An image capture system comprising:
an image capture sub-system including:
a lens directed at a scene to be captured;
a modulation stack comprising one or more digital light path length modulators, a digital light path length modulator comprising:
a polarization modulator to receive light and to selectively modulate a polarization of the light; and
an optical path length extender (OPLE) to direct the light having a first polarization through a first light path through the OPLE, and to direct the light having a second polarization through a second light path through the OPLE, the first and second light paths having different light path lengths; and

an image sensor to capture a plurality of image portions at a plurality of focal distances, from the data captured by the modulation stack, wherein a number of focal distances depends on the number of the one or more digital light path length modulators;
an auxiliary control system to select the plurality of focal distances;
a processor to process the captured data, to generate one or more of: a plurality of images at a plurality of focal distances, or a multi-focal image;
a camera including the image capture subassembly; and
a computer system including the processor, wherein the camera and the computer system are coupled using an I/O system.

18. An optical path length extender (OPLE) comprising:
a plurality of polarization sensitive reflective elements parallel to each other and at an angle of between 20 degrees and 70 degrees to a path of light entering the OPLE, to direct the light having a first polarization through a first light path through the OPLE, and to direct the light having a second polarization through a second light path through the OPLE, the first and second light paths having different light path lengths;
a plurality of light blocking stripes on an entry surface of the OPLE, to block light;
wherein an output of the OPLE comprises alternating stripes of image data, at a first and a second focal distance;
an image capture apparatus to capture image data at two focal distances; and
an image display apparatus to display data at two focal distances.

19. An image capture system comprising:
a lens directed at a scene to be captured;
an optical path length extender (OPLE) to direct the light having a first polarization through a first light path through the OPLE, and to direct the light having a second polarization through a second light path through the OPLE, the first and second light paths having different light path lengths;
a polarizer;
a digital light path length modulator comprising:
a polari

Assignees

• Avegant Corp

Inventors

• Evans Allan Thomas
• Dewald D Scott
• Gross Andrew John

Classifications

• H04N23/676

  Bracketing for image capture at varying focusing conditions · CPC title

• H04N23/63

  by using electronic viewfinders · CPC title

• H04N23/698 Primary

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/54

  Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils · CPC title

• H04N23/55

  Optical parts specially adapted for electronic image sensors; Mounting thereof · CPC title