Energy optimized imaging system with synchronized dynamic control of directable beam light source and reconfigurably masked photo-sensor

Patent metadata

Field	Value
Publication number	US-11747135-B2
Application number	US-201916516664-A
Country	US
Kind code	B2
Filing date	Jul 19, 2019
Priority date	Feb 13, 2015
Publication date	Sep 5, 2023
Grant date	Sep 5, 2023

Abstract

An energy optimized imaging system that includes a light source that has the ability to illuminate specific pixels in a scene, and a sensor that has the ability to capture light with specific pixels of its sensor matrix, temporally synchronized such that the sensor captures light only when the light source is illuminating pixels in the scene.

First claim

We claim:

1. A method of detecting an image, comprising:
enabling a first row of a pixels of a two-dimensional pixel array to detect light reflected from at least one object illuminated by a first light pulse from a first scanning line of a directable light source, the first row of pixels in an epipolar configuration with the first scanning line; and
enabling a second row of pixels of a two-dimensional pixel array to detect light reflected from the at least one object illuminated by a second light pulse from a second scanning line of the directable light source, the second row of pixels in an epipolar configuration with the second scanning line.

2. The method of claim 1 , further comprising:
generating detection signals corresponding to the detected light reflected from the at least one object when illuminated by each of the first and second light pulses.

3. The method of claim 2 further comprising:
generating depth information based on the generated detection signals corresponding to the detected light reflected from the object by the first and second light pulses.

4. The method of claim 2 , wherein enabling the two-dimensional pixel array to detect light reflected from the at least one object illuminated by the first or second light pulses comprises:
determining an active region of the two-dimensional pixel array corresponding to a portion of the object being illuminated by the first or second light pulse; and
enabling the determined active region during the first or second light pulses.

5. A device, comprising:
a two-dimensional pixel array comprising a plurality of lines of pixels;
a directable light source; and
a controller to:
enable a first row of pixels of the two-dimensional pixel array to detect light reflected from at least one object illuminated by a first light pulse from a first scanning line of the directable light source, the first row of pixels in an epipolar configuration with the first scanning line; and
enable a second row of pixels of the two-dimensional pixel array to detect light reflected from the at least one object illuminated by a second light pulse from a second scanning line of the directable light source, the second row of pixels in an epipolar configuration with the second scanning line.

6. The device of claim 5 wherein the controller further:
generates detection signals corresponding to the detected light reflected from the object when illuminated by each of the first and second light pulses;
generates depth information based on the generated detection signals.

7. The device of claim 5 wherein the controller further:
determines a sequence of portions of the object to be illuminated;
directs the directable light source to sequentially illuminate the sequence of portions; and
directs the two-dimensional pixel array to sequentially capture light from the sequence of illuminated portions.

8. The device of claim 7 wherein the controller further:
temporally synchronizes the directable light source and the two-dimensional pixel array such that the two-dimensional pixel array captures light from a portion of the object illuminated by the directable light source.

9. The device of claim 7 wherein the controller further:
spatially synchronizes the directable light source and the two-dimensional pixel array such that the directable light source illuminates a portion of the object that the two-dimensional pixel array is configured to capture.

10. The device of claim 9 wherein the sequence of portions of the object to be illuminated is chosen to maximize total energy transferred from the directable light source to the two-dimensional pixel array.

Assignees

• Univ Carnegie Mellon
• Governing Council Univ Toronto

Inventors

• Narasimhan Srinivasa
• Achar Supreeth
• O'Toole Matthew
• Kutulakos Kiriakos Neoklis

Classifications

• G01B11/2513 Primary

  with several lines being projected in more than one direction, e.g. grids, patterns · CPC title

• G01B11/2518

  Projection by scanning of the object · CPC title

• G01B11/2545

  with one projection direction and several detection directions, e.g. stereo · CPC title

• G03B21/2033

  LED or laser light sources · CPC title

• H04N5/30

  Transforming light or analogous information into electric information (scanning details H04N3/00; cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00; circuitry of solid-state image sensors [SSIS] or control thereof H04N25/00) · CPC title