Systems and methods for digital imaging using computational pixel imagers with multiple in-pixel counters

Patent metadata

Field	Value
Publication number	US-11856302-B2
Application number	US-202218083783-A
Country	US
Kind code	B2
Filing date	Dec 19, 2022
Priority date	Feb 4, 2019
Publication date	Dec 26, 2023
Grant date	Dec 26, 2023

Abstract

A stereo imaging system includes an optical assembly and a computational pixel imager (CPI) having a plurality of pixels. Each pixel includes a light sensor and counters that convert a photocurrent from the light sensor to a digital signal. The optical assembly, which directs light from a light field to the CPI, includes an optical field combiner and first and second primary lens assemblies, which are configured to receive first and second portions of the light from the lightfield, respectively, and to direct the first and second portions of the light to the optical field combiner. The optical field combiner includes a modulator configured to modulate the first and second portions of the light and to direct modulated first and second portions of the light onto the CPI. The counters are configured to perform digital signal processing on the digital signal.

First claim

The invention claimed is:

1. An imaging system, comprising:
a camera configured to capture images of an environment, the camera including a computational pixel imager (CPI) having a plurality of pixels, each of the pixels including:
a first counter configured to count up and down at a frequency F1 of a first modulated light source in the environment, such that a periodicity of an up-down count pattern of the first counter is synchronized with the frequency F1,
a second counter configured to count up and down at a frequency F2 of a second modulated light source in the environment, such that a periodicity of an up-down count pattern of the second counter is synchronized with the frequency F2, and
a third counter configured to count up and down at a frequency F3 of a third modulated light source in the environment, such that a periodicity of an up-down count pattern of the third counter is synchronized with the frequency F3,
wherein the frequencies F1, F2, and F3 are different from each other.

2. The imaging system of claim 1 , wherein each of the pixels of the CPI includes:
a light sensor configured to convert light to photocurrent, and
converter circuitry configured to convert the photocurrent to pulses and to provide the pulses to the counters, the converter circuitry comprising one of both of: current-to-frequency circuitry and voltage-to-frequency circuitry.

3. The imaging system of claim 1 , further comprising a controller configured to control at least one of the counters independently from at least one other one of the counters.

4. The imaging system of claim 1 , wherein the camera is movable within the environment.

5. The imaging system of claim 1 , further comprising a processor configured to determine a location of the camera in the environment, wherein:
the first, second, and third modulated light sources are located at predetermined positions in the environment, and
the processor is configured to determine the location of the camera based on light from the first modulated light source, light from the second modulated light source, and light from the third modulated light source.

6. The imaging system of claim 5 , wherein the CPI is configured to produce digital signals and to process the digital signals to produce image data for an image of an object in the environment.

7. The imaging system of claim 6 , wherein some or all of the pixels of the CPI are configured to perform a differencing process such that:
the first counter rejects a signal from an object illuminated by a light source that is not modulated at the frequency F1,
the second counter rejects a signal from an object illuminated by a light source that is not modulated at the frequency F2, and
the third counter rejects a signal from an object illuminated by a light source that is not modulated at the frequency F3.

8. The imaging system of claim 1 , further comprising a laser apparatus configured to project a predetermined light pattern onto an object in the environment,
wherein, for some or all of the pixels of the CPI, at least some of the counters are synchronized with a modulation of the predetermined light pattern to enable a detection of a shape of the object by detection of the predetermined light pattern.

9. The imaging system of claim 8 , wherein the laser apparatus includes a laser source modulated at a frequency FL different from the frequencies F1, F2, and F3.

10. The imaging system of claim 9 , wherein some or all of the pixels of the CPI include counters that reject a signal from an object illuminated by a light source that is not modulated at the frequency FL.

11. The imaging system of claim 1 , further comprising a laser apparatus configured to project a predetermined light pattern onto an object in the environment,
wherein, for some or all of the pixels of the CPI, at least some of the counters are synchronized with a modulation of the predetermined light pattern to enable a detection of one or both of: a change in a position of the object and a change in an environment near the object, by detection of the predetermined light pattern.

12. The imaging system of claim 1 , further comprising a light source configured to illuminate an object in the environment with modulated light having a frequency greater than 1 MHz,
wherein, for some or all of the pixels of the CPI, at least some of the counters are configured to acquire distance data on a distance to the object based on the modulated light returned or scattered from the object.

13. The imaging system of claim 12 , wherein the frequency of the modulated light is in a range of about 60 MHz to 100 MHz.

14. The imaging system of claim 12 , wherein the distance data comprises in-phase (I) and quadrature (Q) phase signals derived from the modulated light returned or scattered from the object.

15. The imaging system of claim 5 , wherein:
the first counters of the pixels of the CPI are synchronized with the frequency F1 of the first modulated light source and detect data for a first shadow image of the object,
the second counters of the pixels of the CPI are synchronized with the frequency F2 of the second modulated light source and detect data for a second shadow image of the object,
the third counters of the pixels of the CPI are synchronized with the frequency F3 of the third modulated light source and detect data for a third shadow image of the object, and
the processor is programmed to determine at least one of: a geometry of the object and a location of the object, based on the first, second, and third shadow images of the object.

Assignees

• Anduril Industries Inc

Inventors

• Kelly Michael W
• Colonero Curtis
• David Christopher
• Bari Joseph
• Ross William

Classifications

• H04N23/11

  for generating image signals from visible and infrared light wavelengths · CPC title

• H04N25/75

  Circuitry for providing, modifying or processing image signals from the pixel array · CPC title

• H04N23/20

  for generating image signals from infrared radiation only · CPC title

• H10F39/197

  Bipolar transistor image sensors · CPC title

• H04N25/772

  comprising A/D, V/T, V/F, I/T or I/F converters · CPC title