Real-time image formation from Geiger-mode LADAR

Patent metadata

Field	Value
Publication number	US-11415697-B2
Application number	US-201916419768-A
Country	US
Kind code	B2
Filing date	May 22, 2019
Priority date	May 22, 2019
Publication date	Aug 16, 2022
Grant date	Aug 16, 2022

Abstract

A measured photo-event array is converted from two spatial coordinates and one temporal coordinate into three spatial coordinates for real-time imaging. Laser light pulses illuminate at least one object, and a Geiger-mode avalanche photodiode array receives photons from laser light reflected off the object. For each pulse of the laser light, the GMAPD outputs a first array of photo-events representative of reflected photons. A three-dimensional (3D) Gaussian distribution kernel arranged as a list of array locations to be processed and weight list(s) are provided. The weight list(s) specify an amount array values are scaled based on the Gaussian distribution or photon arrival time. A graphics processing unit arranges the first array of measured photo-events as a list, convolves the Gaussian displacement list with the list of measured photo-events to produce a convolution output, and applies weights from the weight list(s) to the values to produce a density point cloud.

First claim

What is claimed is:

1. An apparatus for converting measured photo-events from a format according to two spatial coordinates and one temporal coordinate into a format according to three spatial coordinates, the apparatus comprising:
a laser configured to pulse laser light illuminating at least one object;
a Geiger-mode avalanche photodiode (GMAPD) array configured to receive photons from portions of the laser light reflected off the at least one object and configured to output, for each pulse of the laser light, an array of photo-events representative of portions of the reflected laser light incident on the GMAPD array; and
a graphics processing unit configured to
provide a Gaussian displacement list forming a filter corresponding to a three-dimensional (3D) Gaussian distribution, the filter arranged as a list of array locations to be incremented, and a weight list specifying an amount by which to increment values based on arrival times,
arrange the array of photo-events as a list of measured photo-events,
convolve the Gaussian displacement list with the list of measured photo-events to produce a convolution output, and
provide weights for blocking loss compensation according to a time of arrival of the measured photo-events, and apply the weights for blocking loss compensation to the values within the convolution output to produce a density point cloud.

2. The apparatus according to claim 1 , wherein the Gaussian displacement list comprises a list of translations from an origin of the 3D Gaussian distribution.

3. The apparatus according to claim 2 , wherein the Gaussian displacement list is at least one of weighted or thresholded and does not occupy a full 3D encompassing volume.

4. The apparatus according to claim 1 , wherein the list of measured photo-events is a sparse list containing only non-zero values.

5. The apparatus according to claim 1 , wherein the weight list more heavily weights list locations corresponding to later times within a range gate than list locations corresponding to earlier times within the range gate.

6. The apparatus according to claim 1 , wherein the array of photo-events is an N R ×N C array, wherein N R is a number of rows, N C is a number of columns, and at least one of N R and N C is greater than one, for each of a plurality of frames.

7. The apparatus according to claim 6 , wherein the 3D Gaussian distribution is centered on an origin, and wherein the plurality of frames encompasses the 3D Gaussian distribution.

8. The apparatus according to claim 6 , wherein the array of photo-events contains one photo-event for each of the plurality of frames.

9. The apparatus according to claim 1 , wherein the graphics processing unit is further configured to aggregate an image portion represented by the density point cloud with other image portions to provide real-time image formation.

10. The apparatus according to claim 1 , further comprising:
processing circuitry coupled to the graphics processing unit and configured to receive the density point cloud and determine a range to the at least one object.

11. A method for converting measured photo-events from a format according to two spatial coordinates and one temporal coordinate into a format according to three spatial coordinates, the method comprising:
pulsing a laser to illuminate at least one object with laser light;
positioning a Geiger-mode avalanche photodiode (GMAPD) array to receive photons from portions of the laser light reflected off the at least one object, the GMAPD array configured to output, for each pulse of the laser light, an array of photo-events representative of portions of the reflected laser light incident on the GMAPD array;
providing a Gaussian displacement list forming a filter corresponding to a three-dimensional (3D) Gaussian distribution, the filter arranged as a list of array locations to be incremented, and a weight list specifying an amount by which to increment array values based on arrival times;
arranging the array of photo-events as a list of measured photo-events;
convolving the Gaussian displacement list with the list of measured photo-events to produce a convolution output;
provide weights for blocking loss compensation according to a time of arrival of the measured photo-events; and
applying the weights for blocking loss compensation to the values within the convolution output to produce a density point cloud.

12. The method according to claim 11 , wherein the Gaussian displacement list comprises a list of translations from an origin of the 3D Gaussian distribution.

13. The method according to claim 12 , wherein the Gaussian displacement list is at least one of weighted or thresholded and does not occupy a full 3D encompassing volume.

14. The method according to claim 11 , wherein the list of measured photo-events is a sparse list containing only non-zero values.

15. The method according to claim 11 , wherein the weight list more heavily weights list locations corresponding to later times within a range gate than list locations corresponding to earlier times within the range gate.

16. The method according to claim 11 , wherein the array of photo-events is an N R ×N C array, wherein N R is a number of rows, N C is a number of columns, and at least one of N R and N C is greater than one, for each of a plurality of frames.

17. The method according to claim 16 , wherein the 3D Gaussian distribution is centered on an origin, and wherein the plurality of frames encompasses the 3D Gaussian distribution.

18. The method according to claim 16 , wherein the array of photo-events contains one photo-event for each of the plurality of frames.

19. The method according to claim 11 , further comprising:
aggregating an image portion represented by the density point cloud with other image portions to provide real-time image formation.

20. The method according to claim 11 , further comprising:
receiving the density point cloud; and
determining a range to the at least one object.

Assignees

• Raytheon Co

Inventors

• Newman Arthur M
• Marcus Eran
• Boland Brian

Classifications

• G01S17/894

  Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar · CPC title

• G01J2001/4466

  Avalanche · CPC title

• G01S17/08

  for measuring distance only (indirect measurement G01S17/46; active triangulation systems G01S17/48) · CPC title

• G01S7/4865 Primary

  Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak (peak detection in noise, signal conditioning G01S7/487) · CPC title

• G01J1/44

  Electric circuits {(for command of an exposure part G03B7/02)} · CPC title