Hyper temporal lidar with multi-processor return detection

Patent metadata

Field	Value
Publication number	US-11480680-B2
Application number	US-202117490265-A
Country	US
Kind code	B2
Filing date	Sep 30, 2021
Priority date	Mar 26, 2021
Publication date	Oct 25, 2022
Grant date	Oct 25, 2022

Abstract

A lidar receiver can employ multiple processors to distribute the workload of processing returns from laser pulse shots. Activation/deactivation times of pixel sets that are used by the lidar receiver to sense returns can be used to define which samples in a return buffer will be used for processing to detect each return, and multiple processors can share the workload of processing these samples in an effort to improve the latency of return detection.

First claim

What is claimed is:

1. A lidar receiver comprising:
a photodetector array comprising a plurality of pixels, wherein the pixels receive incident light corresponding to a plurality of returns from a plurality of laser pulse shots; and
a signal processing circuit that processes signal data from the photodetector array to detect the returns and compute range information for the detected returns, wherein the signal data is representative of the received incident light;
wherein the signal processing circuit comprises (1) a plurality of processors that distribute a workload of detecting the returns and (2) a buffer for a plurality of samples that represent the signal data, wherein different ones of the processors draw samples from the buffer to operate on groups of samples corresponding to defined detection intervals for returns from different laser pulse shots to detect those returns and compute return information for those returns; and
wherein each of the processors draws a new group of samples from the buffer for return detection operations if that processor is free to process another return, wherein the new group of samples corresponds to a new return to be detected by that processor.

2. The lidar receiver of claim 1 wherein the processors comprise a first processor and a second processor that draw the samples from the buffer for return detection operations on respective next returns on a first come first served basis to distribute the workload of detecting the returns.

3. The lidar receiver of claim 2 further comprising a control circuit that controls which of the pixels are used to detect returns from each laser pulse shot and when those pixels are activated and deactivated for detecting the returns.

4. The lidar receiver of claim 3 wherein the control circuit receives control data, wherein the control data comprises, for each of a plurality of the returns, (1) first data that identifies a pixel set of the array to use for detecting the return, (2) second data that identifies when to start collection from the identified pixel set for detecting the return, and (3) third data that identifies when to stop collection from the identified pixel set.

5. The lidar receiver of claim 3 wherein the control circuit receives the control data from a system controller for a lidar system, wherein the lidar system includes the lidar receiver.

6. The lidar receiver of claim 1 wherein the processors alternate in drawing groups of samples from the buffer.

7. The lidar receiver of claim 1 wherein the processors comprise different microprocessors.

8. The lidar receiver of claim 1 wherein the processors comprise different processing cores of a multi-core processor.

9. The lidar receiver of claim 1 wherein the processors comprise different parallelized processing resources of a field programmable gate array (FPGA).

10. The lidar receiver of claim 1 wherein the processors comprise different parallelized processing resources of an application-specific integrated circuit (ASIC).

11. The lidar receiver of claim 1 wherein the lidar receiver is part of a lidar system, the lidar system further comprising:
a lidar transmitter, wherein the lidar transmitter comprises a scannable mirror, and wherein the lidar transmitter transmits the laser pulse shots toward a plurality of targeted range points via the scannable mirror.

12. The system of claim 11 wherein the lidar transmitter scans the scannable mirror in a resonant mode.

13. The system of claim 12 wherein the lidar transmitter scans the scannable mirror in the resonant mode at a scan frequency in a range between 10 kHz and 15 kHz.

14. The system of claim 11 wherein the scannable mirror comprises a first scannable mirror and a second scannable mirror, wherein the lidar transmitter transmits the laser pulse shots toward the targeted range points via the first and second scannable mirrors.

15. The system of claim 14 wherein the lidar transmitter scans the second scannable mirror in a point-to-point mode according to a step function that varies as a function of the range points targeted with the laser pulse shots.

16. The system of claim 11 wherein the lidar transmitter and the lidar receiver are in a bistatic arrangement with respect to each other.

17. The system of claim 11 further comprising (1) a laser source that generates the laser pulse shots and (2) a control circuit that schedules the laser pulse shots for transmission by the lidar transmitter according to a laser energy model for the laser source.

18. The system of claim 17 wherein the control circuit schedules the laser pulse shots list according to the laser energy model and a mirror motion model for the scannable mirror.

19. The lidar receiver of claim 1 wherein the defined detection intervals for detecting returns are non-uniform across the laser pulse shots so that the groups of samples to be operated on to detect returns from different laser pulse shots are non-uniform in size.

20. The lidar receiver of claim 19 wherein the buffer stores (1) a first group of samples corresponding to a defined first detection interval for detecting a return from a first laser pulse shot, (2) a second group of samples corresponding to a defined second detection interval for detecting a return from a second laser pulse shot, and (3) a third group of samples corresponding to a defined third detection interval for detecting a return from a third laser pulse shot, wherein the first, second, and third groups of samples are stored in the buffer in a time sequence, wherein the first group precedes the second group and the second group precedes the third group within the time sequence;
wherein the processors comprise a first processor and a second processor, wherein the first processor will operate on the first group samples drawn from the buffer to detect the return from the first laser pulse shot followed by the third group of samples drawn from the buffer to detect the return from the third laser pulse shot while the second processor operates on the second group of samples drawn from the buffer to detect the return from the second laser pulse shot if the second group of samples has a size sufficiently larger than a size for the first group of samples so that operations on the second group of samples by the second processor take longer than operations by the first processor on the first group of samples.

21. The lidar receiver of claim 20 wherein the first processor will further operate on a fourth group of samples drawn from the buffer to detect a return from a fourth laser pulse shot if the second processor continues to operate on the second group of samples when the first processor completes its operations on the third group of samples.

22. The lidar receiver of claim 1 wherein the buffer comprises a first buffer, wherein the lidar receiver further comprises a second buffer in which a plurality of control data entries are stored, wherein the control data entries define the detection intervals that correspond to detecting the returns from the laser pulse shots; and
wherein the processors are further configured to process control data entries from the second buffer to identify boundaries between the groups of samples to be drawn from the buffer.

23. The lidar receiver of claim 1 wherein the signal processing circuit further comprises an analog-to-digital converter (ADC) that digitizes the signal data over time to create the samples for storage in the buffer as a time sequence of signal

Assignees

• Aeye Inc

Inventors

• Reddy Naveen
• Steinhardt Allan
• Dussan Luis
• Benscoter Joel
• Liang Alex
• Feru Philippe
• Polishchuk Igor

Classifications

• G01S17/10

  using transmission of interrupted, pulse-modulated waves (determination of distance by phase measurements G01S17/32) · CPC title

• G01S7/4865

  Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak (peak detection in noise, signal conditioning G01S7/487) · CPC title

• G01S7/484

  Transmitters · CPC title

• G01S7/497

  Means for monitoring or calibrating · CPC title

• G01S17/931 Primary

  of land vehicles · CPC title