Hyper temporal lidar with dynamic shot scheduling using a laser energy model

Patent metadata

Field	Value
Publication number	US-12050286-B2
Application number	US-202318134222-A
Country	US
Kind code	B2
Filing date	Apr 13, 2023
Priority date	Mar 26, 2021
Publication date	Jul 30, 2024
Grant date	Jul 30, 2024

Abstract

A lidar system that includes a laser source and a scannable mirror can also include a circuit that schedules a variable rate firing of a plurality of upcoming laser pulse shots by the laser source using a laser energy model as compared to a plurality of energy requirements applicable to the upcoming laser pulse shots, and wherein the laser energy model takes into consideration a retention of energy in the laser source after the upcoming laser pulse shots are fired and quantitatively predicts available energy amounts for the upcoming laser pulse shots from the laser source based on a history of prior laser pulse shots by the laser source. The laser energy model is capable of modeling the energy available for laser pulse shots in the laser source over very short time intervals (such as 10-100 nanoseconds).

First claim

What is claimed is:

1. A lidar system comprising:
a laser source;
a mirror positioned to reflect a plurality of laser pulse shots from the laser source into a field of view, wherein the mirror is scannable to control where the laser pulse shots are directed in the field of view; and
a circuit that schedules a variable rate firing of a plurality of upcoming laser pulse shots by the laser source using a laser energy model as compared to a plurality of energy requirements applicable to the upcoming laser pulse shots, and wherein the laser energy model takes into consideration a retention of energy in the laser source after the upcoming laser pulse shots are fired and quantitatively predicts available energy amounts for the upcoming laser pulse shots from the laser source based on a history of prior laser pulse shots by the laser source.

2. The system of claim 1 wherein the mirror scans in a resonant mode.

3. The system of claim 2 wherein the mirror scans through a plurality of scan angles along a scan axis in the resonant mode;
wherein the scheduled laser pulse shots comprise a plurality of upcoming laser pulse shots that are to target to a plurality of scan angles in the field of view; and
wherein the circuit schedules the variable rate firing of the upcoming laser pulse shots by the laser source using (1) the laser energy model as compared to the energy requirements applicable to the upcoming laser pulse shots and (2) a mirror motion model that models the scan angles for the mirror over time.

4. The system of claim 3 wherein the circuit determines a plurality of range points in the field of view to be targeted by upcoming laser pulse shots based on a determination that the targeted range points are in a region of interest within the field of view, wherein the targeted range points are defined by coordinates in the field of view, and wherein the coordinates include scan angles with respect to the mirror.

5. The system of claim 3 wherein the mirror motion model models the scan angles for the mirror as a plurality of time slots, and wherein the circuit schedules the upcoming laser pulse shots by generating a shot list that assigns the upcoming laser pulse shots to time slots that are applicable to the targeted scan angles according to the mirror motion model if the laser energy model indicates that there will be sufficient energy available in the laser source with respect to the applicable time slots in view of the energy requirements applicable to the upcoming laser pulse shots that correspond to the applicable time slots.

6. The system of claim 5 wherein the circuit (1) simulates a plurality of different shot order candidates for the upcoming laser pulse shots in view of the laser energy model and the mirror motion model and (2) determines the shot list based on which of the simulated shot order candidates are valid in view of the laser energy model and the energy requirements applicable to the upcoming laser pulse shots.

7. The system of claim 3 wherein the mirror is a first mirror, wherein the scan angles comprise a plurality of first mirror scan angles along a first scan axis, the system further comprising:
a second mirror, wherein the second mirror is scannable through a plurality of second mirror scan angles to control where the laser pulse shots fired by the laser source are directed along a second scan axis; and
wherein the mirror motion model models the first mirror scan angles for the first mirror over time.

8. The system of claim 7 wherein the circuit determines a plurality of range points in the field of view to be targeted by upcoming laser pulse shots, wherein the targeted range points are defined by coordinates in the field of view that correspond to first mirror scan angles and second mirror scan angles, (2) sorts a list of upcoming laser pulse shots by their second mirror scan angles to define a plurality of groups of upcoming laser pulse shots that target a plurality of different first mirror scan angles while targeting the same second mirror scan angle, and (3) schedules the sorted upcoming laser shots using the laser energy model and the mirror motion model on a group-by-group basis.

9. The system of claim 8 wherein the scheduled upcoming laser pulse shots include one or more scan line repeats.

10. The system of claim 7 wherein the upcoming laser pulse shots target a plurality of range points in the field of view, wherein the targeted range points are defined by coordinates in the field of view that correspond to first mirror scan angles and second mirror scan angles, and wherein the second mirror scans through the second mirror scan angles in a point-to-point mode that varies as a function of the second mirror scan angles of the scheduled upcoming laser pulse shots.

11. The apparatus of claim 2 wherein the mirror scans at a frequency in a range between 10 kHz and 20 kHz.

12. The apparatus of claim 1 wherein the laser source comprises a pulsed fiber laser source.

13. The apparatus of claim 12 wherein the pulsed fiber laser source comprises a seed laser, a pump laser, and a fiber amplifier, and wherein the laser energy model models (1) seed energy for the pulsed fiber laser source over time and (2) energy stored in the fiber amplifier over time.

14. The apparatus of claim 1 wherein the energy requirements include a minimum laser pulse energy.

15. The apparatus of claim 14 wherein the minimum laser pulse energy is non-uniform for the upcoming laser pulse shots.

16. The apparatus of claim 1 wherein a plurality of the energy requirements are based on a plurality of range estimates for a plurality of range points in the field of view that are to be targeted by a plurality of the upcoming laser pulse shots.

17. The system of claim 1 wherein the circuit also schedules the upcoming laser pulse shots based on (1) an eye safety model as compared to a plurality of eye safety requirements and/or (2) a camera safety model as compared to a plurality of camera safety requirements.

18. The apparatus of claim 1 wherein the circuit comprises (1) a system controller and (2) a beam scanner controller;
wherein the system controller schedules the upcoming laser pulse shots using the laser energy model; and
wherein the beam scanner controller provides firing commands to the laser source in accordance with the scheduled upcoming laser pulse shots.

19. A method comprising:
scanning a mirror through a plurality of scan angles over time;
scheduling a variable rate firing of a plurality of upcoming laser pulse shots by a laser source using a laser energy model as compared to a plurality of energy requirements applicable to the upcoming laser pulse shots, wherein the upcoming laser pulse shots are to target a plurality of range points in a field of view, and wherein the laser energy model takes into consideration a retention of energy in the laser source after the upcoming laser pulse shots are fired and quantitatively predicts available energy amounts for the upcoming laser pulse shots from the laser source based on a history of prior laser pulse shots by the laser source; and
firing a plurality of laser pulse shots from the laser source in accordance with the scheduling, wherein the fired laser pulse shots are directed by the scanning mirror toward the targeted range points.

20. An article of manufacture for control of a lidar system that includes a laser source and a scannable mirror, the article comprising:
machine-readable code that is resident on a non-transitory machine-readable storage medium, wherein t

Assignees

• Aeye Inc

Inventors

• Feru Philippe
• Dussan Luis
• Benscoter Joel
• Jung Il Woong
• Liang Alex
• Polishchuk Igor
• Steinhardt Allan

Classifications

• G01S17/42

  Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S17/46) · CPC title

• G01S7/4868

  Controlling received signal intensity or exposure of sensor · CPC title

• G01S17/10

  using transmission of interrupted, pulse-modulated waves (determination of distance by phase measurements G01S17/32) · CPC title

• G01S7/484 Primary

  Transmitters · CPC title

• G01S7/4814

  of transmitters alone · CPC title