Vehicular driving assist system with lidar sensors that emit light at different pulse rates

Patent metadata

Field	Value
Publication number	US-12007484-B2
Application number	US-202217931195-A
Country	US
Kind code	B2
Filing date	Sep 12, 2022
Priority date	Nov 21, 2017
Publication date	Jun 11, 2024
Grant date	Jun 11, 2024

Abstract

A vehicular driving assist system includes a plurality of lidar sensors having respective fields of sensing exterior the vehicle. The lidar sensors emit light pulsed at a respective pulse rate and provide a respective output to an electronic control unit based on sensed light that is reflected by objects present in the field of sensing of the respective lidar sensor. The pulse rates of light emitted by the lidar sensors are different. The vehicular driving assist system, via processing at the ECU of the outputs from the lidar sensors, generates a three dimensional (3D) point cloud. The vehicular driving assist system controls the vehicle based at least in part on light sensed by the lidar sensors that is reflected by the objects when light is emitted by the lidar sensors at the respective pulse rates.

First claim

The invention claimed is:

1. A vehicular driving assist system, the vehicular driving assist system comprising:
a plurality of lidar sensors disposed at a vehicle equipped with the vehicular driving assist system, wherein the plurality of lidar sensors comprises at least (i) a first lidar sensor having a first field of sensing exterior the equipped vehicle and (ii) a second lidar sensor having a second field of sensing exterior the equipped vehicle;
an electronic control unit (ECU) including a data processor;
wherein the first lidar sensor emits light pulsed at a first pulse rate and provides a first output based on sensed light that is reflected by objects present in the first field of sensing of the first lidar sensor when light is emitted by the first lidar sensor at the first pulse rate;
wherein the second lidar sensor emits light pulsed at a second pulse rate and provides a second output based on sensed light that is reflected by objects present in the second field of sensing of the second lidar sensor when light is emitted by the second lidar sensor at the second pulse rate;
wherein the second pulse rate is different than the first pulse rate;
wherein the vehicular driving assist system, via processing at the ECU of the first output from the first lidar sensor and the second output from the second lidar sensor, generates a three dimensional (3D) point cloud based at least in part on the difference between the first pulse rate and the second pulse rate; and
wherein the vehicular driving assist system controls the equipped vehicle based at least in part on the generated 3D point cloud.

2. The vehicular driving assist system of claim 1 , wherein the first lidar sensor is disposed at a front grille of the equipped vehicle.

3. The vehicular driving assist system of claim 1 , wherein the first lidar sensor is disposed at a headlight of the equipped vehicle.

4. The vehicular driving assist system of claim 1 , wherein the first lidar sensor is disposed at an exterior rearview mirror assembly of the equipped vehicle.

5. The vehicular driving assist system of claim 1 , wherein at least one of the objects comprises a target.

6. The vehicular driving assist system of claim 1 , wherein the first lidar sensor comprises (i) a first light emitting unit that emits light at the first pulse rate and (ii) a first sensor unit that senses light reflected by the objects present in the first field of sensing of the first lidar sensor, and wherein the second lidar sensor comprises (i) a second light emitting unit that emits light at the second pulse rate and (ii) a second sensor unit that senses light reflected by the objects present in the second field of sensing of the second lidar sensor.

7. The vehicular driving assist system of claim 6 , wherein the first sensor unit senses light that is emitted at the first pulse rate by the first light emitting unit and that is reflected by the objects present in the first field of sensing of the first lidar sensor, and wherein the second sensor unit senses light that is emitted at the second pulse rate by the second light emitting unit and that is reflected by the objects present in the second field of sensing of the second lidar sensor.

8. The vehicular driving assist system of claim 1 , wherein the vehicular driving assist system, via processing at the ECU of the first output of the first lidar sensor and the second output from the second lidar sensor, determines a difference between light emitted by the first lidar sensor at the first pulse rate and light emitted by the second lidar sensor at the second pulse rate.

9. The vehicular driving assist system of claim 8 , wherein the vehicular driving assist system, via processing at the ECU of the first output of the first lidar sensor and the second output from the second lidar sensor, spatially synchronizes the first output and the second output based at least in part on a difference of light emitted by the first lidar sensor and light emitted by the second lidar sensor.

10. The vehicular driving assist system of claim 8 , wherein the vehicular driving assist system, based at least in part on the a difference of light emitted by the first lidar sensor and light emitted by the second lidar sensor, determines a first alignment marker formed by a transition of a non-overlap region of the first field of sensing to an overlap region of the first and second fields of sensing.

11. The vehicular driving assist system of claim 10 , wherein the vehicular driving assist system, based at least in part on the difference of light emitted by the first lidar sensor and light emitted by the second lidar sensor, determines a second alignment marker formed by a transition of a non-overlap region of the second field of sensing to the overlap region of the first and second fields of sensing.

12. The vehicular driving assist system of claim 11 , wherein the vehicular driving assist system senses within a combined field of sensing via processing at the ECU of the first and second outputs and the first and second alignment markers.

13. The vehicular driving assist system of claim 12 , wherein the vehicular driving assist system determines mismatches of the first and second alignment markers within the combined field of sensing.

14. The vehicular driving assist system of claim 1 , comprising a third lidar sensor.

15. The vehicular driving assist system of claim 14 , wherein each of the first lidar sensor, the second lidar sensor and the third lidar sensor has a respective field of sensing greater than 120 degrees.

16. The vehicular driving assist system of claim 1 , wherein the first field of sensing of the first lidar sensor partially overlaps the second field of sensing of the second lidar sensor at an overlap region.

17. The vehicular driving assist system of claim 16 , wherein at least one of the objects is present in the overlap region.

18. The vehicular driving assist system of claim 16 , wherein the first field of sensing of the first lidar sensor partially overlaps the second field of sensing of the second lidar sensor by an amount that accommodates mounting tolerances of the first lidar sensor and the second lidar sensor.

19. A vehicular driving assist system, the vehicular driving assist system comprising:
a plurality of lidar sensors disposed at a vehicle equipped with the vehicular driving assist system, wherein the plurality of lidar sensors comprises at least (i) a first lidar sensor having a first field of sensing at least forward of the equipped vehicle and (ii) a second lidar sensor having a second field of sensing at least forward of the equipped vehicle;
an electronic control unit (ECU) including a data processor;
wherein the first lidar sensor comprises (i) a first light emitting unit that emits light at a first pulse rate and (ii) a first sensor unit that senses light that is emitted at the first pulse rate by the first light emitting unit and that is reflected by objects present in the first field of sensing of the first lidar sensor;
wherein the first lidar sensor provides a first output based on sensed light that is emitted at the first pulse rate by the first light emitting unit and that is reflected by the objects present in the first field of sensing of the first lidar sensor when light is emitted by the first lidar sensor at the first pulse rate;
wherein the second lidar sensor comprises (i) a second light emitting unit that emits light at a second pulse rate and (ii) a second sensor unit that senses light that is emitted at the second pulse rate by the second light

Assignees

• Magna Electronics Inc

Inventors

• Nicke Peter
• May Benjamin

Classifications

• G01S17/931

  of land vehicles · CPC title

• G01S17/86

  Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders · CPC title

• G01S17/89

  for mapping or imaging · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G01S17/87 Primary

  Combinations of systems using electromagnetic waves other than radio waves · CPC title