Vehicular driving assist system with lidar sensors that emit different patterns of light

Patent metadata

Field	Value
Publication number	US-11442168-B2
Application number	US-202016949313-A
Country	US
Kind code	B2
Filing date	Oct 26, 2020
Priority date	Nov 21, 2017
Publication date	Sep 13, 2022
Grant date	Sep 13, 2022

Abstract

A vehicular driving assist system includes a plurality of lidar sensors having respective fields of sensing exterior the vehicle, with the fields of sensing of first and second lidar sensors partially overlapping at an overlap region. The lidar sensors emit a respective pattern of light and provide a respective output to an ECU based on sensed light that is reflected by objects present in the field of sensing of the respective lidar sensor. The pattern of light emitted by the second lidar sensor differs from the pattern of light emitted by the first lidar sensor. The ECU determines misalignment of the second lidar sensor relative to the first lidar sensor based at least in part on the light sensed by each of the lidar sensors that is reflected by an object present in the overlap region when the respective pattern of light is emitted by the respective lidar sensor.

First claim

The invention claimed is:

1. A vehicular driving assist system, the vehicular driving assist system comprising:
a plurality of lidar sensors disposed at a vehicle equipped with the vehicular driving assist system, wherein the plurality of lidar sensors comprises at least (i) a first lidar sensor having a first field of sensing exterior the equipped vehicle and (ii) a second lidar sensor having a second field of sensing exterior the equipped vehicle;
an electronic control unit (ECU) including a data processor;
wherein the first field of sensing of the first lidar sensor partially overlaps the second field of sensing of the second lidar sensor at an overlap region;
wherein the first lidar sensor emits a first pattern of light and provides a first output to the ECU based on sensed light that is reflected by objects present in the first field of sensing of the first lidar sensor;
wherein the second lidar sensor emits a second pattern of light and provides a second output to the ECU based on sensed light that is reflected by objects present in the second field of sensing of the second lidar sensor;
wherein the second pattern of light emitted by the second lidar sensor differs from the first pattern of light emitted by the first lidar sensor; and
wherein the ECU, responsive to processing at the ECU of the first output and the second output, determines misalignment of the second lidar sensor relative to the first lidar sensor based at least in part on (i) light sensed by the first lidar sensor that is reflected by an object present in the overlap region when the first pattern of light is emitted by the first lidar sensor and (ii) light sensed by the second lidar sensor that is reflected by the object present in the overlap region when the second pattern of light is emitted by the second lidar sensor.

2. The vehicular driving assist system of claim 1 , wherein the first pattern of light comprises light pulsed by the first lidar sensor at a first pulse rate, and wherein the second pattern of light comprises light pulsed by the second lidar sensor at a second pulse rate that is different than the first pulse rate.

3. The vehicular driving assist system of claim 1 , wherein the first pattern of light comprises emitted light emitted by the first lidar sensor having a first wavelength, and wherein the second pattern of light comprises emitted light by the second lidar sensor having a second wavelength that is different than the first wavelength.

4. The vehicular driving assist system of claim 1 , wherein the first lidar sensor is disposed at a front grille of the equipped vehicle.

5. The vehicular driving assist system of claim 1 , wherein the first lidar sensor is disposed at a headlight of the equipped vehicle.

6. The vehicular driving assist system of claim 1 , wherein the first lidar sensor is disposed at an exterior rearview mirror assembly of the equipped vehicle.

7. The vehicular driving assist system of claim 1 , wherein the object comprises a target disposed in the overlap region.

8. The vehicular driving assist system of claim 1 , wherein the ECU, via processing at the ECU of the first output from the first lidar sensor and the second output from the second lidar sensor, generates a three dimensional (3D) point cloud.

9. The vehicular driving assist system of claim 1 , wherein (a) the first lidar sensor comprises (i) a first light emitting unit that emits the first pattern of light and (ii) a first sensor unit that senses light reflected by objects present in the first field of sensing, and (b) the second lidar sensor comprises (i) a second light emitting unit that emits the second pattern of light and (ii) a second sensor unit that senses light reflected by objects present in the second field of sensing.

10. The vehicular driving assist system of claim 1 , wherein the ECU, via processing at the ECU of the first output of the first lidar sensor and the second output from the second lidar sensor, determines a pattern difference between the first pattern of light emitted by the first lidar sensor at the overlap region and the second pattern of light emitted by the second lidar sensor at the overlap region.

11. The vehicular driving assist system of claim 10 , wherein the ECU, via processing at the ECU of the first output of the first lidar sensor and the second output from the second lidar sensor, spatially synchronizes the first output and the second output based at least in part on the determined pattern difference at the overlap region.

12. The vehicular driving assist system of claim 10 , wherein the ECU, based at least in part on the determined pattern difference, determines a first alignment marker between a non-overlap region of the first field of sensing and the overlap region and determines a second alignment marker between a non-overlap region of the second field of sensing and the overlap region.

13. The vehicular driving assist system of claim 12 , wherein the ECU determines a combined field of sensing via processing at the ECU of the first and second outputs and the first and second alignment markers.

14. The vehicular driving assist system of claim 1 , comprising a third lidar sensor that has a field of sensing that overlaps the field of sensing of the second lidar sensor, wherein each of the first, second and third lidar sensors has a field of sensing greater than 120 degrees.

15. The vehicular driving assist system of claim 1 , wherein the first field of sensing of the first lidar sensor partially overlaps the second field of sensing of the second lidar sensor by an amount that is equivalent to mounting tolerances of the first lidar sensor and the second lidar sensor.

16. A vehicular driving assist system, the vehicular driving assist system comprising:
a plurality of lidar sensors disposed at a vehicle equipped with the vehicular driving assist system, wherein the plurality of lidar sensors comprises at least (i) a first lidar sensor having a first field of sensing exterior the equipped vehicle and (ii) a second lidar sensor having a second field of sensing exterior the equipped vehicle;
an electronic control unit (ECU) including a data processor;
wherein the first field of sensing of the first lidar sensor partially overlaps the second field of sensing of the second lidar sensor at an overlap region;
wherein the first lidar sensor comprises (i) a first light emitting unit that emits a first pattern of light and (ii) a first sensor unit that senses light reflected by objects present in the first field of sensing;
wherein the second lidar sensor comprises (i) a second light emitting unit that emits a second pattern of light and (ii) a second sensor unit that senses light reflected by objects present in the second field of sensing;
wherein the second pattern of light emitted by the second light emitting unit of the second lidar sensor differs from the first pattern of light emitted by the first light emitting unit of the first lidar sensor;
wherein the first lidar sensor provides a first output to the ECU based on sensed light that is reflected by objects present in the first field of sensing of the first lidar sensor;
wherein the second lidar sensor provides a second output to the ECU based on sensed light that is reflected by objects present in the second field of sensing of the second lidar sensor;
wherein the ECU, responsive to processing at the ECU of the first output and the second output, determines misalignment of the second lidar sensor relative to the first lidar sensor based at least in part on (i) light sensed by the first sensor unit of the first lidar sensor that is refle

Assignees

• Magna Electronics Inc

Inventors

• Nicke Peter
• May Benjamin

Classifications

• G01S17/931

  of land vehicles · CPC title

• G01S17/86

  Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders · CPC title

• G01S17/87 Primary

  Combinations of systems using electromagnetic waves other than radio waves · CPC title

• G01S17/89

  for mapping or imaging · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title