Vehicle sensing system with calibration/fusion of point cloud partitions

Patent metadata

Field	Value
Publication number	US-10816666-B2
Application number	US-201816197484-A
Country	US
Kind code	B2
Filing date	Nov 21, 2018
Priority date	Nov 21, 2017
Publication date	Oct 27, 2020
Grant date	Oct 27, 2020

Abstract

A lidar sensing system for a vehicle includes a plurality of lidar sensor modules disposed at a vehicle, with each lidar sensor module having a laser unit and a sensor unit, and with each lidar sensor module having a respective field of sensing exterior of the vehicle. Each field of sensing is different from the other fields of sensing and partially overlaps at least one other field of sensing. An output of each lidar sensor module is communicated to a control, and the control, responsive to outputs from the lidar sensor modules, determines a combined field of sensing.

First claim

The invention claimed is:

1. A lidar sensing system for a vehicle, said lidar sensing system comprising:
a plurality of lidar sensor modules disposed at a vehicle equipped with said lidar sensing system, wherein the plurality of lidar sensor modules comprises at least a first lidar sensor module and a second lidar sensor module;
wherein the first lidar sensor module projects a first laser-generated pattern of light and senses light reflected off of objects in a first field of sensing of the first lidar sensor module;
wherein the second lidar sensor module projects a second laser-generated pattern of light and senses light reflected off of objects in a second field of sensing of the second lidar sensor module;
wherein the first and second fields of sensing of the first and second lidar sensor modules are different, and wherein the first field of sensing of the first lidar sensor module partially overlaps the second field of sensing of the second lidar sensor module at an overlap area;
a control including a data processor, wherein an output of each of the first and second lidar sensor modules is communicated to the control for processing at the control; and
wherein the control, responsive to processing at the control of the outputs of both of the first and second lidar sensor modules, determines a degree of misalignment of the second lidar sensor module relative to the first lidar sensor module based on comparison between (i) light sensed by the first lidar sensor module that is reflected off of objects in the overlap area when the first laser-generated pattern of light is projected by the first lidar sensor module and (ii) light sensed by the second lidar sensor module that is reflected off of objects in the overlap area when the second laser-generated pattern of light is projected by the second lidar sensor module.

2. The lidar sensing system of claim 1 , wherein each of the first and second lidar sensor modules comprises a laser unit that projects the respective laser-generated pattern of light and a sensor unit that senses the light reflected off of objects in the respective field of sensing.

3. The lidar sensing system of claim 2 , wherein the laser unit of the first lidar sensor module projects the first laser-generated pattern of light in the overlap area that is different than the second laser-generated pattern of light projected in the overlap area by the second lidar sensor module.

4. The lidar sensing system of claim 2 , wherein the laser unit of the first lidar sensor module and the second lidar sensor module project different laser-generated patterns of light in the overlap area by altering a laser energy.

5. The lidar sensing system of claim 2 , wherein the laser unit of the first lidar sensor module projects a laser-generated pattern of light in the overlap area that is different than the laser-generated pattern of light projected by that laser unit in another area of the first field of sensing of the first lidar sensor module.

6. The lidar sensing system of claim 1 , wherein said lidar sensing system, via processing at the control of outputs from the first and second lidar sensor modules, determine pattern differences projected by each of the first and second lidar sensor modules.

7. The lidar sensing system of claim 6 , wherein the control, via processing at the control of outputs from the first and second lidar sensor modules, spatially synchronizes the outputs from the first and second lidar sensor modules based at least in part on the determined pattern differences at the overlap area.

8. The lidar sensing system of claim 6 , wherein the control, based at least in part on the determined pattern differences, determines an alignment marker between the overlap and non-overlap areas.

9. The lidar sensing system of claim 8 , wherein the control determines a combined field of sensing via processing at the control of each output and of each alignment marker.

10. The lidar sensing system of claim 9 , wherein the control reports a failed frame when determining the combined field of sensing fails.

11. The lidar sensing system of claim 1 , comprising a third lidar sensor module that has a field of sensing that overlaps the field of sensing of the second lidar sensor module, wherein each of the first, second and third lidar sensor modules has a field of sensing greater than 120 degrees.

12. The lidar sensing system of claim 1 , wherein the first field of sensing of the first lidar sensor module partially overlaps the second field of sensing of the second lidar sensor module by an amount that is equivalent to mounting tolerances of the first and second lidar sensor modules.

13. A lidar sensing system for a vehicle, said lidar sensing system comprising:
a plurality of lidar sensor modules disposed at a vehicle equipped with said lidar sensing system, wherein the plurality of lidar sensor modules comprises at least a first lidar sensor module and a second lidar sensor module;
wherein the first lidar sensor module projects a first laser-generated pattern of light and senses light reflected off of objects in a first field of sensing of the first lidar sensor module;
wherein the second lidar sensor module projects a second laser-generated pattern of light and senses light reflected off of objects in a second field of sensing of the second lidar sensor module;
wherein each of the first and second lidar sensor modules comprises a laser unit that projects the respective laser-generated pattern of light and a sensor unit that senses the light reflected off of objects in the respective field of sensing;
wherein the first and second fields of sensing of the first and second lidar sensor modules are different, and wherein the first field of sensing of the first lidar sensor module partially overlaps the second field of sensing of the second lidar sensor module at an overlap area;
wherein the laser unit of the first lidar sensor module projects the first laser-generated pattern of light in the overlap area that is different than the second laser-generated pattern of light projected in the overlap area by the second lidar sensor module;
wherein the laser unit of the first lidar sensor module and the second lidar sensor module project different laser-generated patterns of light in the overlap area by altering a laser energy;
a control including a data processor, wherein an output of each of the first and second lidar sensor modules is communicated to the control for processing at the control; and
wherein the control, responsive to processing at the control of the outputs of both of the first and second lidar sensor modules, determines a degree of misalignment of the second lidar sensor module relative to the first lidar sensor module based on comparison between (i) light sensed by the first lidar sensor module that is reflected off of objects in the overlap area when the first laser-generated pattern of light is projected by the first lidar sensor module and (ii) light sensed by the second lidar sensor module that is reflected off of objects in the overlap area when the second laser-generated pattern of light is projected by the second lidar sensor module.

14. The lidar sensing system of claim 13 , wherein the laser unit of the first lidar sensor module projects a laser-generated pattern of light in the overlap area that is different than the laser-generated pattern of light projected by that laser unit in another area of the first field of sensing of the first lidar sensor module.

15. The lidar sensing system of claim 13 , wherein said lidar sensing system, via processing at the control of outputs from the first and second l

Assignees

• Magna Electronics Inc

Inventors

• Nicke Peter
• May Benjamin

Classifications

• G01S17/87 Primary

  Combinations of systems using electromagnetic waves other than radio waves · CPC title

• G01S17/931

  of land vehicles · CPC title

• G01S17/89

  for mapping or imaging · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G01S17/86

  Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders · CPC title