Systems And Methods For A Configurable Sensor System

Patent metadata

Field	Value
Publication number	US-2025035787-A1
Application number	US-202418767493-A
Country	US
Kind code	A1
Filing date	Jul 9, 2024
Priority date	Jan 7, 2019
Publication date	Jan 30, 2025
Grant date	—

Abstract

The present disclosure relates generally to systems and methods for generating, processing and correlating data from multiple sensors in an autonomous navigation system, and more particularly to the utilization of configurable and dynamic sensor modules within light detection and ranging systems that enable an improved correlation between sensor data as well as configurability and responsiveness of the system to its surrounding environment.

First claim

1 . A sensor module comprising:
a plurality of sensors integrated within a single component, the plurality of sensors including a lidar sensor and a second sensor; a scanning mechanism configured to scan the lidar sensor and the second sensor across a 360 degree field of view, wherein as the plurality of sensors are scanned the lidar sensor collects lidar sensor data while the second sensor concurrently collects second sensor data that is temporally correlated with the lidar sensor data but taken from different angular positions than the lidar sensor data; circuitry configured to receive the lidar sensor data and the second sensor data and recombine the data into a correlated data stream in which the lidar sensor data and the second sensor data are spatially correlated without being temporally correlated; and a processor operatively coupled to receive the correlated data stream and generate a point cloud comprising the lidar sensor data and the second sensor data.

2 . The sensor module of claim 1 wherein the second sensor comprises a sensor that detects radiation in a visible light spectrum.

3 . The sensor module of claim 1 wherein the second sensor comprises an RGB sensor.

4 . The sensor module of claim 1 wherein the second sensor comprises a thermal sensor.

5 . The sensor module of claim 1 wherein the lidar sensor and the second sensor detect data along a shared axis.

6 . The sensor module of claim 1 wherein the lidar sensor and the second sensor are intergated onto an application specific integrated circuit.

7 . The sensor module of claim 1 wherein the scanning mechanism comprises a moving mirror.

8 . The sensor module of claim 1 wherein the lidar sensor data and second sensor data are correlated using a 1:1 correspondence between measurement data points from the lidar sensor and the second sensor.

9 . The sensor module of claim 1 wherein the lidar sensor is operable to transmit a plurality of optical signals into an environment in which the sensor module operates, detect a corresponding plurality of return optical signals reflected off objects within the environment, and process the return optical signals to generate the lidar sensor data.

10 . A sensor module comprising:
a scanning mechanism configured to scan the sensor module across a 360 degree field of view; a plurality of sensors including a lidar sensor that collects lidar data and a color sensor that collects color data; first circuitry that, as the plurality of sensors are scanned across the field of view, combines temporally correlated pairs of lidar data and color data taken from different angular positions forming a first combined data stream; second circuitry configured to receive the first combined data stream and recombine the data into a correlated data stream in which pairs of lidar data and color data are spatially correlated without being temporally correlated; and a processor operatively coupled to receive the correlated data stream and generate a point cloud comprising the lidar data and the color data.

11 . The sensor module of claim 10 wherein the lidar sensor and the color sensor detect data along a shared axis.

12 . The sensor module of claim 10 wherein the plurality of sensors are integrated within a single component.

13 . The sensor module of claim 12 wherein the lidar sensor and the color sensor are intergated onto an application specific integrated circuit.

14 . The sensor module of claim 1 wherein the scanning mechanism comprises a moving mirror.

15 . The sensor module of claim 10 wherein the first circuitry comprises a multiplexor and the second circuitry comprises a demultiplexor.

16 . A sensor module comprising:
a scanning mechanism configured to scan the sensor module across a 360 degree field of view; a plurality of sensors integrated within a single component, the plurality of sensors including: (i) a lidar sensor configured to transmit a plurality of optical signals into an environment in which the sensor module operates, detect a corresponding plurality of return optical signals reflected off objects within the environment, and process the return optical signals to generate lidar data related to one or more first attributes of locations within the environment; and (ii) a color sensor that detects ambient light from within the environment and generates color data, wherein there is a 1:1 pairing between the lidar data and the color data; first circuitry that, as the plurality of sensors are scanned across the field of view, combines lidar data with color data generated concurrently with, but from different angular positions than, the lidar data into a stream of temporally paired lidar and color data; second circuitry configured to receive the stream of temporally paired lidar and color data and reconfigure the data into a stream of spatially paired lidar and color data in which pairs of lidar data and color data were acquired from a same angular positions without being temporally correlated; and a processor operatively coupled to receive the stream of spatially paired lidar and color data.

17 . The sensor module of claim 16 wherein the lidar sensor and the color sensor detect data along a shared axis.

18 . The sensor module of claim 16 wherein the lidar sensor and the color sensor are intergated onto an application specific integrated circuit.

19 . The sensor module of claim 16 wherein the scanning mechanism comprises a moving mirror.

20 . The sensor module of claim 16 wherein the processor is configured to generate a point cloud comprising the lidar data and the color data.

Assignees

• Velodyne Lidar Usa Inc

Inventors

• Hall David
• Gopalan Anand
• Rekow Mathew Noel
• Nestinger Stephen
• Banas Tyler

Classifications

• G05D1/247

  using signals provided by artificial sources external to the vehicle, e.g. navigation beacons · CPC title

• G01S17/89

  for mapping or imaging · CPC title

• G01S7/4808

  Evaluating distance, position or velocity data · CPC title

• G05D1/024

  in combination with a laser (lasers per se H01S) · CPC title

• G01S17/931 Primary

  of land vehicles · CPC title