Compact perception device

Patent metadata

Field	Value
Publication number	US-11871130-B2
Application number	US-202318105781-A
Country	US
Kind code	B2
Filing date	Feb 3, 2023
Priority date	Mar 25, 2022
Publication date	Jan 9, 2024
Grant date	Jan 9, 2024

Abstract

A compact perception device for an autonomous driving system is disclosed. The compact perception device includes a lens configured to collect both visible light and near infrared (NIR) light to obtain collected light including collected visible light and collected NIR light. The device further includes a first optical reflector optically coupled to the lens. The first optical reflector is configured to reflect one of the collected visible light or the collected NIR light, and pass the collected light that is not reflected by the first optical reflector. The device further includes an image sensor configured to detect the collected visible light directed by the first optical reflector to form image data; and a depth sensor configured to detect the collected NIR light directed by the first optical reflector to form depth data.

First claim

What is claimed is:

1. A compact perception device, comprising:
a lens configured to collect both visible light and near infrared (NIR) light to obtain collected light including collected visible light and collected NIR light;
a first optical reflector optically coupled to the lens, the first optical reflector being configured to reflect one of the collected visible light or the collected NIR light, and pass the collected light that is not reflected by the first optical reflector;
an image sensor configured to detect the collected visible light directed by the first optical reflector to form image data;
a depth sensor configured to detect the collected NIR light directed by the first optical reflector to form depth data; and
electrical circuitry configured to combine the image data and the depth data, the electrical circuitry comprising a printed circuit board (PCB) coupled to the image sensor and the depth sensor.

2. The device of claim 1 , further comprising a transmitter configured to emit laser light to a field-of-view (FOV), the NIR light collected by the lens being formed based on the emitted laser light.

3. The device of claim 2 , wherein the transmitter comprises at least one of a solid state based light ranging and detection (LiDAR) device configured to perform electronic scanning or a LiDAR device configured to perform optical scanning.

4. The device of claim 1 , further comprising a single housing enclosing the lens, the first optical reflector, the image sensor, and the depth sensor.

5. The device of claim 1 , further comprising a second optical reflector optically coupled to the first optical reflector, the second optical reflector being configured to direct the collected light that is reflected by the first optical reflector.

6. The device of claim 5 , wherein the first optical reflector is configured to reflect the collected visible light and pass the collected NIR light; and wherein the second optical reflector is configured to reflect the collected NIR light passed by the first optical reflector.

7. The device of claim 5 , wherein the first optical reflector is configured to reflect the collected NIR light and pass the collected visible light; and wherein the second optical reflector is configured to reflect the collected visible light passed by the first optical reflector.

8. The device of claim 1 , wherein at least a part of the compact perception device is steerable.

9. The device of claim 1 , wherein the electrical circuitry further comprises a processor configured to encode the depth data and the image data into red, green, blue and depth (RGBD) data, and transmit the RGBD data externally via a data bus.

10. The device of claim 1 , wherein the lens is configured to collect both the visible light and the NIR light from a same field-of-view (FOV).

11. A light detection and ranging (LiDAR) system comprising at least one compact perception device comprising:
a lens configured to collect both visible light and near infrared (NIR) light to obtain collected light including collected visible light and collected NIR light;
a first optical reflector optically coupled to the lens, the first optical reflector being configured to reflect one of the collected visible light or the collected NIR light, and pass the collected light that is not reflected by the first optical reflector;
an image sensor configured to detect the collected visible light directed by the first optical reflector to form image data;
a depth sensor configured to detect the collected NIR light directed by the first optical reflector to form depth data; and
electrical circuitry configured to combine the image data and the depth data, the electrical circuitry comprising a printed circuit board (PCB) coupled to the image sensor and the depth sensor.

12. A vehicle comprising a light detection and ranging (LiDAR) system, the LiDAR system comprising at least one compact perception device, the compact perception device comprising:
a lens configured to collect both visible light and near infrared (NIR) light to obtain collected light including collected visible light and collected NIR light;
a first optical reflector optically coupled to the lens, the first optical reflector being configured to reflect one of the collected visible light or the collected NIR light, and pass the collected light that is not reflected by the first optical reflector;
an image sensor configured to detect the collected visible light directed by the first optical reflector to form image data;
a depth sensor configured to detect the collected NIR light directed by the first optical reflector to form depth data; and
electrical circuitry configured to combine the image data and the depth data, the electrical circuitry comprising a printed circuit board (PCB) coupled to the image sensor and the depth sensor.

13. A method performed by a compact perception device for perceiving an external environment, comprising:
collecting, by a lens, both visible light and near infrared (NIR) light to obtain collected light including collected visible light and collected NIR light;
reflecting, by a first optical reflector, one of the collected visible light or the collected NIR light, and passing the collected light that is not reflected by the first optical reflector;
detecting, by an image sensor, the collected visible light directed by the first optical reflector to form image data;
detecting, by a depth sensor, the collected NIR light directed by the first optical reflector to form depth data; and
combining the image data and the depth data by electrical circuitry comprising a printed circuit board (PCB) coupled to the image sensor and the depth sensor.

14. The method of claim 13 , further comprising:
emitting laser light to a field-of-view (FOV) by a transmitter, the NIR light collected by the lens being formed based on the emitted laser light.

15. The method of claim 13 , further comprising:
directing, by a second optical reflector, the collected light that is reflected by the first optical reflector to the image sensor or the depth sensor.

16. The method of claim 15 , wherein reflecting, by the first optical reflector, one of the collected visible light or the collected NIR light, and passing the collected light that is not reflected by the first optical reflector comprises:
reflecting the collected visible light by the first optical reflector;
passing the collected NIR light by the first optical reflector; and
wherein directing the collected light that is reflected by the first optical reflector comprises reflecting, by the second optical reflector, the collected visible light to the image sensor.

17. The method of claim 15 , wherein reflecting, by the first optical reflector, one of the collected visible light or the collected NIR light, and passing the collected light that is not reflected by the first optical reflector comprises:
reflecting the collected NIR light by the first optical reflector;
passing the collected visible light by the first optical reflector; and
wherein directing the collected light that is reflected by the first optical reflector comprises reflecting, by the second optical reflector, the collected NIR light to the depth sensor.

18. The method of claim 13 , further comprising steering at least a part of the compact perception device.

19. The method of claim 13 , further comprising
transmitting the combined data via a data bus.

20. The method of claim 13 , wherein combining the image data and the depth data comprises encodin

Assignees

• Innovusion Inc

Inventors

• Wang Haosen
• Li Yimin

Classifications

• H04N25/70 Primary

  SSIS architectures; Circuits associated therewith · CPC title

• G01S17/89

  for mapping or imaging · CPC title

• H04N25/20

  for transforming only infrared radiation into image signals · CPC title

• G01S17/42 Primary

  Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S17/46) · CPC title

• G01S17/86

  Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders · CPC title