Multi-spectral imaging system and method thereof

Patent metadata

Field	Value
Publication number	US-9871981-B1
Application number	US-201715630237-A
Country	US
Kind code	B1
Filing date	Jun 22, 2017
Priority date	Jun 22, 2017
Publication date	Jan 16, 2018
Grant date	Jan 16, 2018

Abstract

A multi-spectral visual light (VL) and infrared (IR) imaging system and method suitable for use in security cameras, security devices, surveillance cameras, surveillance devices, consumer digital cameras, consumer digital devices, thin clients, thick clients, industrial machine vision systems, automotive cameras, home furnishing cameras, residential cameras, commercial cameras, object detectors, as well as other markets and/or applications is provided. The multi-spectral VL and infrared IR imaging system comprises a plurality of VL imaging sensors, a plurality of infrared (IR) imaging sensors, and a readout assembly operatively connected to the CMOS imaging sensors and the IR imaging sensors, wherein the IR imaging sensors configured to generate thermal signals and operate the CMOS imaging sensors.

First claim

What is claimed is:

1. A multi-spectral imaging system comprising:
a plurality of super pixel groups arranged in an array, each super pixel group in the plurality of super pixel groups comprising:
a plurality of pixels, implemented in a complementary metal oxide (CMOS) imaging sensor, for capturing first image data in response to visual light (VL); and
an infrared (IR) imaging pixel for capturing second image data in response to IR wavelength ranges between 850 nm and 14000000 nm;
a carrier, the plurality of super pixel groups are disposed on the carrier; and

a readout assembly operatively connected to the plurality of super pixel groups, the readout assembly having a first column readout circuit connected to the VL imaging pixels and a second column readout circuit connected to the IR imaging pixels;
wherein the IR imaging pixels are configured to generate thermal signals and operate the VL imaging sensors.

2. The multi-spectral imaging system of claim 1 further comprising a controller communicatively connected to the plurality of the super pixel groups, the controller being configured to operate at least one of the VL imaging pixels and the IR imaging pixels.

3. The multi-spectral imaging system of claim 2 further comprising switching elements connected to the controller to switch the multi-spectral imaging system between an IR imaging mode and a VL imaging mode.

4. The multi-spectral imaging system of claim 3 wherein the multi-spectral imaging system in the IR imaging mode, the VL imaging pixels are deactivated.

5. The multi-spectral imaging system of claim 3 wherein the multi-spectral imaging system in the VL imaging mode, the IR imaging pixels are deactivated.

6. The multi-spectral imaging system of claim 1 further comprising a processor communicatively connected to the plurality of the super pixel group, the processor being configured to process first and second image data and evaluate the processed first and second image data.

7. The multi-spectral imaging system of claim 1 wherein the multi-spectral imaging system is integrated into a camera, a thin client, a thick client, an automotive, a home furnishing device, a home appliance, or an object detector.

8. A method of making a multi-spectral imaging system comprising:
providing a carrier;
forming a plurality of super pixel groups arranged in an array on the carrier, each super pixel group in the plurality of super pixel groups comprising:
a plurality of pixels, implemented in a complementary metal oxide (CMOS) image sensor, for capturing first image data in response to visual light (VL); and
an infrared (IR) imaging pixel for capturing second image data in response to IR wavelength ranges between 850 nm and 14000000 nm;

forming a readout assembly on the carrier, the readout assembly including a first column readout circuit connected to the VL imaging pixels and a second column readout circuit connected to the IR imaging pixels;
wherein the IR imaging pixels are configured to generate thermal signals and operate the VL imaging pixels.

9. The method of claim 8 further comprising:
providing a controller, the controller being configured to operate at least one of the VL imaging pixels and the IR imaging pixels.

10. The method of claim 9 further comprising:
providing switching elements, the switching elements being connected to the controller for switching the plurality of super pixel groups between an IR imaging mode and a VL imaging mode.

11. An apparatus comprising:
a plurality of super pixel groups arranged in an array, each super pixel group in the plurality of super pixel groups comprising:
a plurality of pixels, implemented in a complementary metal oxide (CMOS) image sensor, for capturing first image data in response to visual light (VL); and
a plurality of infrared (IR) imaging pixels for capturing second image data in response to IR wavelength ranges between 850 nm and 14000000 nm;
a carrier, the plurality of super pixel groups are disposed on the carrier; and
a readout assembly;
wherein the VL imaging pixels configured to generate sensor signals and transmit the sensor signals to the readout assembly;
wherein the IR imaging pixels configured to generate thermal signals and transmit the thermal signals to the readout assembly; and
wherein the IR imaging pixels are configured to operate the VL imaging sensors.

12. The apparatus of claim 11 wherein the readout assembly comprising:
a first column readout circuit; and
a second column readout circuit;
wherein the sensor signals generated by the VL imaging pixels are being transmitted to the first column readout circuit; and
wherein the sensor signals generated by the IR imaging pixels are being transmitted to the second column readout circuit.

13. The apparatus of claim 12 further comprising a controller, the controller being configured to operate at least one of the VL imaging pixels and the IR imaging pixels.

14. The apparatus of claim 13 further comprising switching elements connected to the controller to switch the apparatus between an IR imaging mode and a VL imaging mode.

15. The apparatus of claim 14 wherein when the apparatus in the IR imaging mode, the VL imaging pixels are deactivated.

16. The apparatus of claim 14 wherein when the apparatus in the VL imaging mode, the IR imaging pixels are deactivated.

17. The apparatus of claim 11 wherein the apparatus is a camera and a detector.

18. The apparatus of claim 17 wherein the apparatus is integrated into a thin client, a thick client, an automotive, a home furnishing device, and a home appliance.

Assignees

• Bosch Gmbh Robert

Inventors

• Lajevardi Pedram
• Blechschmidt Rainer

Classifications

• G01J3/2823 Primary

  Imaging spectrometer · CPC title

• G01J3/027

  Control of working procedures of a spectrometer; Failure detection; Bandwidth calculation · CPC title

• G01J2003/2826

  Multispectral imaging, e.g. filter imaging · CPC title

• G01J3/36

  Investigating two or more bands of a spectrum by separate detectors · CPC title

• G01J3/2803 Primary

  using photoelectric array detector · CPC title