Cameras having a rgb-ir channel

Patent metadata

Field	Value
Publication number	US-2016295133-A1
Application number	US-201615082776-A
Country	US
Kind code	A1
Filing date	Mar 28, 2016
Priority date	Apr 6, 2015
Publication date	Oct 6, 2016
Grant date	—

Abstract

The present disclosure describes various RGB-IR cameras, as well as new applications and methods of using such cameras. An apparatus includes an image sensor module including an image sensor. The image sensor has an active region including pixels operable to sense radiation in the visible and IR parts of the spectrum. The module can include, in some cases, a switchable IR filter disposed between the active region of the image sensor and an optical assembly. In various implementations, the module can be used in conjunction with one or more of the following: generating color images, generating IR images, performing iris recognition, performing facial recognition, and performing eye tracking/eye gazing.

First claim

What is claimed is:

1 . An apparatus comprising:
an image sensor module including an image sensor that includes an active region, the active region including a plurality of pixels operable to sense radiation in a visible part of the spectrum and radiation in the IR part of the spectrum; and an optical assembly disposed over the active region of the image sensor; a read-out circuit to acquire output signals from the pixels; and one or more processors to acquire the output signals, generate a color image based on the output signals from the pixels that sense color information in the visible part of the spectrum, and generate an IR image based on the output signals from the pixels that sense IR information.

2 . An apparatus comprising:
an image sensor module including an image sensor that includes an active region, the active region including a plurality of pixels operable to sense radiation in a visible part of the spectrum and radiation in the IR part of the spectrum; and an optical assembly disposed over the active region of the image sensor; a read-out circuit to acquire output signals from the pixels; and one or more processors configured to acquire the output signals, generate a color image based on the output signals from the pixels that sense color information in the visible part of the spectrum, and perform iris recognition based on the output signals from the pixels that sense IR information.

3 . The apparatus of claim 2 further including an eye illumination source operable to illuminate a subject's eye with IR radiation.

4 . The apparatus of claim 3 wherein the eye illumination source is operable to emit modulated IR radiation.

5 . The apparatus of claim 2 further including a diffuse IR illuminator operable to project IR light onto a subject's eye.

6 . An apparatus comprising:
an image sensor module including an image sensor that includes an active region, the active region including a plurality of pixels operable to sense radiation in a visible part of the spectrum and radiation in the IR part of the spectrum; and an optical assembly disposed over the active region of the image sensor; a read-out circuit to acquire output signals from the pixels; and one or more processors to acquire the output signals, perform facial recognition based on the output signals from the pixels that sense color information in the visible part of the spectrum, and perform iris recognition based on the output signals from the pixels that sense IR information.

7 . The apparatus of claim 6 further including:
an eye illumination source operable to emit modulated IR illumination toward a subject's face; and
a depth sensor operable to detect optical signals indicative of distance to the subject's eye and to demodulate the detected optical signals,
wherein the one or more processors are operable to generate depth data based on signals from the depth sensor.

8 . The apparatus of claim 7 wherein the depth sensor includes an optical time-of-flight sensor.

9 . The apparatus of claim 7 wherein the one or more processors are operable to perform eye tracking based on the depth data.

10 . The apparatus of claim 6 further including a diffuse IR illuminator operable to project IR light onto a subject's eye.

11 . An apparatus comprising:
an image sensor module including an image sensor that includes an active region, the active region including a plurality of pixels each of which is operable to sense radiation in the visible part of the spectrum and radiation in the IR part of the spectrum; an optical assembly disposed over the active region of the image sensor; a switchable optical filter disposed between the active region of the image sensor and the optical assembly, the switchable optical filter being operable in a first state and in a second state,
wherein the first state allows radiation in the visible part of the spectrum and radiation in the IR part of the spectrum to pass from the optical assembly to the active region of the image sensor; and
wherein the second state allows radiation in the visible part of the spectrum to pass from the optical assembly to the active region of the image sensor and substantially prevents radiation in the IR part of the spectrum from passing from the optical assembly to the active region of the image sensor.

12 . The apparatus of claim 11 wherein the switchable optical filter includes a mechanical shutter.

13 . The apparatus of claim 11 wherein the switchable optical filter includes an electro-wetting device.

14 . The apparatus of claim 11 wherein the switchable optical filter includes a MEMS tunable optical element.

15 . The apparatus of claim 11 wherein the switchable optical filter includes a movable liquid IR filter.

16 . The apparatus of claim 15 wherein the movable liquid IR filter includes a colored oil film to block or significantly attenuate IR radiation.

17 . The apparatus of claim 11 wherein the switchable optical filter includes a Fabry-Perot filter.

18 . The apparatus of claim 11 further including a respective color filter disposed between the optical assembly and a particular one of the pixels, wherein each color filter is operable to pass radiation in the IR part of the spectrum and a particular portion of the visible part of the spectrum.

19 . A method of using the apparatus of claim 11 , the method including two or more of the following:
generating a color image based on output signals from the pixels sensing color radiation in the visible part of the spectrum when the switchable optical filter is in the second state; (ii) generating an IR image based on the output signals from the pixels sensing IR radiation when the switchable optical filter is in the first state; (iii) performing iris recognition based on output signals from the pixels sensing IR radiation when the switchable optical filter is in the first state; (iv) performing facial recognition based on output signals from the pixels sensing color radiation in the visible part of the spectrum when the switchable optical filter is in the second state.

20 . The method of claim 19 wherein the method includes:
at least one of (i) or (iv); and
at least one of (ii) or (iii).

Assignees

• Heptagon Micro Optics Pte Ltd

Inventors

• Rudmann Hartmut
• Roentgen Peter

Classifications

• G03B33/04 Primary

  by four or more separation records · CPC title

• H04N23/56

  provided with illuminating means · CPC title

• H04N23/12

  with one sensor only · CPC title

• H04N23/57

  Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices · CPC title

• G01S17/894

  Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar · CPC title