Dual mode image sensor and method of using same

Patent metadata

Field	Value
Publication number	US-2017366754-A1
Application number	US-201615187942-A
Country	US
Kind code	A1
Filing date	Jun 21, 2016
Priority date	Jun 21, 2016
Publication date	Dec 21, 2017
Grant date	—

Abstract

A dual mode image sensor is provided. The image sensor includes an on-chip sensing array, on-chip analog-to-digital converters, and an on-chip processor. The sensor array has rows and columns of discrete sensor elements. The dual mode image sensor has a scene sensing mode and an image capture mode, which use the same set of imaging optics. The processor includes a dual context register; one being for the scene sensing mode and the other for image capture mode. The scene sensing mode is configured to output results of object sensing, motion detection, focus evaluation and illumination measurement to the analog-to-digital converters. The image capture mode is configured to output captured images to the analog-to-digital converters, which are configured to send the digital data to the processor. The processor is configured to switch from scene sensing mode to image capture mode based upon the scene sensing mode output results.

First claim

1 . A dual mode image sensor having controls for exposure, gain, clock, frame rate, subsampling and binning, comprising:
a set of imaging optics; a sensing array on a chip, the sensor array having rows and columns of discrete sensor elements, the sensor array configured to receive light through the imaging optics; a scene sensing mode; an image capture mode; the scene sensing mode and the image capture mode using the set of imaging optics; analog-to-digital converters on the chip to convert analog values into digital data; a processor on the chip to process the digital data, the processor having dual context registers, one register for the scene sensing mode, and the second register for the image capture mode; the scene sensing mode being configured to output results of object sensing, motion detection, focus evaluation and illumination measurement to the analog-to-digital converters; the image capture mode configured to output captured images to the analog-to-digital converters; the analog-to-digital converters being configured to send the digital data to the processor; and the processor being configured to switch from scene sensing mode to image capture mode based upon the digital data from the analog-to-digital converters about the output results in the scene sensing mode.

2 . The dual mode image sensor of claim 1 , wherein the scene sensing mode has a sensor configuration for scanning using the sensor array selected from line scanning and zone scanning.

3 . The dual mode image sensor of claim 2 , wherein the sensor configuration of line scanning is selected from single line, multi-line, and separated multi-line scanning.

4 . The dual mode image sensor of claim 2 , wherein the sensor configuration of zone scanning is selected from single zone and multi-zone scanning.

5 . The dual mode image sensor of claim 1 , wherein the image capture mode uses full resolution of the sensor array to provide image data.

6 . The dual mode image sensor of claim 1 , wherein the scene sensing mode is under low clock frequency.

7 . The dual mode image sensor of claim 1 , wherein the processor provides scene analysis and remap results based upon digital data from the scene sensing mode to a sensor output.

8 . The dual mode image sensor of claim 6 , wherein the processor is configured to operate the dual image sensor in a power saving mode based upon the digital data from the analog-to-digital converters about the output results in the scene sensing mode indicating no motion being sensed.

9 . The dual mode image sensor of claim 1 , wherein the imaging optics are provided with infrared illumination filters; and wherein the processor is configured to activate the infrared illumination filters based upon the digital data from the analog-to-digital converters about the output results in the scene sensing mode indicating low light conditions.

10 . The dual mode image sensor of claim 1 , wherein the processor is provided with further registers for storing sensing inputs and outputs; and wherein the processor is provided with inter-integrated circuits; the further registers being accessible with the inter-integrated circuits.

11 . The dual mode image sensor of claim 1 , wherein the processor is provided with object detection to determine differences between output frames from the digital data; and wherein the processor is provided with object speed vector algorithms to correlate differences between output frames from the digital data for motion detection; and wherein the processor is configured to switch from scene sensing mode to image capture mode based upon object detection and motion detection.

12 . The dual mode image sensor of claim 1 , further comprising output pins, the output pins being electrically connected to an output of the processor; the output pins being configured by the processor for output image data, pixel clock, horizontal sync and vertical sync based upon the dual mode image sensor being in image capture mode; and the output pins being configured by the processor for average scene illumination level, x and y motion speed, and focusing signal based upon the dual mode image sensor being in scene sensing mode.

13 . The dual mode image sensor of claim 12 , wherein the image capture mode and the scene sensing mode operate simultaneously; the processor being configured to analyze scene sensing data; the processor further configured to control gain, exposure, zoom, autofocus, and image processing corrections based upon the scene sensing data to improve the image capture mode data.

14 . The dual mode image sensor of claim 13 , wherein the processor is provided with additional registers to store the scene sensing data; and wherein, the processor is provided with inter-integrated circuits, the inter-integrated circuits being provided with access to the registers storing scene sensing data; and wherein scene sensing data is accessible to a user of the dual mode image sensor.

15 . The dual mode image sensor of claim 14 , wherein the scene sensing data is appended to image data files and to video data streams available as outputs of the dual mode image sensor.

16 . The dual mode image sensor of claim 12 , wherein the image capture mode and the scene sensing mode operate alternately; the scene sensing mode operating for a short frame period between long image capture frames; the processor being configured to analyze scene sensing data; the processor further configured to control gain, exposure, zoom, autofocus, and image processing corrections based upon the scene sensing data to improve the image capture mode data.

17 . A process for using a dual mode image sensor having a single set of imaging optics for an image capture mode and a scene sensing mode, comprising the steps of:
initializing the image sensor; providing activating criteria for image capture mode; initializing scene sensing mode; providing data in scene sensing mode on object sensing, motion detection, focus evaluation and illumination measurement; determining if provided data meets activating criteria; triggering image capture mode based upon provided data meeting activating criteria; continuing scene sensing mode based upon provided data not meeting activating criteria; capturing an image; outputting resulting image; analyzing resulting image; determining if image capture should be repeated based upon analysis of resulting image; and repeating the capturing an image step based upon a positive determination in the determining if image capture should be repeated step.

18 . The process of claim 17 , further comprising the step of re-initializing scene sensing mode after the step of determining if image capture should be repeated based upon a negative determination in the determining if image capture should be repeated step.

19 . The process of claim 17 , wherein the step of initializing the sensor is preceded by a step of powering up the dual mode image sensor.

20 . The process of claim 17 , wherein the initializing step is activated by an image motion sensor.

Assignees

• Hand Held Prod Inc

Inventors

• Feng Chen
• Xian Tao
• Giordano Patrick Anthony
• Bremer Edward C
• Kearney Sean Philip

Classifications

• H04N25/42

  by switching between different modes of operation using different resolutions or aspect ratios, e.g. switching between interlaced and non-interlaced mode · CPC title

• H04N25/709

  Circuitry for control of the power supply · CPC title

• H04N23/67 Primary

  Focus control based on electronic image sensor signals · CPC title

• H04N23/667 Primary

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title

• H04N25/70

  SSIS architectures; Circuits associated therewith · CPC title