Power efficient image sensing apparatus, method of operating the same and eye/gaze tracking system

Patent metadata

Field	Value
Publication number	US-9846481-B2
Application number	US-201615336552-A
Country	US
Kind code	B2
Filing date	Oct 27, 2016
Priority date	Apr 29, 2013
Publication date	Dec 19, 2017
Grant date	Dec 19, 2017

Abstract

An image sensing apparatus has a light sensitive area and a control unit. The light sensitive area registers image data in response to an incoming amount of light, and is operable in an active mode wherein image data can be read out there from as well as in a standby mode wherein image data cannot be read out. The control unit produces a control signal setting the light sensitive area to operate in the active mode and the standby mode respectively in a cyclic manner during an operation period, which preferably encompasses multiple data frame read-outs of image data from the light sensitive area.

First claim

The invention claimed is:

1. An image sensing apparatus comprising:
a light sensitive area configured to register image data in response to an incoming amount of light, the light sensitive area being operable in an active mode wherein image data can be read out there from and a standby mode wherein image data cannot be read out; and
a control unit configured to produce a control signal for setting the light sensitive area in the active mode and the standby mode respectively, said control unit configured to produce the control signal such that the light sensitive area transitions from operation in the active mode to the standby mode and back to the active mode in a cyclic manner during an operation period,
wherein one data frame represents readout of the image data having been registered by the light sensitive area during a capture time,
wherein the control unit is configured to produce the control signal so that the operation period extends over at least one capture time, the light sensitive area operating in the active mode during said at least one capture time, and
wherein either prior to or after the operation period, the control unit is configured to produce the control signal so that the light sensitive area operates in the active mode during an unbroken period of time exceeding a typical capture time associated with a full readout of image data from the light sensitive area.

2. The image sensing apparatus according to claim 1 , comprising an output interface configured to deliver output image data from the light sensitive area, wherein
the light sensitive area is configured to feed a sequence of said data frames through the output interface; and
the control unit is configured to produce the control signal so that the operation period extends over at least one capture time and at least two periods during which the light sensitive area operates in the standby mode, the light sensitive area operating in the active mode during said at least one capture time.

3. The image sensing apparatus according to claim 2 , wherein the operation period extends over at least two capture times during which the light sensitive area operates in the active mode, said at least two capture times being separated by a respective delay period during which the light sensitive area operates in the standby mode.

4. The image sensing apparatus according to claim 1 , wherein
the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows,
the light sensitive area is controllable to read out image data to the output interface, which image data have been registered exclusively by at least one subset of the first number of columns and/or the second number of rows, and
the control unit is further configured to produce the control signal so that said at least one subset of image data is fed to the output interface when the light sensitive area operates in the active mode.

5. The image sensing apparatus according to claim 2 , wherein when the control unit produces the control signal prior to the operation period, the light sensitive area operates in the active mode during an unbroken period of time exceeding a typical capture time associated with a full readout of image data from the light sensitive area.

6. The image sensing apparatus according to claim 1 , wherein
the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, and
the light sensitive area is controllable to read out image data to the output interface such that data from two or more light sensitive elements are combined with one another to form a common data unit and a total number of said data units fed to the output interface is less than the first number times the second number.

7. An eye/gaze tracking system comprising an image sensing apparatus, said image sensing apparatus comprising:
a light sensitive area configured to register image data in response to an incoming amount of light, the light sensitive area being operable in an active mode wherein image data can be read out there from and a standby mode wherein image data cannot be read out, wherein the light sensitive area comprises a set of light sensitive elements arranged in a first number of columns and a second number of rows, and wherein the light sensitive area is controllable to read out image data to an output interface, which image data have been registered exclusively by at least one sub-set of the first number of columns and/or the second number of rows, and
a control unit configured to produce a control signal for setting the light sensitive area in the active mode and the standby mode respectively, said control unit configured to produce the control signal such that the light sensitive area transitions from operation in the active mode to the standby mode and back to the active mode in a cyclic manner during an operation period, wherein the control unit is further configured to produce the control signal so that said at least one subset of image data is fed to the output interface when the light sensitive area operates in the active mode,
wherein the image sensing apparatus being arranged to capture image data of a subject whose eye and/or gaze is tracked,
wherein the control unit is configured to produce the control signal so that said at least one subset of image data represents the image of at least one eye of the subject,
wherein the control unit is configured to produce the control signal so that the operation period extends over at least one capture time, the light sensitive area operating in the active mode during said at least one capture time, and
wherein either prior to or after the operation period, the control unit is configured to produce the control signal so that the light sensitive area operates in the active mode during an unbroken period of time exceeding a typical capture time associated with a full readout of image data from the light sensitive area.

8. A method of controlling an image sensing apparatus having a light sensitive area configured to register image data in response to an incoming amount of light, the light sensitive area being operable in an active mode wherein image data can be read out there from and a standby mode wherein image data cannot be read out; the method comprising:
producing a control signal for setting the light sensitive area in the active mode and the standby mode respectively;
producing the control signal such that the light sensitive area transitions from operation in the active mode to the standby mode and back to the active mode in a cyclic manner during an operation period;
reading out one data frame representing image data having been registered by the light sensitive area during a capture time;
producing the control signal so that the operation period extends over at least one capture time, the light sensitive area operating in the active mode during said at least one capture time; and
either prior to or after the operation period, producing the control signal so that the light sensitive area operates in the active mode during an unbroken period of time exceeding a typical capture time associated with a full readout of image data from the light sensitive area.

9. The method according to claim 8 , wherein the image sensing apparatus comprises an output interface configured to deliver output image data from the light sensitive area, and the method further comprising:
feeding out a sequence of said data frames from the light sensitive area through the output interface; and
producing the control signal so that the operation period extends over at least one capture time and at least two periods during which the light se

Assignees

• Tobii Ab

Inventors

• Skogo Marten
• Jonsson Henrik
• Karlsson Mattias O
• Kuldkepp Mattias
• Elvesjo John
• Karlsson Ingemar Mattias

Classifications

• H04N23/61

  based on recognised objects · CPC title

• H04N23/651

  for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera · CPC title

• G06F1/325 Primary

  Power saving in peripheral device · CPC title

• H04N23/667

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title

• H04N13/383

  for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes · CPC title