Power management in an eye-tracking system

Patent metadata

Field	Value
Publication number	US-10313587-B2
Application number	US-201715831511-A
Country	US
Kind code	B2
Filing date	Dec 5, 2017
Priority date	Oct 27, 2011
Publication date	Jun 4, 2019
Grant date	Jun 4, 2019

Abstract

An imaging device adapted to provide eye-tracking data by imaging at least one eye of a viewer, wherein: the imaging device is switchable between at least an active mode and a ready mode; the imaging device is configured, in the active mode, to use active eye illumination, which enables tracking of a corneal reflection, and to provide eye tracking data which include eye position and eye orientation; and the imaging device is configured, in the ready mode, to reduce an illumination intensity from a value the illumination intensity has in the active mode.

First claim

The invention claimed is:

1. An imaging device adapted to provide data measurements by imaging at least one eye of a viewer, wherein:
the data measurements describe one or more of eye position or eye orientation;
the imaging device is switchable between at least an active mode and a ready mode;
the imaging device is configured, in the active mode, to maintain a first result history of the data measurements based on data gathered based on first criteria, the first criteria including a first frame rate;
the imaging device is configured, in the ready mode, to maintain a second result history of the data measurements based on data gathered based on second criteria, the second criteria including a second frame rate that is lower than the first frame rate; and
upon switching to the active mode from the ready mode, the imaging device provides additional data based on a combination of the data measurements from the first result history and the data measurements from the second result history.

2. The imaging device of claim 1 , wherein the first criteria further include one or more of:
data estimating camera-to-eye distance,
data indicating multiple distinct tracked eye features,
camera data having a resolution reduced by a relatively low binning ratio,
data received from multiple cameras, or
a particular eye position and a particular eye orientation.

3. The imaging device of claim 2 , wherein the first criteria further include camera data having a full resolution.

4. The imaging device of claim 1 , wherein the second criteria further include one or more of:
data indicating a single distinct tracked eye feature,
camera data having a resolution reduced by a relatively high binning ratio,
data received from a single camera, or
a particular eye position without a particular eye orientation.

5. The imaging device of claim 1 , wherein the second result history includes data measurements based on partially processed data.

6. The imaging device of claim 1 , wherein, in the ready mode, the data gathered based on the second criteria relates to an eye location in an image plane but not in world coordinates.

7. The imaging device of claim 1 , wherein the imaging device is configured to activate, from a group of light sources:
in the active mode, multiple light sources from the group of light sources, and
in the ready mode, a single light source from the group of light sources.

8. The imaging device of claim 1 , wherein the imaging device is configured to pre-process optical data by binning at a higher binning ratio in the ready mode than in the active mode.

9. The imaging device of claim 1 , wherein the imaging device is switchable between the active mode, the ready mode and an idle mode, and wherein a switching time from the idle mode to the active mode is longer than a switching time from the ready mode to the active mode.

10. A personal computer system comprising:
the imaging device of claim 1 ;
a visual display; and
an input device for accepting eye-tracking control data and other input data.

11. The personal computer system of claim 10 , wherein the input device includes:
at least one dedicated input device adapted to accept the eye-tracking control data only; and
at least one general-purpose input device adapted to accept the other input data.

12. The personal computer system of claim 11 , wherein the imaging device operates in the active mode based on an input received from the dedicated input device.

13. The personal computer system of claim 12 , wherein the imaging device changes operation to the active mode based on an interrupt triggered by the input received from the dedicated input device.

14. The personal computer system of claim 11 , wherein the dedicated input device is a hardware touch-actuated input device, and the imaging device operates in an idle mode based on an input received from the hardware touch-actuated input device.

15. The personal computer system of claim 14 , wherein:
the imaging device is selectively connected to a drive power; and
the imaging device changes operation to the idle mode based on the input received from the hardware touch-actuated input device disconnecting the imaging device from said drive power.

16. The personal computer system of claim 10 , further comprising a viewer presence detector configured to provide at least one of:
a positive detection signal, wherein the imaging device switches into the ready mode from an idle mode based on the positive detection signal, or
a negative detection signal, wherein the imaging device switches into the idle mode from either the active mode or the ready mode based on the negative detection signal.

17. The personal computer system of claim 16 , wherein:
the viewer presence detector is a proximity sensor at a push button and is arranged to sense proximity of a finger; and
the proximity sensor is configured to provide the positive detection signal causing the image device to switch into the ready mode from the idle mode.

18. A method in an imaging device adapted to provide data measurements by imaging at least one eye of a viewer,
wherein the data measurements describe one or more of eye position or eye orientation;
wherein said method comprises the steps of:
switching the imaging device between at least an active mode and a ready mode;
in the active mode, maintaining a first result history of the data measurements based on data gathered based on first criteria, the first criteria including a first frame rate; and
in the ready mode, maintaining a second result history of the data measurements based on data gathered based on second criteria, the second criteria including a second frame rate that is lower than the first frame rate; and
upon switching to the active mode from the ready mode, providing additional data based on a combination of the data measurements from the first result history and the data measurements from the second result history.

19. The method of claim 18 , wherein the first criteria further include one or more of:
data estimating camera-to-eye distance,
data indicating multiple distinct tracked eye features,
camera data having a resolution reduced by a relatively low binning ratio,
data received from multiple cameras,
the imaging device being configured to use multiple light sources, or
a particular eye position and a particular eye orientation; and
wherein the second criteria further include one or more of:
data indicating a single distinct tracked eye feature,
camera data having a resolution reduced by a relatively high binning ratio,
data received from a single camera,
the imaging device being configured to use a single light source,
data measurements based on partially processed data, or
the particular eye position without the particular eye orientation.

20. A computer program product embodied in a non-transitory computer readable medium, the computer program product comprising computer-executable instructions for executing the method of claim 18 .

21. A method in a personal computer system, the personal computer system comprising:
a visual display;
an imaging device adapted to provide data measurements by imaging at least one eye of a viewer of the visual display, wherein the data measurements describe one or more of eye position or eye orientation; and
an input device for accepting eye-tracking control data and other input data,
said method comprising the steps of:
switching the imaging device between at least an active mode an

Assignees

• Tobii Ab

Inventors

• Eskilsson Henrik
• Skogö Mårten
• Elvesjö John
• Blixt Peter

Classifications

• G09G2354/00

  Aspects of interface with display user · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G02B27/0172

  characterised by optical features · CPC title

• G09G2330/021

  Power management, e.g. power saving · CPC title

• H04N23/667

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title