Adaptive camera and illuminator eyetracker

Patent metadata

Field	Value
Publication number	US-10314484-B2
Application number	US-201715595672-A
Country	US
Kind code	B2
Filing date	May 15, 2017
Priority date	Apr 1, 2009
Publication date	Jun 11, 2019
Grant date	Jun 11, 2019

Abstract

A method includes obtaining an image of an eye in a bright-pupil imaging mode in which a retinal retro-reflection complements the image of the eye in the bright-pupil mode, and obtaining an image of the eye in a dark-pupil imaging mode in which a corneo-scleral retro-reflection complements the image of the eye in the dark-pupil mode. One of the bright-pupil imaging mode and the dark-pupil imaging mode is selected based on quality of obtained images.

First claim

What is claimed is:

1. A system for determining a gaze direction of at least one eye of a user, wherein the system comprises:
a plurality of image sensors;
a plurality of illuminators; and
a processor configured to:
determine an operational mode of the system from a first mode and a second mode, the first mode comprising a bright pupil mode, the second mode comprising a dark pupil mode, each of the bright pupil mode and the dark pupil mode associated with combinations of one or more of the plurality of image sensors and one or more of the plurality of illuminators;
select, based on the operational mode, a particular image sensor from the combinations applicable to the operational mode;
select, based on, the operational mode and the particular image sensor, a particular illuminator from the combinations applicable to the operational mode;
activate the particular image sensor and the particular illuminator; and
determine a gaze direction of at least one eye of a user based at least in part on an image captured by the particular image sensor of light from the particular illuminator reflecting from the at least one eye of the user.

2. The system for determining a gaze direction of claim 1 , wherein determining the operational mode comprises:
activating a first image sensor;
activating at least one illuminator which is substantially coaxial with the first image sensor to obtain a first image by the first image sensor;
determining an image quality metric of the first image;
activating a second image sensor;
activating at least one illuminator which is substantially non-coaxial with the second image sensor to obtain a second image by the second image sensor;
determining an image quality metric of the second image; and
determining to operate the system in the first mode when the image quality metric of the first image is greater than the image quality metric of the second image, and to operate the system in the second mode when the image quality metric of the first image is less than the image quality metric of the second image.

3. The system for determining a gaze direction of claim 1 , wherein:
the operational mode is selected as the bright pupil mode;
the particular illuminator is substantially coaxial with the particular image sensor; and
determining the gaze direction comprises analyzing a retinal retro-reflection in an iris image captured by the particular image sensor.

4. The system for determining a gaze direction of claim 1 , wherein:
the operational mode is selected as the dark pupil mode;
the particular illuminator is substantially non-coaxial with the particular image sensor; and
determining the gaze direction comprises analyzing a corneo-scleral reflection in an iris image captured by the particular image sensor.

5. The system for determining a gaze direction of claim 4 , wherein:
the particular illuminator selected produces a more centric corneo-scleral glint than an alternative illuminator not selected.

6. The system for determining a gaze direction of claim 1 , wherein the processor is further configured to:
re-determine whether to operate the system in the first mode or the second mode, and to re-select the particular image sensor and the particular illuminator after each determination of the gaze direction.

7. A non-transitory machine readable medium having instructions stored thereon for determining a gaze direction of at least one eye of a user, wherein the instructions, upon execution by one or more processors of an eye tracking system, cause the eye tracking system to at least:
determine an operational mode of the eye tracking system from a first mode and a second mode, the first mode comprising a bright pupil mode, the second mode comprising a dark pupil mode, each of the bright pupil mode and the dark pupil mode associated with combinations of one or more of image sensors and one or more of illuminators;
select, based on the operational mode, a particular image sensor from the combinations applicable to the operational mode;
select, based on the operational mode and the particular image sensor, a particular illuminator from the combinations applicable to the operational mode; and
activate the particular image sensor and the particular illuminator for a gaze direction determination.

8. The non-transitory machine readable medium of claim 7 , wherein determining the operational mode comprises:
activating a first image sensor;
activating at least one illuminator which is substantially coaxial with the first image sensor to obtain a first image by the first image sensor;
determining an image quality metric of the first image;
activating a second image sensor;
activating at least one illuminator which is substantially non-coaxial with the second image sensor to obtain a second image by the second image sensor;
determining an image quality metric of the second image; and
determining to operate the system in the first mode when the image quality metric of the first image is greater than the image quality metric of the second image, and to operate the system in the second mode when the image quality metric of the first image is less than the image quality metric of the second image.

9. The non-transitory machine readable medium of claim 7 , wherein:
the operational mode is selected as the bright pupil mode;
the particular illuminator is substantially coaxial with the particular image sensor illuminator selected; and
determining the gaze direction comprises analyzing a retinal retro-reflection in an iris image captured by the particular image sensor.

10. The non-transitory machine readable medium of claim 7 , wherein:
the operational mode is selected as the dark pupil mode;
the particular illuminator is substantially non-coaxial with the particular image sensor; and
determining the gaze direction comprises analyzing a corneo-scleral reflection in an iris image captured by the particular image sensor.

11. The non-transitory machine readable medium of claim 10 , wherein:
the particular illuminator selected produces a more centric corneo-scleral glint than an alternative illuminator not selected.

12. The non-transitory machine readable medium of claim 7 , wherein the instructions are further executable by one or more processors to at least:
re-determine whether to operate the system in the first mode or the second mode, and to re-select the particular image sensor and the particular illuminator after each determination of the gaze direction.

13. A method for determining a gaze direction of at least one eye of a user, wherein the method comprises:
determining an operational mode of an eye tracking system from a first mode and a second mode, the first mode comprising a bright pupil mode, the second mode comprising a dark pupil mode, each of the first mode and the second mode associated with combinations of one or more of image sensors and one or more of illuminators;
selecting, based on the operational mode, a particular image sensor from the combinations applicable to the operational mode;
selecting, based on the operational mode and the particular image sensor, a particular illuminator from the combinations applicable to the operational mode; and
activating the particular image sensor and the particular illuminator for a gaze direction determination.

14. The method for determining a gaze direction of claim 13 , wherein determining the operational mode comprises:
activating a first image sensor;
activating at least one illuminator which is substantially coaxial with the first image sensor to obtain a first image by the first image sensor;
determining an imag

Assignees

• Tobii Ab

Inventors

• Blixt Peter
• Troili Gunnar
• Kingbäck Anders
• Elvesjö John Mikael
• Skogö Mårten

Classifications

• A61B3/113 Primary

  for determining or recording eye movement · CPC title

• A61B3/0008

  provided with illuminating means (A61B3/117, A61B3/14 take precedence) · CPC title

• A61B3/14

  Arrangements specially adapted for eye photography · CPC title

• A61B3/145

  by video means · CPC title

• A61B3/0025

  characterised by electronic signal processing, e.g. eye models · CPC title