Eye gaze determination

Patent metadata

Field	Value
Publication number	US-9829973-B2
Application number	US-201414580286-A
Country	US
Kind code	B2
Filing date	Dec 23, 2014
Priority date	Dec 23, 2013
Publication date	Nov 28, 2017
Grant date	Nov 28, 2017

Abstract

There is provided methods, systems and computer program products for identifying an interaction element from one or more interaction elements present in a user interface, comprising: receiving gaze information from an eye tracking system; determining the likelihood that an interaction element is the subject of the gaze information from the eye tracking system; and identifying an interaction element from the one or more interaction elements based on said likelihood determination.

First claim

What is claimed:

1. A computer system providing a gaze-controlled interface, the computer system comprising:
an operating system for executing an application;
a display module for displaying at least one interaction element on a visual display;
an eye tracking system operable to determine at least one gaze position of a user; and
an identification module operable to determine an interaction element displayed on the visual display that is the subject of the gaze position;
wherein the identification module comprises a processor configured to determine an interaction element by:
assigning a first weighting to an interaction element based on at least one property of the interaction element;
determining a likelihood that the user will direct their gaze to the interaction element dependent on the gaze position by using an alpha mask representing a weight distribution of said interaction element;
assigning a second weighting to the interaction element dependent on the likelihood;
determining the distance from the determined gaze position to a selected coordinate or area within the interaction element, wherein the selected coordinate or area is a center of the interaction element; and
identifying an interaction element dependent on the first weighting, the second weighting, and the determined distance from the determined gaze position to the selected coordinate or area.

2. The computer system according to claim 1 , wherein the at least one property is selected from a group consisting of:
an intended use;
a visual context;
an interaction context; and
collected data indicating how often one or more users interacts with the interaction element.

3. The computer system according to claim 1 , wherein identifying the interaction element is further based on information on the physiological properties of an eye of the user.

4. The computer system according to claim 1 , wherein identifying the interaction element comprises:
determining a weighting of a first and a second interaction element;
comparing the difference in the weighting between said first and second interaction elements with a threshold value; and
selecting from said first and second interaction elements based at least in part on said comparison with said threshold value.

5. A computer program product comprising a non-transitory computer-readable medium with instructions for causing a programmable computer to at least:
execute an application;
display at least one interaction element on a visual display;
use an eye tracking system to determine at least one gaze position of a user; and
determine an interaction element displayed on the visual display that is the subject of the gaze position by:
assigning a first weighting to an interaction element based on at least one property of the interaction element;
determining a likelihood that the user will direct their gaze to the interaction element dependent on the gaze position by using an alpha mask representing a weight distribution of said interaction element;
assigning a second weighting to the interaction element dependent on the likelihood;
determining the distance from the determined gaze position to a selected coordinate or area within the interaction element, wherein the selected coordinate or area is a center of the interaction element; and
identifying an interaction element dependent on the first weighting, the second weighting, and the determined distance from the determined gaze position to the selected coordinate or area.

6. The computer program product according to claim 5 , wherein the at least one property is selected from a group consisting of:
an intended use;
a visual context;
an interaction context; and
collected data indicating how often one or more users interacts with the interaction element.

7. The computer program product according to claim 5 , wherein identifying the interaction element is further based on information on the physiological properties of an eye of the user.

8. The computer program product according to claim 5 , wherein identifying the interaction element comprises:
determining a weighting of a first and a second interaction element;
comparing the difference in the weighting between said first and second interaction elements with a threshold value; and
selecting from said first and second interaction elements based at least in part on said comparison with said threshold value.

9. A method of providing a gaze-controlled interface, the method comprising:
executing an application;
displaying at least one interaction element on a visual display;
using an eye tracking system to determine at least one gaze position of a user; and
determining an interaction element displayed on the visual display that is the subject of the gaze position by:
assigning a first weighting to an interaction element based on at least one property of the interaction element;
determining a likelihood that the user will direct their gaze to the interaction element dependent on the gaze position by using an alpha mask representing a weight distribution of said interaction element;
assigning a second weighting to the interaction element dependent on the likelihood;
determining the distance from a determined gaze position to a selected coordinate or area within the interaction element, wherein the selected coordinate or area is a center of the interaction element; and
identifying an interaction element dependent on the first weighting, the second weighting, and the determined distance from the determined gaze position to the selected coordinate or area.

10. The method according to claim 9 , wherein the at least one property is selected from a group consisting of:
an intended use;
a visual context;
an interaction context; and
collected data indicating how often one or more users interacts with the interaction element.

11. The method according to claim 9 , wherein identifying the interaction element is further based on information on the physiological properties of an eye of the user.

12. The method according to claim 9 , wherein identifying the interaction element comprises:
determining a weighting of a first and a second interaction element;
comparing the difference in the weighting between said first and second interaction elements with a threshold value; and
selecting from said first and second interaction elements based at least in part on said comparison with said threshold value.

Assignees

• Tobii Ab

Inventors

• Vennström Anders
• Skogö Mårten
• Elvesjö John

Classifications

• G06T2207/20076

  Probabilistic image processing · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06T2207/10048

  Infrared image · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• G06T2207/30201

  Face · CPC title