Zonal gaze driven interaction

Patent metadata

Field	Value
Publication number	US-11853477-B2
Application number	US-202318177489-A
Country	US
Kind code	B2
Filing date	Mar 2, 2023
Priority date	Mar 1, 2013
Publication date	Dec 26, 2023
Grant date	Dec 26, 2023

Abstract

A computer system can be controlled with non-contact inputs through zonal control. In an embodiment, a non-contact input that is an eye-tracking device is used to track the gaze of a user. A computer's display, and beyond, can be separated into a number of discrete zones according to a configuration. Each zone is associated with a computer function. The zones and/or their functions can, but need not, be indicated to the user. The user can perform the various functions by moving gaze towards the zone associated with that function and providing an activation signal of intent. The activation signal of intent can be a contact-required or non-contact action, such as a button press or dwelling gaze, respectively.

First claim

What is claimed is:

1. A computing device comprising:
a display;
an eye tracking device which tracks a gaze of a user of the computing device; and
a processing device in communication with the eye tracking device and configured to control the computing device to perform functions comprising:
displaying a menu on the display, wherein the menu includes items corresponding to computer functions;
selecting an item on the menu in response to determining that the gaze of the user is directed toward the item;
determine that the gaze of the user is directed away from the menu;
displaying a zoomed image of a portion of the display near the gaze of the user; and
in response to determining that the gaze of the user is directed toward a location on the zoomed image for a predetermined period of time and without detecting further user input, performing at the location a computer function corresponding to the selected item.

2. The computing device according to claim 1 , wherein the functions further comprise providing an indication of activation when the item on the menu is selected.

3. The computing device according to claim 2 , wherein the indication of activation comprises at least one of a change in the appearance of the item, a sound, or haptic feedback.

4. The computing device according to claim 1 , wherein the item on the menu is a place cursor icon and wherein the corresponding computer function places a mouse cursor within the location of the display at which the gaze of the user is directed.

5. The computing device according to claim 1 , wherein the item on the menu is a gaze scroll icon and wherein the corresponding computer function enables gaze-controlled scrolling within the location of the display at which the gaze of the user is directed.

6. The computing device according to claim 1 , wherein the item on the menu is a click icon or a double click icon and wherein the corresponding computer function emulates performance of at least one physical click on a mouse within the location of the display at which the gaze of the user is directed.

7. The computing device according to claim 1 , wherein the item on the menu is a left click icon or a right click icon and wherein the corresponding computer function emulates performance of a physical click on a mouse within the location of the display at which the gaze of the user is directed.

8. The computing device according to claim 1 , wherein the item on the menu is a gaze drag and drop icon and wherein the corresponding computer function enables use of a non-contact input to emulate a drag and drop action on a mouse.

9. A method for performing a function on a computing device, the method comprising:
displaying a menu on a display of a computing device, wherein the menu includes items corresponding to computer functions;
tracking a gaze direction of a user on the display using an eye tracking device;
selecting an item on the menu in response to determining that the gaze of the user is directed toward the item;
determining the gaze of the user is directed away from the menu;
displaying a zoomed image of a portion of the display near the gaze of the user, and
in response to determining that the gaze of the user is directed toward a location on the zoomed image for a predetermined period of time and without detecting further user input, performing at the location a computer function corresponding to the selected item.

10. The method according to the claim 9 , further comprising providing an indication of activation when the item on the menu is selected.

11. The method according to the claim 10 , wherein the indication of activation comprises at least one of a change in the appearance of the item, a sound, or haptic feedback.

12. The method according to the claim 9 , wherein the item on the menu is a place cursor icon and wherein the corresponding computer function places a mouse cursor within the location of the display at which the gaze of the user is directed.

13. The method according to the claim 9 , wherein the item on the menu is a gaze scroll icon and wherein the corresponding computer function enables gaze-controlled scrolling within the location of the display at which the gaze of the user is directed.

14. The method according to the claim 9 , wherein the item on the menu is a click icon or a double click icon and wherein the corresponding computer function emulates performance of at least one physical click on a mouse within the location of the display at which the gaze of the user is directed.

15. The method according to the claim 9 , wherein the item on the menu is a left click icon or a right click icon and wherein the corresponding computer function emulates performance of a physical click on a mouse within the location of the display at which the gaze of the user is directed.

16. The method according to the claim 9 , wherein the item on the menu is a gaze drag and drop icon and wherein the corresponding computer function enables use of a non-contact input to emulate a drag and drop action on a mouse.

Assignees

• Tobii Ab

Inventors

• Henderek David Figgins
• Olsson Anders
• Sävmarker Magnus Carl Olof
• Wingren Staffan

Classifications

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title

• G06F3/02

  Input arrangements using manually operated switches, e.g. using keyboards or dials · CPC title

• G06F3/0227

  Cooperation and interconnection of the input arrangement with other functional units of a computer (G06F3/023 - G06F3/037 take precedence) · CPC title

• G06F3/033

  Pointing devices displaced or positioned by the user {, e.g. mice, trackballs, pens or joysticks}; Accessories therefor (digitisers characterised by the transducing means G06F3/041) · CPC title