Generation of graphical feedback in a computer system

Patent metadata

Field	Value
Publication number	US-9760170-B2
Application number	US-201514959790-A
Country	US
Kind code	B2
Filing date	Dec 4, 2015
Priority date	Feb 1, 2006
Publication date	Sep 12, 2017
Grant date	Sep 12, 2017

Abstract

The present invention relates to control of a computer system, which includes a data processing unit, a display and an eye tracker adapted to register a user's gaze point with respect to the display The data processing unit is adapted to present graphical information on the display, which includes feedback data reflecting the user's commands entered into the unit. The data processing unit is adapted to present the feedback data such that during an initial phase, the feedback data is generated based on an absolute position of the gaze point. An imaging device of the system is also adapted to register image data representing movements of a body part of the user, and to forward a representation of the image data to the data processing unit. Hence, during a phase subsequent to the initial phase, the data is instead generated based on the image data.

First claim

The invention claimed is:

1. A computer system comprising:
a data processing unit adapted to present graphical information including feedback data on a display;
a memory unit storing software executable by the data processing unit; and
an eye tracker adapted to register a user's gaze point with respect to the display and image data representing movements of a body part of the user,
wherein the computer system is operative to present the feedback data such that:
during an initial phase, the feedback data is generated based on an absolute position of the gaze point detected by the eye tracker, wherein the feedback data, during the initial phase, is positioned on the display at a start location defined by the gaze point, the gaze point being where the eye tracker has estimated the user's gaze to be directed, and
during a subsequent phase following the initial phase, the feedback data is generated based on the image data representing movements of the user's body part, wherein, during the subsequent phase, the feedback data is moved from the start location determined in the initial phase to a new location on the display based on the image data representing movements of the user's body part determined in the subsequent phase to thereby refine the position of the feedback data on the display based on the user's movements of the body part as a refinement to the detection of the user's gaze point,
wherein the initial phase is instigated in response to engagement by the user of an input member,
wherein the eye tracker is adapted to register the user's gaze point in connection with engagement of the input member,
wherein, in response thereto, the data processing unit is configured to cause feedback data to be presented on the display, which feedback data represents an estimated position for the gaze point of the user, thereafter the data processing unit is configured to initiate the subsequent phase automatically at a predetermined time after initiation of the initial phase, and end the subsequent phase in response to disengagement of said input member by the user, the graphical information presented on the display including a first fraction representing non-feedback data and a second fraction representing the feedback data, and
wherein the software stored in the memory unit that is executable by the data processing unit renders the computer system further operative to cause presentation of the second fraction at a confirmation position on the display, where the location of the confirmation position depends on a content of the first fraction.

2. The computer system according to claim 1 , wherein the data processing unit is adapted to: receive a user-generated start command via engagement of the input member, and instigate the initial phase in response to a reception of the start command.

3. The computer system according to claim 1 , wherein the feedback data represents a graphical pointer, and the data processing unit is adapted to: during the initial phase, position the pointer on the display at a start location being reflected by the gaze point, and during the subsequent phase, move the pointer from the start location in response to the image data.

4. The computer system according to claim 3 , wherein the data processing unit is adapted to interpret the image data to represent a relative repositioning of the graphical pointer from the start location in such a manner that a particular movement of the body part causes a predetermined repositioning of the graphical pointer.

5. The computer system according to claim 3 , wherein the data processing unit is adapted to cause the display to repeatedly update the presented feedback data in response to the image data during the subsequent phase.

6. The computer system according to claim 1 , wherein the at least one imaging device is included in the eye tracker.

7. A computer implemented method for presenting graphical information including feedback data on a display based on a user's gaze point with respect to the display and image data representing movements of a body part of the user, said method comprising:
instigating an initial phase in response to engagement by the user of an input member;
registering the user's gaze point in connection with engagement of the input member;
in response thereto causing feedback data to be presented on the display, wherein the feedback data is generated based on an absolute position of the gaze point detected by an eye tracker, wherein the feedback data, during the initial phase, is positioned on the display at a start location defined by the gaze point, the gaze point being where the eye tracker has estimated the user's gaze to be directed;
initiating a subsequent phase automatically at a predetermined time after initiation of the initial phase, and end the subsequent phase in response to disengagement of the input member by the user, wherein the feedback data is generated based on the image data representing movements of the user's body part, wherein, during the subsequent phase, the feedback data is moved from the start location determined in the initial phase to a new location on the display based on the image data representing movements of the user's body part determined in the subsequent phase to thereby refine the position of the feedback data on the display based on the user's movements of the body part as a refinement to the detection of the user's gaze point, the graphical information presented on the display including a first fraction representing non-feedback data and a second fraction representing the feedback data; and
presenting the second fraction at a confirmation position on the display, where the location of the confirmation position depends on a content of the first fraction.

8. The computer implemented method according to claim 7 , wherein the feedback data represents a graphical pointer, wherein during the initial phase, positioning the pointer on the display at a start location being reflected by the gaze point, and during the subsequent phase, moving the pointer from the start location in response to the image data.

9. The computer implemented method according to claim 8 comprising interpreting the image data to represent a relative repositioning of the graphical pointer from the start location in such a manner that a particular movement of the body part causes a predetermined repositioning of the graphical pointer.

10. The computer implemented method according to claim 8 comprising causing the display to repeatedly update the presented feedback data in response to the image data during the subsequent phase.

11. A computer program product comprising computer program code stored on a non-transitory computer readable medium, said computer program product for presenting graphical information including feedback data on a display based on a user's gaze point with respect to the display and image data representing movements of a body part of the user, said computer program code comprising computer instructions to cause one or more data processing units to perform the operations of:
instigating an initial phase in response to engagement by the user of an input member;
registering the user's gaze point in connection with engagement of the input member;
in response thereto causing feedback data to be presented on the display, wherein the feedback data is generated based on an absolute position of the gaze point detected by an eye tracker, wherein the feedback data, during the initial phase, is positioned on the display at a start location defined by the gaze point, the gaze point being where the eye tracker has estimated the user's gaze to be directed;
initiating a subsequent phase automatically at a predet

Assignees

• Tobii Ab

Inventors

• Elvesjö John
• Olsson Anders
• Sahlen Johan

Classifications

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G09G5/08

  Cursor circuits · CPC title