Gaze and saccade based graphical manipulation

Patent metadata

Field	Value
Publication number	US-10082870-B2
Application number	US-201715476650-A
Country	US
Kind code	B2
Filing date	Mar 31, 2017
Priority date	Mar 4, 2013
Publication date	Sep 25, 2018
Grant date	Sep 25, 2018

Abstract

According to the invention, a system for presenting graphics on a display device is disclosed. The system may include an eye tracking device for determining a gaze point of a user on a display device. The system may also include a graphics processing device for causing graphics to be displayed on the display device. The graphics displayed on the display device may be modified such that the graphics in an area including the gaze point of the user have at least one modified parameter relative to graphics outside the area. The size of the area may be based at least in part on an amount of noise in the gaze point over time and at least one other secondary factor.

First claim

What is claimed is:

1. A system for presenting graphics on a display device, wherein the system comprises:
an eye tracking device configured to determine a gaze point of a user on an image displayed on a display device; and
a processing device configured to:
cause the image to be displayed on the display device; and
modify an area of the image which includes the gaze point of the user, wherein:
a size of the area is based at least in part on an amount of noise in the gaze point over time and at least one other secondary factor, wherein the at least one other secondary factor comprises the image including text; and
modifying the area of the image comprises modifying at least one parameter of the image within the area of the image relative to a remainder of the image.

2. The system for presenting graphics on a display device of claim 1 , wherein the secondary factor comprises:
an identity of the user.

3. The system for presenting graphics on a display device of claim 1 , wherein the secondary factor comprises:
an identifier of the eye tracking device.

4. The system for presenting graphics on a display device of claim 1 , wherein the secondary factor comprises:
a determination about a state or a characteristic of the user.

5. The system for presenting graphics on a display device of claim 4 wherein the determination about the state or the characteristic of the user comprises:
a determination that the user is tired based at least in part on data received from the eye tracking device.

6. The system for presenting graphics on a display device of claim 1 , wherein the secondary factor comprises:
an environmental variable.

7. The system for presenting graphics on a display device of claim 6 , wherein the environmental variable comprises:
an ambient light level.

8. The system for presenting graphics on a display device of claim 6 , wherein the environmental variable comprises:
a humidity level.

9. The system for presenting graphics on a display device of claim 6 , wherein the environmental variable comprises:
a concentration of particulate matter.

10. The system for presenting graphics on a display device of claim 6 , wherein the environmental variable comprises:
an amount of wind.

11. The system for presenting graphics on a display device of claim 6 , wherein the environmental variable comprises:
a temperature.

12. The system for presenting graphics on a display device of claim 1 , wherein the at least one parameter comprises at least one selection from a group consisting of:
resolution;
shading quality;
texture mapping quality;
quality of reflection rendering;
anti-aliasing;
frame rate;
three-dimensional rendering quality;
animation quality;
post-processing effects quality;
refraction quality;
three dimensional object quality;
opacity; and
graphical content.

13. A method for presenting graphics on a display device, wherein the method comprises:
determining, with an eye tracking device, a gaze point of a user on an image displayed on a display device;
causing, with a processing device, the image to be displayed on the display device; and
modifying, with the processing device, an area of the image which includes the gaze point of the user, wherein:
a size of the area is based at least in part on an amount of noise in the gaze point over time and at least one other secondary factor, wherein the at least one other secondary factor comprises the image including dynamic or static images; and
modifying the area of the image comprises modifying at least one parameter of the image within the area of the image relative to a remainder of the image.

14. The method for presenting graphics on a display device of claim 13 , wherein the secondary factor comprises:
an identity of the user.

15. The method for presenting graphics on a display device of claim 13 , wherein the secondary factor comprises:
a determination about a state or a characteristic of the user.

16. The method for presenting graphics on a display device of claim 13 , wherein the secondary factor comprises:
an environmental variable.

17. A non-transitory machine readable medium having instructions thereon for presenting graphics on a display device, the instructions executable by one or more processors to at least:
determine a gaze point of a user on an image displayed on a display device;
cause the image to be displayed on the display device; and
modify an area of the image which includes the gaze point of the user, wherein:
a size of the area is based at least in part on an amount of noise in the gaze point over time and at least one other secondary factor, wherein the at least one other secondary factor comprises the image including bright or dark content; and
modifying the area of the image comprises modifying at least one parameter of the image within the area of the image relative to a remainder of the image.

18. The non-transitory machine readable medium of claim 17 , wherein the secondary factor comprises:
an identity of the user.

19. The non-transitory machine readable medium of claim 17 , wherein the secondary factor comprises:
a determination about a state or a characteristic of the user.

20. The non-transitory machine readable medium of claim 17 , wherein the secondary factor comprises:
an environmental variable.

Assignees

• Tobii Ab

Inventors

• Thunström Robin
• Skogö Märten
• Rönngren Denny
• Clausen Anders

Classifications

• G06T5/00

  Image enhancement or restoration · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G09G5/373

  for modifying the size of the graphic pattern · CPC title

• G06F2203/011

  Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns · CPC title

• G09G5/37

  Details of the operation on graphic patterns (G09G5/38 takes precedence) · CPC title