Gaze and saccade based graphical manipulation

Patent metadata

Field	Value
Publication number	US-9898081-B2
Application number	US-201615270783-A
Country	US
Kind code	B2
Filing date	Sep 20, 2016
Priority date	Mar 4, 2013
Publication date	Feb 20, 2018
Grant date	Feb 20, 2018

Abstract

According to the invention, a system for presenting graphics on a display device is disclosed. The system may include an eye tracking device and a graphics processing device. The eye tracking device may be for determining a gaze point of a user on a display device. The graphics processing device may be for causing graphics to be displayed on the display device. The graphics displayed on the display device may be modified such that the graphics are of higher quality in an area including the gaze point of the user, than outside the area.

First claim

What is claimed is:

1. A system for presenting graphics on a display device, wherein the system comprises:
an eye tracking device for determining a gaze point of a user on a display device;
a graphics processing device for causing graphics to be displayed on the display device;
wherein the graphics processing device causes graphics displayed on the display device to be of a higher quality in an area including the gaze point of the user than outside the area; and
wherein a location of the area is changed based at least in part on the eye tracking device determining that at least a predetermined number of gaze points of the user are located outside the area.

2. The system for presenting graphics on a display device of claim 1 , wherein the area includes a sub-area containing the gaze point of the user.

3. The system for presenting graphics on a display device of claim 2 , wherein while the gaze point of the user remains within the sub-area, the location of the area on the display device does not change.

4. The system for presenting graphics on a display device of claim 2 , wherein when the gaze point of the user moves outside the sub-area, a new area having higher quality graphics is located around the gaze point.

5. The system for presenting graphics on a display device of claim 2 , wherein a size of the sub-area is based at least in part on the proximity of the user to the display device.

6. The system for presenting graphics on a display device of claim 1 , wherein a size of the area is based at least in part on the proximity of the user to the display device.

7. The system for presenting graphics on a display device of claim 1 , wherein a size of the sub-area is based at least in part on an eccentricity angle between a user's eye and the display device.

8. The system for presenting graphics on a display device of claim 1 , wherein the gaze point of a user on the display device, as determined by the eye tracking device, includes noise.

9. The system for presenting graphics on a display device of claim 8 , wherein a size of the sub-area is based at least in part on the amount of noise included in the gaze point of the user as determined by the eye tracking device.

10. The system for presenting graphics on a display device of claim 1 , wherein higher quality comprises at least one selection from a group consisting of:
increased resolution;
increased shading quality;
increased texture mapping quality;
increased quality of reflection rendering;
increased anti-aliasing;
increased frame rate;
increased three-dimensional rendering quality;
increased animation quality
increased post-processing effects quality;
increased refraction quality; and
increased three dimensional object quality.

11. A method for presenting graphics on a display device, wherein the method comprises:
determining, with an eye tracking device, a gaze point of a user on a display device;
causing, with a graphics processing device, graphics to be displayed on the display device;
wherein the graphics processing device causes graphics displayed on the display device to be of a higher quality in an area including the gaze point of the user than outside the area; and
wherein at least one of a shape or a size of the area is changed based at least in part on the eye tracking device determining that at least a predetermined number of gaze points of the user are located outside the area.

12. The method for presenting graphics on a display device of claim 11 , wherein the area having higher quality graphics includes a sub-area containing the gaze point of the user.

13. The method for presenting graphics on a display device of claim 12 , wherein while the gaze point of the user remains within the sub-area, the location of the area on the display device does not change.

14. The method for presenting graphics on a display device of claim 12 , wherein when the gaze point of the user moves outside the sub-area, a new area having higher quality graphics is located around the gaze point.

15. The method for presenting graphics on a display device of claim 12 , wherein a size of the sub-area is based at least in part on the proximity of the user to the display device.

16. A non-transitory machine readable medium having instructions thereon for presenting graphics on a display device, the instructions executable by one or more processors to at least:
determine a gaze point of a user on a display device;
cause graphics to be displayed on the display device;
wherein the graphics displayed on the display device are of a higher quality in an area including the gaze point of the user than outside the area; and
wherein a location of the area is changed based at least in part on the eye tracking device determining that the gaze point of the user is located outside the area for at least a predetermined period of time.

17. The non-transitory machine readable medium of claim 16 , wherein the area having higher quality graphics includes a sub-area containing the gaze point of the user.

18. The non-transitory machine readable medium of claim 17 , wherein while the gaze point of the user remains within the sub-area, the location of the area on the display device does not change.

19. The non-transitory machine readable medium of claim 17 , wherein when the gaze point of the user moves outside the sub-area, a new area having higher quality graphics is located around the gaze point.

20. The non-transitory machine readable medium of claim 17 , wherein a size of the sub-area is based at least in part on the proximity of the user to the display device.

21. A wearable device for presenting graphics to a user, wherein the wearable device comprises:
an eye tracking device for determining a gaze point of a user on a display device;
a processing device for causing graphics to be displayed on the display device;
wherein the processing device causes graphics displayed on the display device to be of a higher quality in an area including the gaze point of the user than outside the area;
wherein at least one of a shape or a size of the area is changed by the processing device based at least in part on the eye tracking device determining that the gaze point of the user is located outside the area for at least a predetermined period of time.

22. The wearable device of claim 21 , wherein the area having higher quality graphics includes a sub-area containing the gaze point of the user.

23. The wearable device of claim 22 , wherein while the gaze point of the user remains within the sub-area, the location of the area on the display device does not change.

24. The wearable device of claim 22 , wherein when the gaze point of the user moves outside the sub-area, a new area having higher quality graphics is located around the gaze point.

Assignees

• Tobii Ab

Inventors

• Thunstroem Robin
• Skogoe Mårten

Classifications

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06T2210/36

  Level of detail · CPC title