Gaze tracking variations using dynamic lighting position

Patent metadata

Field	Value
Publication number	US-9468373-B2
Application number	US-201414493723-A
Country	US
Kind code	B2
Filing date	Sep 23, 2014
Priority date	Sep 24, 2013
Publication date	Oct 18, 2016
Grant date	Oct 18, 2016

Abstract

Aspects of the present disclosure relate to eye tracking systems and methods which track eyes by illuminating the eyes using a light source and detecting the eye illuminations using a sensor. Implementations of the present disclosure may utilize a light source with a dynamic lighting position to account for changes in lighting conditions during the tracking which interfere with detection of the eye illuminations, such as reflections in glasses which may obscure a user's eyes.

First claim

What is claimed is:

1. A method comprising:
emitting light from an eye tracking device;
capturing one or more images with the eye tracking device of an area illuminated by said emitting the light;
determining one or more gaze characteristics from analysis of the images based on eye illuminations within the images from said emitting the light;
analyzing the images to detect a pre-defined change in lighting conditions in the images; and
triggering a change of a position of a source of the light upon detection of the pre-defined change in the light conditions.

2. The method of claim 1 , wherein the pre-defined change is an occurrence of glare which interferes with the eye illuminations in the images.

3. The method of claim 1 , wherein said determining the gaze characteristics based on the eye illuminations includes analyzing a Dark Pupil in the images which is generated by said emitting the light, wherein said analyzing the images to detect the pre-defined change in lighting conditions includes analyzing a location of the Dark Pupil for a bright spot at the location which exceeds a pre-defined size threshold, a pre-defined intensity threshold, or a combination thereof.

4. The method of claim 1 ,
wherein the eye tracking device has a plurality of light sources,
wherein said emitting the light includes initially emitting the light from one or more first light sources selected from the plurality of light sources and, after said change in the position, emitting light from one or more second light sources selected from the plurality of light sources which are different from the first light sources, and
wherein said triggering the change includes triggering a change from emitting the light from the first light sources to emitting light from the second light sources.

5. The method of claim 4 , wherein the plurality of light sources are infrared LEDs, wherein the images are infrared images, and wherein triggering the change includes turning off the first infrared LEDs and turning on the second infrared LEDs.

6. The method of claim 4 , wherein the second light sources are offset from the first light sources in a vertical direction.

7. The method of claim 4 , wherein the pre-defined change is an occurrence of glare which interferes with the eye illuminations in the images.

8. The method of claim 1 , wherein said determining the gaze characteristics includes determining a gaze direction.

9. A system comprising:
an eye tracking device; and
a computing device, wherein the system is configured to perform a method, the method comprising:
emitting light from the eye tracking device;
capturing one or more images with the eye tracking device of an area illuminated by said emitting the light;
determining one or more gaze characteristics from analysis of the images with the computing device based on eye illuminations within the images from said emitting the light;
analyzing the images with the computing device to detect a pre-defined change in lighting conditions in the images; and
triggering a change with the computing device of a position of a source of the light upon detection of the pre-defined change in the light conditions.

10. The system of claim 9 ,
wherein the eye tracking device has a plurality of light sources,
wherein said emitting the light includes initially emitting the light from one or more first light sources selected from the plurality of light sources and, after said change in the position, emitting light from one or more second light sources selected from the plurality of light sources which are different from the first light sources, and
wherein said triggering the change includes triggering a change from emitting the light from the first light sources to emitting light from the second light sources.

11. The system 10 , The method of claim 4 , wherein the plurality of light sources are infrared LEDs, wherein the images are infrared images, and wherein triggering the change includes turning off the first infrared LEDs and turning on the second infrared LEDs.

12. The system of claim 10 , wherein the pre-defined change is an occurrence of glare which interferes with the eye illuminations in the images.

13. The system of claim 9 ,
wherein the eye tracking device has one or more sets of light sources,
wherein each said set has a plurality of light sources offset in a vertical direction with respect to each other,
wherein said emitting the light includes initially emitting the light from one or more first light sources selected from each of the sets of the light sources and, after said change in the position, emitting light from one or more second light sources selected from each of the sets of the light sources which are different from the first light sources, and
wherein said triggering the change includes triggering a change from emitting the light from the first light sources to emitting light from the second light sources.

14. The system of claim 13 , wherein the one or more sets are a plurality of sets of light sources, wherein each of the plurality of the sets are horizontally offset from each other.

15. The system of claim 9 , wherein the pre-defined change is an occurrence of glare which interferes with the eye illuminations in the images.

16. The system of claim 9 , wherein said determining the gaze characteristics based on the eye illuminations includes analyzing a Dark Pupil in the images which is generated by said emitting the light, wherein said analyzing the images to detect the pre-defined change in lighting conditions includes analyzing a location of the Dark Pupil for a bright spot at the location which exceeds a pre-defined size threshold, a pre-defined intensity threshold, or a combination thereof.

17. The system of claim 9 , wherein said determining the gaze characteristics includes determining a gaze direction.

18. A non-transitory computer readable medium having processor-executable instructions embodied therein, wherein execution of the instructions by a processor causes a processor to perform a method, the method comprising:
emitting light from an eye tracking device;
capturing one or more images with the eye tracking device of an area illuminated by said emitting the light;
determining one or more gaze characteristics from analysis of the images based on eye illuminations within the images from said emitting the light;
analyzing the images to detect a pre-defined change in lighting conditions in the images; and
triggering a change of a position of a source of the light upon detection of the pre-defined change in the light conditions.

19. The non-transitory computer readable medium of claim 18 , wherein the pre-defined change is an occurrence of glare which interferes with the eye illuminations in the images.

20. The non-transitory computer readable medium of claim 18 ,
wherein the pre-defined change is an occurrence of glare which interferes with the eye illuminations in the images,
wherein the eye tracking device has a plurality of light sources,
wherein said emitting the light includes initially emitting the light from one or more first light sources selected from the plurality of light sources and, after said change in the position, emitting light from one or more second light sources selected from the plurality of light sources which are different from the first light sources, and
wherein said triggering the change includes triggering a change from emitting the light from the first light sources to emitting light from the second light sources.

Assignees

• Sony Computer Entertainment Inc
• Sony Interactive Entertainment Inc

Inventors

• Larsen Eric J

Classifications

• A61B3/0025

  characterised by electronic signal processing, e.g. eye models · CPC title

• A61B3/14

  Arrangements specially adapted for eye photography · CPC title

• G06T7/0012

  Biomedical image inspection · CPC title

• G06T2207/30041

  Eye; Retina; Ophthalmic · CPC title

• A61B3/113 Primary

  for determining or recording eye movement · CPC title