Method for displaying gaze point data based on an eye-tracking unit

Patent metadata

Field	Value
Publication number	US-2018232575-A1
Application number	US-201715722971-A
Country	US
Kind code	A1
Filing date	Oct 2, 2017
Priority date	Jan 26, 2009
Publication date	Aug 16, 2018
Grant date	—

Abstract

A method of presenting gaze-point data of a subject detected by an eye-tracking unit includes presenting a test scene picture acquired by a camera unit, and displaying shapes on the test scene picture. The shapes represent momentary gaze points of the subject.

First claim

1 - 14 . (canceled)

15 . A method of determining gaze points of users relative to an image of a physical space comprising:
capturing an image of a physical space; detecting an infrared signal source located within the physical space; determining a direction to the infrared signal source from a first user; determining a gaze direction of the first user based on data gathered by a first eye tracking device; and determining a gaze point of the first user in the image based on the gaze direction of the first user, the image of the physical space, and the direction to the infrared signal source from the first user.

16 . The method of claim 15 , further comprising:
superimposing a visual element onto the image indicating the gaze point of the first user.

17 . The method of claim 16 , further comprising:
determining a direction to the infrared signal source from a second user; determining a gaze direction of the second user based on data gathered by a second eye tracking device; determining a gaze point of the second user in the image based on the gaze direction and the direction to the infrared signal source from the second user; and superimposing a second visual element onto the image indicating a gaze point of a second user.

18 . The method of claim 15 , wherein determining the gaze point of the first user comprises:
correlating the gaze direction and a location of the infrared signal source.

19 . The method of claim 18 , wherein correlating the gaze direction and the location of the infrared signal source comprises:
transforming the gaze direction of the first user from a reference frame of the first eye tracking device to a reference frame of the image of the physical space.

20 . The method of claim 15 , wherein determining the gaze point further comprises:
calibrating the gaze direction based at least in part on personal calibration data.

21 . The method of claim 20 , wherein the personal calibration data is selected from the group consisting of:
horizontal and vertical angles between visual and optical axes of an eye; radius of corneal curvature; and distance between a center of a pupil and a center of corneal curvature.

22 . A system for presenting gaze points of users comprising:
a first eye tracking device; a scene camera; an infrared signal source located within a physical space; and one or more processors configured to:
capture an image of the physical space with the scene camera;
detect the infrared signal source;
determine a direction to the infrared signal source from a first user;
determine a gaze direction of the first user using the first eye tracking device; and
determine a gaze point of the first user in the image based on the gaze direction of the first user, the image, and the direction to the infrared signal source from the first user.

23 . The system of claim 22 , wherein the one or more processors are further configured to:
superimpose a visual element indicating the gaze point of the first user onto the image.

24 . The system of claim 23 , further comprising:
a second eye tracking device; and one or more additional processors configured to:
detect the infrared signal source;
determine a direction to the infrared signal source from a second user;
determine a gaze direction of the second user using the second eye tracking device;
determine a gaze point of the second user in the image based on the gaze direction of the second user, the image, and the direction to the infrared signal source from the second user; and
superimpose a second visual element onto the image indicating a gaze point of the second user.

25 . The system of claim 22 , wherein the one or more processors determining the gaze point of the first user further comprises:
correlating the gaze direction and a location of the infrared signal source.

26 . The system of claim 25 , wherein correlating the gaze direction and the location of the infrared signal source comprises:
transforming the gaze direction of the first user from a reference frame of the first eye tracking device to a reference frame of the image of the physical space.

27 . The system of claim 22 , wherein determining a gaze point of the first user is further based on:
a location of a physical element in the image.

28 . The system of claim 22 , wherein the one or more processors are further configured to:
calibrate the gaze direction based at least in part on personal calibration data.

29 . A non-transitory computer-readable medium having instructions stored thereon executable by a computing device to cause the computing device to perform operations comprising:
capturing an image of a physical space; detecting an infrared signal source located within the physical space; determining a direction from a first user to the infrared signal source; determining a gaze direction of the first user based on data gathered by a first eye tracking device; and determining a gaze point of the first user in the image based on the gaze direction of the first user, the image of the physical space, and the direction from the first user to the infrared signal source.

30 . The non-transitory computer-readable medium of claim 29 , wherein the instructions further comprise:
correlating the infrared signal source with an element in the image.

31 . The non-transitory computer-readable medium of claim 29 , wherein the instructions further comprise:
outputting the image with a visual element indicating the gaze point of the first user superimposed onto the image.

32 . The non-transitory computer-readable medium of claim 31 , wherein the instructions further comprise:
determining a direction from a second user to the infrared signal source; determining a gaze direction of the second user based on data gathered by a second eye tracking device; determining a gaze point of the second user in the image based on the gaze direction of the second user, the image of the physical space, and the direction from the second user to the infrared signal source; and superimposing a second element onto the image indicating a gaze point of a second user.

33 . The non-transitory computer-readable medium of claim 29 , wherein the instructions further comprise:
determining a location of a physical element in the image; and wherein determining the gaze point of the first user in the image is further based on the location of the physical element in the image.

34 . The non-transitory computer-readable medium of claim 29 , wherein the instructions further comprise:
relating a location of the infrared signal source with a reference frame of a camera used to capture the image of the physical space using hardware calibration data.

Assignees

• Tobii Ab

Inventors

• Strombom Johan
• Skogo Marten
• Nystedt Per
• Gustafsson Simon
• Elvesjo John Mikael Holtz
• Blixt Peter

Classifications

• A61B3/113 Primary

  for determining or recording eye movement · CPC title

• A61B3/00

  Apparatus for testing the eyes; Instruments for examining the eyes (eye inspection using ultrasonic, sonic or infrasonic waves A61B8/10) · CPC title

• H04N7/18

  Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast · CPC title

• A61B3/12

  for looking at the eye fundus, e.g. ophthalmoscopes (A61B3/13 takes precedence) · CPC title

• G06K9/00604 Primary

  Physics · mapped topic