Eye gaze detecting device and eye gaze detection method

Patent metadata

Field	Value
Publication number	US-9913578-B2
Application number	US-201514836284-A
Country	US
Kind code	B2
Filing date	Aug 26, 2015
Priority date	Oct 2, 2014
Publication date	Mar 13, 2018
Grant date	Mar 13, 2018

Abstract

An eye gaze detecting device includes: a memory configured to store position information regarding a specific position where a specific object is located; and a processor coupled to the memory and configured to: identify an eye gaze position regarding the subject in an image for each of a plurality of images including the image, and calculate a correction value based on the position information and a plurality of eye gaze positions including the eye gaze position, the correction value causing the plurality of eye gaze positions to match the specific position.

First claim

What is claimed is:

1. An eye gaze detection device comprising:
a memory configured to store position information regarding object positions where objects being displayed are located; and
a processor coupled to the memory and configured to:
specify a plurality of eye gaze positions regarding a subject captured in each of a plurality of images,
determine a first object from among the objects in accordance with at least a part of the plurality of eye gaze positions and the position information, and
calculate a correction value based on both a first object position regarding the first object and a location representing first eye gaze positions included in the plurality of eye gaze positions, the correction value causing the location to match the first object position,
wherein the processor is configured to identify each of eye gaze vectors from each of the plurality of images, and calculates the plurality of eye gaze positions in accordance with each of the eye gaze vectors, the plurality of eye gaze positions being with reference to a virtual space where the objects are located, and
the virtual space includes the object positions of the objects indicated by the position information.

2. The eye gaze detection device according to claim 1 , wherein the correction value is an amount of offset between the location and the first object position.

3. The eye gaze detection device according to claim 1 , wherein the correction value is a transformation matrix to transform the location into the first object position.

4. The eye gaze detection device according to claim 1 , wherein
the first eye gaze positions are determined in accordance with a region including the first eye gaze positions, a shape and size of the region being similar or identical to a shape and size of a first object region associated with the first object.

5. The eye gaze detection device according to claim 1 , wherein the processor is configured to:
carry out a clustering process for clustering the plurality of eye gaze positions, and
select a cluster including the first eye gaze positions, the cluster including a largest number of eye gaze positions from among a plurality of clusters obtained by the clustering process.

6. The eye gaze detection device according to claim 1 , wherein
the first object is determined by comparing a shape or size of a first object region associated with the first object with a shape or size of a region including the part of the plurality of eye gaze positions, the part of the plurality of eye gaze positions being determined in accordance with distances between each of the plurality of eye gaze positions.

7. The eye gaze detection device according to claim 1 , wherein the processor is configured to identify new eye gaze positions of the subject by correcting the first eye gaze positions based on the correction value.

8. The eye gaze detection device according to claim 1 , wherein the first object is an item displayed on a commodity shelf.

9. An eye gaze detection method executed by a computer, the eye gaze detection method comprising:
specifying a plurality of eye gaze positions regarding a subject captured in each of a plurality of images;
referring to a memory that stores position information regarding object positions where objects being displayed are located;
determining a first object from among the objects in accordance with at least a part of the plurality of eye gaze positions and the position information; and
calculating a correction value based on both a first object position regarding the first object and a location representing first eye gaze positions included in the plurality of eye gaze positions, the correction value causing the location to match the first object position; and
identifying each of eye gaze vectors from each of the plurality of images, and calculating the plurality of eye gaze positions in accordance with each of the eye gaze vectors, the plurality of eye gaze positions being with reference to a virtual space where the objects are located, wherein
the virtual space includes the object positions of the objects indicated by the position information.

10. An eye gaze detection device comprising:
a memory configured to store position information regarding object positions where objects being displayed are located; and
a processor coupled to the memory and configured to:
acquire a plurality of eye gaze directions of a subject, the plurality of eye gaze directions being identified from a plurality of images respectively,
generate a plurality of eye gaze positions by identifying an eye gaze position for each of the plurality of eye gaze directions, the plurality of eye gaze positions corresponding to intersections of a virtual plane and the each of the plurality of eye gaze directions, and the virtual plane being set based on a three-dimensional position at which the subject is assumed to gaze,
determine a first object from among the objects in accordance with at least a part of the plurality of eye gaze positions and the position information,
identify a location of a virtual region that includes first eye gaze positions included in the plurality of eye gaze positions,
when it is detected that the virtual region has a shape and size tbat4s similar or identical to a shape and size associated with the first object, calculate a correction value to be applied when a new eye gaze position is identified from a new image based on the location of the virtual region, and a first object position of the first object, and
identify each of eye gaze vectors from each of the plurality of images, and calculate the plurality of eye gaze positions in accordance with each of the eye gaze vectors, the plurality of eye gaze positions being with reference to a virtual space where the objects are located, wherein
the virtual space includes the object positions of the objects indicated by the position information.

Assignees

• Fujitsu Ltd

Inventors

• Taguchi Akinori
• Nakashima Satoshi

Classifications

• A61B3/0025 Primary

  characterised by electronic signal processing, e.g. eye models · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• A61B3/113

  for determining or recording eye movement · CPC title

• G06K9/00597

  Physics · mapped topic

• A61B3/14

  Arrangements specially adapted for eye photography · CPC title