Eye tracking control of vehicle entertainment systems

Patent metadata

Field	Value
Publication number	US-8928585-B2
Application number	US-201213605176-A
Country	US
Kind code	B2
Filing date	Sep 6, 2012
Priority date	Sep 9, 2011
Publication date	Jan 6, 2015
Grant date	Jan 6, 2015

Abstract

An in-flight entertainment system includes a video display unit facing a user seat. The video display unit includes a display surface that displays images to a user who is seated on the user seat. A light emitter illuminates eyes of the user. A camera outputs a video signal containing reflections from the illuminated eyes. A processor processes the video signal to determine a viewing location on the display surface at which the eyes are directed, and controls at least one function for how images are displayed on the display surface responsive to the determined viewing location.

First claim

What is claimed:

1. A video display unit comprising:
a display surface configured to display images to a user;
a light emitter configured to illuminate eyes of the user while seated in front of the video display unit;
a camera configured to output a video signal containing reflections from the illuminated eyes;
a processor configured to process the video signal to determine a viewing location on the display surface at which the eyes are directed, and to control at least one function for how images are displayed on the display surface responsive to the determined viewing location; and
a camera angle actuator configured to rotate a viewing angle of the camera relative to the display surface,
wherein the processor is further configured to process the video signal to detect a location of the user's face relative to the camera, and to control the camera angle actuator to rotate the camera toward the user's face to receive reflections from the illuminated eyes.

2. The video display unit of claim 1 , wherein the processor is further configured to:
display target indicia in at least two opposite corner areas of the display surface;
process the video signal to detect when the eyes are looking at a first one of the target indicia, and to responsively determine a first angle to the eyes;
process the video signal to detect when the eyes are looking at a second one of the target indicia that is located within an opposite corner area of the display surface relative to the first target indicia, and to responsively determine a second angle to the eyes;
determine a location of the eyes using the first and second angles; and
control the camera angle actuator to rotate the camera toward the location of the eyes.

3. A video display unit comprising;
a display surface configured to display images to a user;
a light emitter configured to illuminate eyes of the user while seated in front of the video display unit;
a camera configured to output a video signal containing reflections from the illuminated eyes; and
a processor configured to:
process the video signal to determine a viewing location on the display surface at which the eyes are directed,
display a plurality of user selectable indicia on the display surface, wherein a user's selection of different ones of the user selectable indicia causes the processor to perform a corresponding different function controlling how images are displayed on the display surface;
detect that the user has selected a first one of the user selectable indicia in response to determining that the viewing location corresponds to a location of the first user selectable indicia for at least a threshold selection dwell time
display the user selectable indicia with no less than a defined minimum dimensional size value on the display surface;
determine detection accuracy over a plurality of user's attempted selections of at least one of the user selectable indicia; and
control the defined minimum dimensional size value of the user selectable indicia displayed on the display surface in response to the determined detection accuracy.

4. The video display unit of claim 3 , wherein the processor is further configured to:
detect that the user has selected the first one of the user selectable indicia in response to further determining, from processing of the video signal, that the user's eyes remained closed while blinking for at least a threshold blink time while the previously determined viewing location corresponds to the location of the first user selectable indicia.

5. The video display unit of claim 3 , wherein the processor is further configured to:
receive information identifying an angle of recline of a seat back surface on which the user rests; and
control the defined minimum dimensional size value in response to the angle of recline of the seat back surface.

6. The video display unit of claim 3 , wherein the processor is further configured to:
display the user selectable indicia with no less than a defined minimum dimensional size value on the display surface;
process the video signal to determine distance between the user's eyes; and
control the defined minimum dimensional size value in response to the distance between the user's eyes.

7. A video display unit comprising:
a display surface configured to display images to a user;
a light emitter configured to illuminate eyes of the user while seated in front of the video display unit;
a camera configured to output a video signal containing reflections from the illuminated eyes;
an acceleration sensor that generates a vibration signal that is indicative of an amount of vibration experienced by the display surface, wherein the video display unit is part of an in-flight entertainment system and the display surface is attached to a back surface of a user seat to display images to a user who is seated on another user seat facing the user seat; and
a processor configured to:
process the video signal to determine a viewing location on the display surface at which the eyes are directed,
display a plurality of user selectable indicia on the display surface, wherein a user's selection of different ones of the user selectable indicia causes the processor to perform a corresponding different function controlling how images are displayed on the display surface;
detect that the user has selected a first one of the user selectable indicia in response to determining that the viewing location corresponds to a location of the first user selectable indicia for at least a threshold selection dwell time;

display the plurality of user selectable indicia with no less than a defined minimum dimensional size value on the display surface; and
enlarge the defined minimum dimensional size of the plurality of user selectable indicia concurrently displayed on the display surface from a first value to a second value in response to detecting a threshold amount of vibration indicated by the vibration signal.

8. A video display unit comprising:
a display surface configured to display images to a user;
a light emitter configured to illuminate eyes of the user while seated in front of the video display unit;
a camera configured to output a video signal containing reflections from the illuminated eyes;
a processor configured to process the video signal to determine a viewing location on the display surface at which the eyes are directed, and to control at least one function for how images are displayed on the display surface responsive to the determined viewing location;
a plurality of the light emitters spaced apart and arranged horizontally across the video display unit to form a horizontal array; and
a plurality of the light emitters spaced apart and arranged vertically along the video display unit to form a vertical array,
wherein the processor is further configured to sequentially pulse different ones of the light emitters and to process the video signal to identify one of the light emitters in the horizontal array that creates a brightest eye reflection and to identify one of the light emitters in the vertical array that creates a brightest eye reflection, and to determine the viewing location on the display surface responsive to the identified ones of the light emitters in the horizontal and vertical arrays that create the brightest eye reflections.

9. The video display unit of claim 8 , wherein:
the horizontal array of the light emitters is arranged adjacent to a bottom surface of the display area; and
the vertical array of the light emitters is arranged adjacent to a side surface of the display area.

10. The video display unit of claim 8 , wherein the horizontal array comprises a first horizontal array, and the vertical arr

Assignees

• Mondragon Christopher K
• Bleacher Brett
• Thales Avionics Inc

Inventors

• Mondragon Christopher K
• Bleacher Brett

Classifications

• B60N2210/24

  Cameras · CPC title

• B60N2/0028

  of a body part, e.g. of an arm or a leg · CPC title

• B64D47/08

  Arrangements of cameras · CPC title

• G09G5/00 Primary

  Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T) · CPC title

• B64D11/0015

  Arrangements for entertainment or communications, e.g. radio, television · CPC title