Light field displays incorporating eye trackers and methods for generating views for a light field display using eye tracking information

Patent metadata

Field	Value
Publication number	US-11474597-B2
Application number	US-202017087053-A
Country	US
Kind code	B2
Filing date	Nov 2, 2020
Priority date	Nov 1, 2019
Publication date	Oct 18, 2022
Grant date	Oct 18, 2022

Abstract

A multiview autostereoscopic display includes a display area including an array of angular pixels, an eye tracker, and a processing system. Each angular pixel emits color that varies across a field of view of that angular pixel. The array of angular pixels displays different views in different viewing zones across the field of view of the display. The eye tracker detects the presence of the eyes of at least one viewer within specific viewing zones and produces eye tracking information including locations of the detected eyes within the specific viewing zones. The processing system renders a specific view for each detected eye based upon the location of the detected eye within the viewing zone with detected eyes, and generates control information for the array of angular pixels to cause the specific view for each detected eye to be displayed in the viewing zone in which that eye was detected.

First claim

What is claimed is:

1. A multiview autostereoscopic display for providing a plurality of views to a viewer, comprising:
a display area comprising an array of angular pixels, where:
each angular pixel is configured for emitting light that varies across a field of view of that angular pixel; and
the array of angular pixels is configured for displaying different views in different viewing zones across a field of view of the display;
at least one eye tracker configured for (i) detecting the presence of eyes of the viewer within specific viewing zones, (ii) producing eye tracking information related to locations of the eyes so detected within the specific viewing zones, and (iii) detecting locations of the detected eyes within the specific viewing zones by performing a hierarchical eye tracking process comprising determining a location of the viewer, determining a location of a head of the viewer based on the location of the viewer so determined, and determining locations of the viewer's eyes based upon the location of the head of the viewer so determined; and
a processing system, where the processing system is configured for:
rendering a specific view for each one of the eyes so detected based upon the location of that eye within the viewing zone in which that eye was detected; and
generating control information for the array of angular pixels to cause the specific view for that eye to be displayed in the viewing zone in which that eye was detected.

2. The multiview autostereoscopic display of claim 1 , wherein the processing system is configured for rendering an updated view for each one of the eyes so detected based upon an updated location for that eye within the viewing zone in which that eye was previously detected.

3. The multiview autostereoscopic display of claim 2 , wherein the processing system is configured for rendering the updated view based upon a relative motion between a previous location for the detected eye and the updated location for the detected eye.

4. The multiview autostereoscopic display of claim 1 , wherein the processing system is configured for rendering at least one of reduced resolution views, reduced density views, and two-dimensional views for display in specific viewing zones based upon eye tracking information.

5. The multiview autostereoscopic display of claim 4 ,
wherein the eye tracking information includes confidence information indicating a level of uncertainty associated with a tracked eye location, and
wherein the processing system is further configured for adjusting the rendering according to the confidence information.

6. The multiview autostereoscopic display of claim 1 , wherein the processing system is configured for generating control information to control activation of emitters within the array of angular pixels based upon eye tracking information to prevent display of views in specific viewing zones.

7. The multiview autostereoscopic display of claim 1 , wherein the processing system is configured for rendering specific views for each one of the eyes so detected based upon the location of that eye within the viewing zone in which that eye was detected and in manner constrained by a determined viewer specific inter-pupil distance.

8. The multiview autostereoscopic display of claim 1 , wherein:
the at least one eye tracker comprises at least one gaze tracker configured for determining a gaze direction for each detected eye of the viewer; and
the processing system is configured for rendering a specific view for each detected eye based upon the location of the detected eye within the viewing zone in which the eye was detected and the gaze direction of the detected eye.

9. A multiview autostereoscopic display
for providing views viewable by a first viewer and a second viewer, comprising:
a display area comprising an array of angular pixels, where:
each angular pixel is configured for emitting light that varies across a field of view of that angular pixel; and
the array of angular pixels is configured for displaying different views in different viewing zones across a field of view of the display;
at least one eye tracker configured for (i) detecting the presence of eyes of the first viewer and eyes of the second viewer within specific viewing zones, (ii) producing eye tracking information related to locations of the eyes so detected within the specific viewing zones; and (iii) simultaneously tracking eyes of the first and second viewers; and
a processing system configured for:
rendering a specific view for each one of the eyes so detected based upon the location of that eye within the viewing zone in which that eye was detected;
generating control information for the array of angular pixels to cause the specific view for that eye to be displayed in the viewing zone in which that eye was detected;
rendering specific views based upon a first scene for each detected eye of the first viewer,
rendering additional views based upon a second scene for each detected eye of the second viewer, the second scene being at least partially different from the first scene, and
generating control information for the array of angular pixels such that, simultaneously, the specific views for each detected eye of the first viewer are displayed in viewing zones in which the eyes of the first viewer were detected, and the additional views for each detected eye of the second viewer are displayed in viewing zones in which the second viewer's eyes were detected.

10. The multiview autostereoscopic display of claim 9 , wherein the control information so generated by the processing system causes no view to be displayed outside the viewing zones in which at least one of the first and second viewers' eyes were detected.

11. A multiview autostereoscopic display
for providing views viewable by a first viewer and a second viewer, comprising:
a display area comprising an array of angular pixels, where:
each angular pixel is configured for emitting light that varies across a field of view of that angular pixel; and
the array of angular pixels is configured for displaying different views in different viewing zones across a field of view of the display;
an eye tracker that (i) includes a first eye tracker for tracking eyes of the first viewer and a second eye tracker for tracking eyes of the second viewer, and (ii) is configured for detecting the presence of eyes of the viewer within specific viewing zones, and producing eye tracking information related to locations of the eyes so detected within the specific viewing zones; and
a processing system configured for:
rendering a specific view for each one of the eyes so detected based upon the location of that eye within the viewing zone in which that eye was detected;
generating control information for the array of angular pixels to cause the specific view for that eye to be displayed in the viewing zone in which that eye was detected;
rendering specific views based upon a first scene for each detected eye of the first viewer,
rendering additional views based upon a second scene for each detected eye of the second viewer, the second scene being at least partially different from the first scene, and
generating control information for the array of angular pixels such that, simultaneously, the specific views for each detected eye of the first viewer are displayed in viewing zones in which the eyes of the first viewer were detected, and the additional views for each detected eye of the second viewer are displayed in the viewing zones in which the second viewer's eyes were detected.

12. The multiview autostereoscopic display of claim 11 , wherein the control information so generated by the proce

Assignees

• Google Llc

Inventors

• Pulli Kari
• Wetzstein Gordon
• Spicer Ryan
• Jones Andrew
• Maila Tomi
• Economou Zisimos

Classifications

• H04N13/398

  Synchronisation thereof; Control thereof · CPC title

• G02B27/0093 Primary

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• H04N13/307

  using fly-eye lenses, e.g. arrangements of circular lenses · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G02B30/31 Primary

  involving active parallax barriers (involving directional light or back-light sources G02B30/33) · CPC title