Display with an embedded eye tracker

Patent metadata

Field	Value
Publication number	US-10274730-B2
Application number	US-201615065811-A
Country	US
Kind code	B2
Filing date	Mar 9, 2016
Priority date	Aug 3, 2015
Publication date	Apr 30, 2019
Grant date	Apr 30, 2019

Abstract

A display device includes a two-dimensional array of tiles. Each tile includes a two-dimensional array of pixels and a lens of a two-dimensional array of lenses. Each pixel is configured to output light so that the two-dimensional array of pixels outputs a respective pattern of light. Each lens is configured to direct at least a portion of the respective pattern of light from the two-dimensional array of pixels to a pupil of an eye of a user. The display device also includes an array of sensors for determining a location of the pupil of the eye of the user.

First claim

What is claimed is:

1. A display device, comprising:
a two-dimensional array of tiles, each tile comprising:
a two-dimensional array of pixels, wherein each pixel is configured to output light so that the two-dimensional array of pixels outputs a respective pattern of light; and
a lens, of a two-dimensional array of lenses, configured to direct at least a portion of the respective pattern of light from the two-dimensional array of pixels to a pupil of an eye of a user;

one or more sensors for determining a location of the pupil of the eye of the user, and
one or more emitters configured to emit non-visible light, wherein
the one or more sensors and the one or more emitters are located on a first substrate;
the two-dimensional array of pixels is located on a second substrate that is distinct from the first substrate, separate from the first substrate, and located between the first substrate and the two-dimensional array of lenses;
the two-dimensional array of pixels, configured to output the pattern of light, is configured to transmit at least a portion of non-visible light emitted by the one or more emitters to the eye of the user and to transmit at least a portion of non-visible light from the eye of the user toward the one or more sensors; and
the two-dimensional array of lenses is configured to transmit at least a portion of non-visible light emitted by the one or more emitters to the eye of the user and to transmit at least a portion of non-visible light from the eye of the user toward the one or more sensors.

2. The display device of claim 1 , wherein the one or more sensors comprise an array of sensors.

3. The display device of claim 2 , including:
an array of emitters configured to emit non-visible light, wherein each emitter is coupled with a respective group of multiple sensors, of the array of sensors, located adjacent to the emitter.

4. The display device of claim 1 , including:
an array of emitters configured to emit non-visible light, wherein each emitter is coupled with a respective sensor of the one or more sensors.

5. The display device of claim 1 , including:
multiple arrays of sensors for determining the location of the pupil of the eye of the user, wherein a respective array is separate from the rest of the multiple arrays of sensors.

6. The display device of claim 1 , including:
one or more polarizers configured to reduce light reflected from a cornea of the eye of the user toward the one or more sensors.

7. The display device of claim 1 , including:
one or more processors coupled with the two-dimensional array of tiles and configured to select a subset of the two-dimensional array of tiles based on the location of the pupil of the eye of the user and activate the subset of the two-dimensional array of tiles for outputting, from at least the subset of the two-dimensional array of tiles, a collective pattern of light that is directed to the pupil of the eye of the user.

8. The display device of claim 7 , wherein:
the one or more processors are configured to activate the one or more sensors for determining the location of the pupil of the eye of the user between activating the subset of the two-dimensional array of tiles.

9. The display device of claim 7 , wherein:
the one or more processors are configured to activate at least a subset of the one or more sensors concurrently for determining the location of the pupil of the eye of the user.

10. The display device of claim 7 , wherein:
the one or more processors are configured to activate at least a subset of the array of sensors sequentially for determining the location of the pupil of the eye of the user.

11. The display device of claim 1 , wherein:
the one or more processors are configured to adjust the detected location of the pupil of the eye of the user based on an interpupilary distance of the pupil of the eye of the user.

12. A method, comprising:
at a display device comprising a two-dimensional array of tiles, one or more sensors for determining a location of a pupil of an eye of a user, and one or more emitters configured to emit non-visible light, each tile comprising:
a two-dimensional array of pixels, each pixel being configured to output light so that the two-dimensional array of pixels outputs a respective pattern of light, and
a lens, of a two-dimensional array of lenses, configured to direct at least a portion of the respective pattern of light from the two-dimensional array of pixels to the pupil of the eye of the user, wherein
the one or more sensors and the one or more emitters are located on a first substrate;
the two-dimensional array of pixels is located on a second substrate that is distinct from the first substrate, separate from the first substrate, and located between the first substrate and the two-dimensional array of lenses;
the two-dimensional array of pixels, configured to output the pattern of light, is configured to transmit at least a portion of non-visible light emitted by the one or more emitters to the eye of the user and to transmit at least a portion of non-visible light from the eye of the user toward the one or more sensors; and
the two-dimensional array of lenses is configured to transmit at least a portion of non-visible light emitted by the one or more emitters to the eye of the user and transmit at least a portion of non-visible light from the eye of the user toward the one or more sensors:

selecting a subset of the two-dimensional array of tiles based on the location of the pupil of the eye of the user and activating the subset of the two-dimensional array of tiles for outputting, from at least the subset of the two-dimensional array of tiles, a collective pattern of light that is directed to the pupil of the eye of the user.

13. The method of claim 12 , including:
activating the one or more sensors for determining the location of the pupil of the eye of the user between activating the subset of the two-dimensional array of tiles.

14. The method of claim 12 , including:
activating at least a subset of the one or more sensors concurrently for determining the location of the pupil of the eye of the user.

15. The method of claim 12 , including:
activating at least a subset of the one or more sensors sequentially for determining the location of the pupil of the eye of the user.

16. The method of claim 12 , wherein the one or more sensors comprise an array of sensors.

Assignees

• Facebook Tech Llc

Inventors

• Jepsen Mary Lou
• Shroff Sapna

Classifications

• G02F1/29

  for the control of the position or the direction of light beams, i.e. deflection · CPC title

• G09G2340/0407

  Resolution change, inclusive of the use of different resolutions for different screen areas · CPC title

• G02F2203/24

  beam steering · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title