Light field directional backlighting based three-dimensional (3D) pupil steering

Patent metadata

Field	Value
Publication number	US-12276796-B2
Application number	US-202218073823-A
Country	US
Kind code	B2
Filing date	Dec 2, 2022
Priority date	Aug 16, 2022
Publication date	Apr 15, 2025
Grant date	Apr 15, 2025

Abstract

A head-mounted display device employs light field directional backlighting to provide three-dimensional (3D) pupil steering without mechanical adjustment while maintaining a compact form factor and performance. An example light field directional backlighting unit includes two substantially flat components: an array of light sources and an array of modulators (e.g., a micro lens array (MLA), a stack of transmissive display elements, a pinhole array, and similar ones). By digitally modifying the illumination pattern on the array of light source and pairing to the light field directional backlighting unit to an extra transmissive display element as the main display panel and one or more viewing optical elements, a light field created by the light field directional backlighting unit is moved in three-dimensional (3D) space to correspond to pupil shift without interfering with the display content.

First claim

The invention claimed is:

1. A head-mounted display (HMD) device, comprising:
a two-dimensional (2D) light emitting diode (LED) array;
a micro lens array (MLA) axially aligned with the two-dimensional (2D) light emitting diode (LED) array;
a transmissive display element axially aligned with the micro lens array (MLA); and
an optical lens axially aligned with the transmissive display element, wherein individual light emitting diodes (LEDs) of the two-dimensional (2D) light emitting diode (LED) array are selectively activated for three-dimensional (3D) pupil steering at an eye box receiving focused light beams from the optical lens,
wherein the micro lens array (MLA) is placed at a predefined distance from the transmissive display element to increase a footprint of illumination for each lenslet of the micro lens array (MLA) on the transmissive display element.

2. The head-mounted display (HMD) device of claim 1 , wherein the two-dimensional (2D) light emitting diode (LED) array is at about a focal length (f MLA ) of the micro lens array (MLA).

3. The head-mounted display (HMD) device of claim 1 , wherein one or more individual light emitting diodes (LEDs) or one or more groups of light emitting diodes (LEDs) of the two-dimensional (2D) light emitting diode (LED) array are activated or deactivated for local dimming.

4. The head-mounted display (HMD) device of claim 1 , further comprising:
a Pancharatnam-Berry phase (PBP) lens and a holographic optical element (HOE) between the two-dimensional (2D) light emitting diode (LED) array and the transmissive display element to increase a fill factor.

5. The head-mounted display (HMD) device of claim 1 , wherein the micro lens array (MLA) is a first micro lens array (MLA), and the apparatus further comprises:
a second micro lens array (MLA) placed between the two-dimensional (2D) light emitting diode (LED) array and the first micro lens array (MLA) to increase an efficiency for an off-axis pupil position.

6. The head-mounted display (HMD) device of claim 5 , wherein individual lenslets of the second micro lens array (MLA) are at least three times smaller compared to individual lenslets of the first micro lens array (MLA).

7. The head-mounted display (HMD) device of claim 1 , wherein the micro lens array (MLA) is a first micro lens array (MLA), and the apparatus further comprises:
a second micro lens array (MLA) placed between the transmissive display element and the optical lens to converge light beams diffracted by pixels of the transmissive display element.

8. The head-mounted display (HMD) device of claim 7 , wherein individual lenslets of the second micro lens array (MLA) are at least three times smaller compared to individual lenslets of the first micro lens array (MLA).

9. The head-mounted display (HMD) device of claim 1 , further comprising:
a camera to track a position of a pupil;
a processor to control selective activation of individual light emitting diodes (LEDs) of the two-dimensional (2D) light emitting diode (LED) array based, at least in part, on the tracked position of the pupil such that three-dimensional (3D) pupil steering is achieved at an eye box receiving focused light beams from the optical lens.

10. The head-mounted display (HMD) device of claim 1 , wherein the two-dimensional (2D) light emitting diode (LED) array comprises one or more of a light emitting diode (LED) array, a micro light emitting diode (μLED) array, or a micro-organic light emitting diode (μOLED) panel.

11. A head-mounted display (HMD) device, comprising:
a two-dimensional (2D) light emitting diode (LED) array;
a first micro lens array (MLA) axially aligned with the two-dimensional (2D) light emitting diode (LED) array;
a second micro lens array (MLA) placed between the two-dimensional (2D) light emitting diode (LED) array and the first micro lens array (MLA) to increase an efficiency for an off-axis pupil position;
a transmissive display element axially aligned with the first micro lens array (MLA); and
an optical lens axially aligned with the transmissive display element, wherein individual light emitting diodes (LEDs) of the two-dimensional (2D) light emitting diode (LED) array are selectively activated for three-dimensional (3D) pupil steering at an eye box receiving focused light beams from the optical lens.

12. The head-mounted display (HMD) device of claim 11 , wherein individual lenslets of the second micro lens array (MLA) are at least three times smaller compared to individual lenslets of the first micro lens array (MLA).

13. The head-mounted display (HMD) device of claim 11 , wherein the two-dimensional (2D) light emitting diode (LED) array is at about a focal length (f MLA ) of the first micro lens array (MLA).

14. The head-mounted display (HMD) device of claim 11 , wherein one or more individual light emitting diodes (LEDs) or one or more groups of light emitting diodes (LEDs) of the two-dimensional (2D) light emitting diode (LED) array are activated or deactivated for local dimming.

15. The head-mounted display (HMD) device of claim 11 , further comprising:
a camera to track a position of a pupil; and
a processor to control selective activation of individual light emitting diodes (LEDs) of the two-dimensional (2D) light emitting diode (LED) array based, at least in part, on the tracked position of the pupil such that three-dimensional (3D) pupil steering is achieved at an eye box receiving focused light beams from the optical lens.

16. A head-mounted display (HMD) device, comprising:
a two-dimensional (2D) light emitting diode (LED) array;
a first micro lens array (MLA) axially aligned with the two-dimensional (2D) light emitting diode (LED) array;
a second micro lens array (MLA);
a transmissive display element axially aligned with the first micro lens array (MLA); and
an optical lens axially aligned with the transmissive display element,
wherein the second micro lens array (MLA) is placed between the transmissive display element and the optical lens to converge light beams diffracted by pixels of the transmissive display element, and
wherein individual light emitting diodes (LEDs) of the two-dimensional (2D) light emitting diode (LED) array are selectively activated for three-dimensional (3D) pupil steering at an eye box receiving focused light beams from the optical lens.

17. The head-mounted display (HMD) device of claim 16 , wherein individual lenslets of the second micro lens array (MLA) are at least three times smaller compared to individual lenslets of the first micro lens array (MLA).

18. The head-mounted display (HMD) device of claim 16 , wherein the two-dimensional (2D) light emitting diode (LED) array is at about a focal length (f MLA ) of the first micro lens array (MLA).

19. The head-mounted display (HMD) device of claim 16 , wherein one or more individual light emitting diodes (LEDs) or one or more groups of light emitting diodes (LEDs) of the two-dimensional (2D) light emitting diode (LED) array are activated or deactivated for local dimming.

20. The head-mounted display (HMD) device of claim 16 , further comprising:
a camera to track a position of a pupil; and
a processor to control selective activation of individual light emitting diodes (LEDs) of the two-dimensional (2D) light emitting diode (LED) array based, at least in part, on the tracked position of the pupil such that three-dimensional (3D) pupil steering is achieved at an eye box receiving focused light beams from the optical lens.

Assignees

• Meta Platforms Tech Llc

Inventors

• Huang Hekun
• Wang Xuan
• Hallstein Sascha

Classifications

• G02B3/0043 Primary

  Inhomogeneous or irregular arrays, e.g. varying shape, size, height · CPC title

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G02B2027/0174

  holographic · CPC title

• G02B3/0068

  arranged in a single integral body or plate, e.g. laminates or hybrid structures with other optical elements (G02B5/1885, G02B17/002, G02B30/27 take precedence) · CPC title

• G02B27/0172 Primary

  characterised by optical features · CPC title