Optical systems having multiple light paths for performing foveation

Patent metadata

Field	Value
Publication number	US-11852819-B2
Application number	US-202117479322-A
Country	US
Kind code	B2
Filing date	Sep 20, 2021
Priority date	Nov 22, 2019
Publication date	Dec 26, 2023
Grant date	Dec 26, 2023

Abstract

An electronic device may include a display module that produces foveated images having high and low resolution regions. The module may include a reflective display panel that produces first reflected light during first time periods and second reflected light during second time periods. The first reflected light may reflect off of a beam splitter to form the low resolution region of the foveated image. The second reflected light may be transmitted by the beam splitter, de-magnified by a lens, and redirected by an optical steering element to produce the high resolution region at a desired, adjustable, location in the foveated image. The reflective display panel may be replaced by sets of emissive display panels that concurrently display the high and low resolution regions in the foveated image. The sets of emissive display panels may be replaced by front-lit reflective display panels.

First claim

What is claimed is:

1. A display system configured to display a foveated image having a first region with a first resolution and a second region with a second resolution greater than the first resolution, the display system comprising:
an optical system configured to direct the foveated image;
a light source that produces illumination light;
a reflective display panel, wherein:
during a first time period, the reflective display panel is configured to reflect the illumination light as first reflected light, and
during a second time period different from the first time period, the reflective display panel is configured to reflect the illumination light as second reflected light;

a polarizing beam splitter, wherein:
the polarizing beam splitter is configured to reflect the first reflected light towards the optical system as the first region of the foveated image, and
the polarizing beam splitter is configured to transmit the second reflected light;

a lens configured to receive the second reflected light transmitted by the polarizing beam splitter and configured to de-magnify the second reflected light transmitted by the polarizing beam splitter to produce de-magnified light; and
an optical steering element configured to re-direct the de-magnified light through the polarizing beam splitter and towards the optical system as the second region of the foveated image.

2. The display system of claim 1 , further comprising:
control circuitry, wherein the control circuitry is configured to adjust the optical steering element to change a location of the second region in the foveated image.

3. The display system of claim 2 , wherein the optical steering element comprises an adjustable mirror.

4. The display system of claim 2 , further comprising:
a mirror, wherein the optical steering element is configured to re-direct the de-magnified light towards the mirror and wherein the mirror is configured to reflect the de-magnified light through the polarizing beam splitter and towards the optical system as the second region of the foveated image.

5. The display system of claim 4 , wherein the optical steering element comprises a switchable liquid crystal steering device.

6. The display system of claim 4 , further comprising an additional lens, wherein the lens is optically interposed between the mirror and the polarizing beam splitter.

7. The display system of claim 6 , further comprising a polarizing element, wherein the polarizing element is optically interposed between the additional lens and the polarizing beam splitter.

8. The display system of claim 7 , wherein the polarizing element is configured to provide the de-magnified light with a polarization that is transmitted by the polarizing beam splitter.

9. The display system of claim 2 , further comprising:
a gaze tracking sensor, wherein the gaze tracking sensor is configured to gather gaze tracking data that identifies a gaze direction, and wherein the control circuitry is configured to adjust the optical steering element to align the location of the second region with the gaze direction identified by the gaze tracking data.

10. The display system of claim 1 , wherein the reflective display panel comprises a liquid crystal on silicon (LCOS) display panel.

11. The display system of claim 1 , wherein the reflective display panel comprises a digital-micromirror device display panel.

12. The display system of claim 1 , further comprising:
a mirror, wherein the mirror is configured to reflect the illumination light towards the polarizing beam splitter and wherein the mirror is configured to reflect the second reflected light transmitted by the polarizing beam splitter towards the lens; and
a partial mirror, wherein the partial mirror is configured to transmit the illumination light, wherein the partial mirror is configured to receive the second reflected light from the mirror, and wherein the partial mirror is configured to reflect the second reflected light towards the lens.

13. The display system of claim 12 , wherein the lens is optically interposed between the partial mirror and the optical steering element, wherein the mirror is optically interposed between the partial mirror and the polarizing beam splitter, and wherein the polarizing beam splitter is optically interposed between the mirror and the reflective display panel.

14. The display system of claim 1 , wherein the optical system comprises a waveguide having an input coupler configured to couple the foveated image into the waveguide and an output coupler configured to couple the foveated image out of the waveguide.

15. The display system of claim 1 , wherein the first reflected light does not pass through the lens and is not redirected by the optical steering element.

16. The display system of claim 1 , further comprising:
a waveguide configured to propagate the first reflected light via total internal reflection and configured to propagate the de-magnified light via total internal reflection.

17. The display system of claim 16 , wherein the waveguide comprises surface relief gratings.

18. The display system of claim 1 , wherein the optical steering element has a first state in which the de-magnified light is re-directed in a first direction and in which the second region is at a first location in the foveated image, and wherein the optical steering element has a second state in which the de-magnified light is re-directed in a second direction different from the first direction and in which the second region is at a second location in the foveated image that is different from the first location.

19. The display system of claim 18 , further comprising control circuitry configured to control the optical steering element to switch between the first and second states.

20. The display system of claim 1 , further comprising a prism, wherein the prism is optically interposed between the light source and the reflective display panel.

Assignees

• Apple Inc

Inventors

• Myhre Graham B
• Peng Guolin
• Choi Hyungryul
• Delapp Scott M
• Bhakta Vikrant

Classifications

• G02B27/0172 Primary

  characterised by optical features · CPC title

• G02B27/0093 Primary

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G02B27/283

  used for beam splitting or combining · CPC title

• G02B27/1066

  for enhancing image performance, like resolution, pixel numbers, dual magnifications or dynamic range, by tiling, slicing or overlapping fields of view · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title