Combined birefringent material and reflective waveguide for multiple focal planes in a mixed-reality head-mounted display device

Patent metadata

Field	Value
Publication number	US-11953686-B2
Application number	US-202117448890-A
Country	US
Kind code	B2
Filing date	Sep 26, 2021
Priority date	Sep 26, 2021
Publication date	Apr 9, 2024
Grant date	Apr 9, 2024

Abstract

An optical combiner in a display system of a mixed-reality head-mounted display (HMD) device comprises a lens of birefringent material and a ferroelectric liquid crystal (FLC) modulator that are adapted for use with a reflective waveguide to provide multiple different focal planes on which holograms of virtual-world objects (i.e., virtual images) are displayed. The birefringent lens has two orthogonal refractive indices, ordinary and extraordinary, depending on the polarization state of the incident light. Depending on the rotation of the polarization axis by the FLC modulator, the incoming light to the birefringent lens is focused either at a distance corresponding to the ordinary refractive index or the extraordinary refractive index. Virtual image light leaving the birefringent lens is in-coupled to a see-through reflective waveguide which is configured to form an exit pupil for the optical combiner to enable an HMD device user to view the virtual images from the source.

First claim

What is claimed:

1. A method for operating an electronic device that includes a mixed-reality see-through optical display system configured for showing mixed-reality scenes comprising virtual images of virtual-world objects that are rendered over views of real-world objects to a user of the electronic device, the method comprising:
receiving light for the virtual images, the light being linearly polarized in a first polarization state;
operating a ferroelectric liquid crystal (FLC) modulator to switch between the first polarization state for the virtual image light and a second polarization state that is orthogonal to the first polarization state;
providing a lens of birefringent material upon which virtual image light is incident in either the first polarization state or second polarization state, in which the lens provides one of two different focal distances for the virtual images depending on polarization state of the incident virtual image light;
in-coupling the virtual image light from the lens into the mixed-reality see-through optical display system which renders the virtual images at the one of two different focal distances to the user;
stacking combinations of FLC modulators and lenses of birefringent material that act on the received virtual image light in series, in which each combination in a stack of FLC modulators and lenses of birefringent material provides two unique focal distances for the rendered virtual images; and
operating an FLC modulator at a rate that is synchronized to a refresh rate of the received virtual image light to provide a temporally multiplexed virtual image display comprising one or more virtual images located at either one or the other different focal distances or located at both of the different focal distances simultaneously,
wherein the stack of combinations of FLC modulators and lenses of birefringent material are located on the electronic device outside the user's line of sight.

2. The method of claim 1 further comprising operating the FLC modulator according to a composition of a mixed-reality scene, in which the composed mixed-reality scene includes virtual-world objects that are located at different focal distances.

3. A head-mounted display (HMD) device wearable by a user and configured for supporting a mixed-reality experience including viewing, by the user, of virtual images that are combined with views of real-world objects in a physical world, comprising:
a focal-distance modulation system that is operable to receive virtual images from a virtual image source, the focal-distance modulation system comprising first and second polarization modulators and first and second birefringent lenses, wherein the virtual images propagate in series through a stack comprising the first polarization modulator, the first birefringent lens, the second polarization modulator, and the second birefringent lens, wherein each polarization modulator is configured to selectively switch polarization of the virtual images between two orthogonal states, and wherein each birefringent lens has two different refractive indices each with sensitivity to a different orthogonal state of polarization of virtual images, wherein virtual images are focused by the first and second birefringent lenses at different focal distances in response to polarization state of the virtual images; and
an optical combiner with which the user can see the real-world objects and the virtual images rendered in a mixed-reality scene, the optical combiner including an input coupler configured to in-couple virtual images from the focal-distance modulation system that are focused at either the first or second focal distance into the optical combiner and further including an output coupler configured to out-couple the virtual images that are focused at different focal distances from the optical combiner to one or more of the user's eyes;
wherein the stack of first and second polarization modulators and first and second birefringent lenses are operable in the focal-distance modulation system to provide four unique focal distances for the rendered virtual images, and
wherein the stack of first and second polarization modulators and first and second birefringent lenses are located on the HMD device outside the user's line of sight.

4. The HMD device of claim 3 further comprising a linear polarizing filter that is arranged to linearly polarize light from the virtual image source.

5. The HMD device of claim 3 further comprising an eye tracker for tracking vergence of the user's eyes or tracking a gaze direction of at least one eye of the user to perform one of calibration of alignment between the user's eye and the optical combiner, dynamic determination of whether alignment changes during use of the HMD device, or composition of a mixed-reality scene at the virtual image source.

6. The HMD device of claim 5 in which the composition of the mixed-reality scene comprises rendering virtual images in a single focal plane that is selected based on operation of the eye tracker to determine a gaze point of the user.

7. The HMD device of claim 6 further comprising a focal plane controller operatively coupled to the polarization modulator and configured to selectively switch the polarization state of the virtual images at a rate that is synchronized with a refresh rate of the virtual image source to generate virtual images at different focal distances in the mixed-reality scene supported by the optical combiner.

8. The HMD device of claim 7 in which the focal plane controller is further operatively coupled to the virtual image source and configured to selectively switch the polarization state of the virtual images based on a composition of a mixed-reality scene generated at the virtual image source.

9. The HMD device of claim 3 in which the focal-distance modulation system further comprises at least an additional polarization modulator and an additional birefringent lens wherein a total of N polarization modulator/birefringent lens pairs are utilized to provide 2 N different focal distances.

10. The HMD device of claim 3 in which the optical combiner comprises a waveguide that is at least partially transparent, the waveguide configured for guiding focused virtual images from the input coupler to the output coupler.

11. The HMD device of claim 10 in which one or more of the input coupler, output coupler, or waveguide include one or more reflective surfaces.

12. The HMD device of claim 3 in which the optical combiner is configured to provide an exit pupil that is expanded in one or more directions relative to an input pupil to the optical combiner.

13. The HMD device of claim 3 in which the polarization modulator comprises one of ferroelectric liquid crystal (FLC) modulator, photo-elastic modulator, electro-optic modulator, magneto-optic modulator, or piezoelectric modulator.

14. A mixed-reality optical display system providing a plurality of different focal lengths for planes into which images of virtual-world objects are displayable, comprising:
a source configured to generate light for virtual-world images, the virtual-world image light propagating on a light path from the source to an eye of a user of the mixed-reality display system;
first and second ferroelectric liquid crystal (FLC) modulators disposed along the light path, each of which is operatively coupled to the source to receive virtual-world image light, and each of which is switchable between first and second switched states;
a linear polarizer disposed along the light path between the source and the first FLC modulator and configured to impart a linearly polarized state to the virtual-worl

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Held Robert Thomas
• Kress Bernard Charles
• Saulsbury Ashley
• Reshidko Dmitry

Classifications

• G02B27/0172 Primary

  characterised by optical features · CPC title

• G02B27/0179

  Display position adjusting means not related to the information to be displayed · CPC title

• G02B27/288

  Filters employing polarising elements, e.g. Lyot or Solc filters (G02B5/3016 takes precedence) · CPC title

• G02F1/294

  Variable focal length devices · CPC title

• G09G3/001

  using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background (slide projectors per se G03B23/00 = 42 HP) · CPC title