Autocalibrated near-eye display

Patent metadata

Field	Value
Publication number	US-11716456-B2
Application number	US-202117326965-A
Country	US
Kind code	B2
Filing date	May 21, 2021
Priority date	May 21, 2021
Publication date	Aug 1, 2023
Grant date	Aug 1, 2023

Abstract

A near-eye display device comprises right and left display projectors, expansion optics, and inertial measurement units (IMUs), in addition to a plurality of angle-sensitive pixel (ASP) elements and a computer. The right and left expansion optics are configured to receive respective display images from the right and left display projectors and to release expanded forms of the display images. The right IMU is fixedly coupled to the right display projector, and the left IMU is fixedly coupled to the left display projector. Each ASP element is responsive to an angle of light of one of the respective display images as received into the right or left expansion optic. The computer is configured to receive output from the right IMU, the left IMU and the plurality of ASP elements, and render display data for the right and left display projectors based in part on the output.

First claim

The invention claimed is:

1. A near-eye display device comprising:
a right display projector and a left display projector;
a right expansion optic configured to receive a right display image from the right display projector and to release an expanded form of the right display image;
a left expansion optic configured to receive a left display image from the left display projector and to release an expanded form of the left display image;
a right inertial measurement unit (IMU) fixedly coupled to the right display projector, and a left IMU fixedly coupled to the left display projector;
a plurality of angle-sensitive pixel (ASP element) elements each responsive to an angle of light of a display image received into the right or left expansion optic; and
a computer configured to:
receive output from each of the right IMU, the left IMU and the plurality of ASP elements, and
render display data for the right and left display projectors based in part on the output from each of the right IMU, the left IMU and the plurality of ASP elements, thereby providing predefined stereo disparity between the expanded forms of the right and left display images.

2. The near-eye display device of claim 1 wherein each of the right and left display projectors comprises a spatial light modulator, a scanning-laser projector, or a micro light-emitting-diode (μLED) projector.

3. The near-eye display device of claim 1 wherein each of the right and left expansion optics includes an optical waveguide supporting total internal reflection of display light received therein.

4. The near-eye display device of claim 3 wherein each of the right and left expansion optics includes a first optical element configured to couple light of a display image into the optical waveguide, and a second optical element configured to couple light of an expanded form of the display image out of the optical waveguide.

5. The near-eye display device of claim 1 wherein both of the right and left expansion optics are configured to expand a display image in two orthogonal directions, thereby overfilling an anatomical eyebox of a wearer of the display device.

6. The near-eye display device of claim 1 wherein each of the right and left IMUs includes an electronic gyroscope responsive to a rotation.

7. The near-eye display device of claim 1 wherein each ASP element includes a photodiode and one or more diffraction gratings arranged in front of the photodiode.

8. The near-eye display device of claim 1 wherein the plurality of ASP elements comprises: a right ASP element arranged optically downstream of a right locus where the right display image is received into the right expansion optic; and a left ASP element arranged optically downstream of a left locus where the left display image is received into the left expansion optic.

9. The near-eye display device of claim 8 wherein the right ASP element is fixedly coupled to the right expansion optic, and the left ASP element is fixedly coupled to the left expansion optic.

10. The near-eye display device of claim 8 wherein the right ASP element is arranged behind an in-coupling structure of the right expansion optic to receive light of the right display image that passes uncoupled through the in-coupling structure.

11. The near-eye display device of claim 1 wherein the right or left display image comprises a calibration image.

12. The near-eye display device of claim 11 wherein the calibration image is a peripheral portion of a display image further including non-calibration display content.

13. The near-eye display device of claim 11 further comprising an ocular sensor responsive to nictitation of a wearer of the display device, and wherein the calibration image is projected pursuant to the nictitation.

14. The near-eye display device of claim 11 further comprising an ocular sensor responsive to gaze direction of a wearer of the display device, and wherein the calibration image is projected based on the gaze direction.

15. The near-eye display device of claim 11 wherein the calibration image is an infrared image, and wherein each of the ASP elements is an infrared-responsive pixel element.

16. The near-eye display device of claim 1 wherein providing the predefined stereo disparity includes quelling vertical disparity between the expanded forms of the right and left display images.

17. A near-eye display device comprising:
a right display projector and a left display projector;
a right expansion optic configured to receive a right display image from the right display projector and to release an expanded form of the right display image;
a left expansion optic configured to receive a left display image from the left display projector and to release an expanded form of the left display image;
a right inertial measurement unit (IMU) fixedly coupled to the right display projector, and a left IMU fixedly coupled to the left display projector;
a right angle-sensitive pixel (ASP element) element fixedly coupled to the right expansion optic and configured to sense an angle of light of the right display image received into the right expansion optic;
a left ASP element fixedly coupled to the left expansion optic and configured to sense an angle of light of the left display image received into the left expansion optic;
a computer configured to:
receive output from each of the right IMU, the left IMU, the right ASP element, and the left ASP element, and
render display data for the right and left display projectors based in part on the output from each of the right IMU, the left IMU, the right ASP element, and the left ASP element, thereby providing predefined stereo disparity between the expanded forms of the right and left display images.

18. The near-eye display device of claim 17 wherein the right ASP element is one of a right set of ASP elements arranged optically downstream of a right locus where the right display image is received into the right expansion optic.

19. The near-eye display device of claim 18 wherein the right set of ASP elements are arranged behind an in-coupling structure of the right expansion optic to receive light of the right display image that passes uncoupled through the in-coupling structure.

20. A near-eye display device comprising:
a right display projector and a left display projector;
a right expansion optic configured to receive a right display image from the right display projector and to release an expanded form of the right display image;
a left expansion optic configured to receive a left display image from the left display projector and to release an expanded form of the left display image, wherein the right or left display image includes a calibration image;
a right inertial measurement unit (IMU) fixedly coupled to the right display projector, and a left IMU fixedly coupled to the left display projector;
a plurality of angle-sensitive pixel (ASP element) elements each responsive to an angle of light of the calibration image received into the right expansion optic or into the left expansion optic; and
a computer configured to:
receive output from each of the right IMU, the left IMU, and the plurality of ASP elements, and
render display data for the right and left display projectors based in part on the output from each of the right IMU, the left IMU and the plurality of ASP elements, to quell vertical disparity between the expanded forms of the right and left display images.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Samples Michael Edward
• Reshidko Dmitry
• Demaster-Smith Rayna

Classifications

• H04N13/327 Primary

  Calibration thereof · CPC title

• H04N9/3164

  using multiple light sources · CPC title

• H04N9/3194

  including sensor feedback · CPC title

• H04N13/344 Primary

  with head-mounted left-right displays · CPC title

• H04N13/363

  using image projection screens (volumetric display H04N13/388) · CPC title