Binocular image alignment for near-eye display

Patent metadata

Field	Value
Publication number	US-10178378-B2
Application number	US-201615097199-A
Country	US
Kind code	B2
Filing date	Apr 12, 2016
Priority date	Apr 12, 2016
Publication date	Jan 8, 2019
Grant date	Jan 8, 2019

Abstract

A near-eye display device comprises a left-eye optical system and a right-eye optical system. Each of the left-eye optical system and the right-eye optical system comprises a holographic optical component positioned in a field of view of a user eye, an image source configured to emit imaging light, and an alignment optical component, wherein projection beam path between the image source and the light-deflecting optical component and an alignment beam path between the alignment optical component and the light-deflecting component share a common optical path.

First claim

The invention claimed is:

1. A near-eye display device, comprising:
a left-eye optical system and a right-eye optical system, each of the left-eye optical system and the right-eye optical system comprising:
a light-deflecting optical component positioned to be in a field of view of a user eye;
an image source configured to emit imaging light for deflection by the light-deflecting optical component toward the user eye;
a camera configured to acquire an alignment image based on alignment light deflected by the light-deflecting optical component,
wherein a projection beam path of the imaging light between the image source and the light-deflecting optical component and an alignment beam path of the alignment light between the camera and the light-deflecting optical component share a common optical path; and

a computing system configured to calibrate the image source of the left-eye optical system and the image source of the right-eye optical system to align a left-eye image produced from the imaging light emitted by the image source of left-eye optical system with a right-eye image produced from imaging light emitted by the image source of the right-eye optical system based on the alignment image acquired by the camera of the left-eye optical system and the alignment image acquired by the camera of the right-eye optical system.

2. The near-eye display device of claim 1 , wherein each of the left-eye optical system and the right-eye optical system further comprises:
a beam splitter configured to split the common optical path into 1) the alignment beam path extending between the beam splitter and the camera and 2) the projection beam path extending between the beam splitter and the image source.

3. The near-eye display device of claim 1 , wherein the camera is a visible-light camera, and wherein the alignment image is a visible-light image.

4. The near-eye display device of claim 1 , further comprising an infrared projector configured to emit infrared light, wherein the camera is a depth camera, wherein the infrared light is reflected to the depth camera via the alignment beam path, and wherein the alignment image is an infrared light image that includes reflected infrared light from the infrared projector.

5. The near-eye display device of claim 1 , further comprising an outward-facing camera configured to acquire an external alignment image of a physical space from light that does not travel through the left-eye optical system or the right-eye optical system, and wherein the computing system is configured to align the left-eye image and the right-eye image with one or more features in the external alignment image of the physical space based on a calibration of the alignment image acquired by the camera of the left-eye optical system, the alignment image acquired by the camera of the right-eye optical system, and the external alignment image.

6. The near-eye display device of claim 1 , wherein the light-deflecting optical component is configured to direct light from a portion of a physical space viewable through the field of view from a perspective of the user eye to the camera.

7. The near-eye display device of claim 1 , wherein each of the left-eye optical system and the right-eye optical system further comprises an infrared projector configured to emit infrared light via the alignment beam path, and wherein the camera is a depth camera configured to acquire infrared light emitted by the infrared projector of the left-eye optical system and infrared light emitted by the infrared projector of the right-eye optical system.

8. The near-eye display device of claim 7 , wherein the alignment beam path is configured to direct the infrared light towards a portion of a physical space viewable through the field of view from a perspective of the user eye, and wherein the depth camera is positioned to acquire infrared light reflected from the physical space.

9. The near-eye display device of claim 7 , wherein the alignment beam path is configured to direct the infrared light towards a user of the near-eye display device, and wherein the depth camera is positioned to acquire infrared light reflected from the user.

10. The near-eye display device of claim 7 , wherein the infrared projector of the left-eye optical system and the infrared projector of the right-eye optical system are configured to emit infrared light according to a time multiplexing scheme.

11. The near-eye display device of claim 1 , wherein the image source and camera are positioned side-by-side to form the common optical path shared by the alignment beam path and the projection beam path.

12. A near-eye display device, comprising:
a left-eye optical system and a right-eye optical system, each of the left-eye optical system and the right-eye optical system comprising:
a holographic optical component positioned to be in a field of view of a user eye;
an image source configured to emit imaging light for deflection by the holographic optical component toward the user eye;
a camera configured to acquire an alignment image based on alignment light deflected by the holographic optical component; and
a beam splitter configured to split a common optical path extending between the beam splitter and the holographic optical component into an alignment beam path for the alignment light extending between the beam splitter and the camera, and a projection beam path for the imaging light extending between the beam splitter and the image source; and

a computing system configured to calibrate the image source of the left-eye optical system and the image source of the right-eye optical system to align a left-eye image produced from the imaging light emitted by the image source of the left-eye optical system and a right-eye image produced from imaging light emitted by the image source of the right-eye optical system based on the alignment image acquired by the camera of the left-eye optical system and the alignment image acquired by the camera of the right-eye optical system.

13. The near-eye display device of claim 12 , wherein the camera is a visible-light camera, and wherein the alignment image is a visible-light image.

14. The near-eye display device of claim 12 , wherein the camera is a depth camera, wherein the near-eye display device further comprises an infrared projector configured to emit infrared light, wherein the infrared light is reflected to the depth camera via the alignment beam path, and wherein the alignment image is an infrared light image that includes reflected infrared light from the infrared projector.

15. The near-eye display device of claim 12 , further comprising an outward-facing camera configured to acquire an external alignment image of a physical space from light that does not travel through the left-eye optical system or the right-eye optical system, and wherein the computing system is configured to align the left-eye image and the right-eye image with one or more features in the external alignment image of the physical space based on a calibration of the alignment image acquired by the camera of the left-eye optical system, the alignment image acquired by the camera of the right-eye optical system, and the external alignment image.

16. The near-eye display device of claim 12 , wherein the holographic optical component is configured to direct light from a portion of a physical space viewable through the field of view from a perspective of the user eye to the camera.

17. The near-eye display device of claim 12 , wherein the holographic optical component is configured to direct light reflected from the user of the

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Travis Adrian

Classifications

• G03H1/0005

  Adaptation of holography to specific applications (holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042) · CPC title

• H04N13/128

  Adjusting depth or disparity · CPC title

• H04N13/344

  with head-mounted left-right displays · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title