Automatic detection and correction of binocular misalignment in a display device

Patent metadata

Field	Value
Publication number	US-10425636-B2
Application number	US-201615284424-A
Country	US
Kind code	B2
Filing date	Oct 3, 2016
Priority date	Oct 3, 2016
Publication date	Sep 24, 2019
Grant date	Sep 24, 2019

Abstract

A near-to-eye display (NED) device comprises a light sensor, a processor, a first imager to generate a left image of an object for the user's left optical sensor, and a second imager to generate a right image of the object for the user's right optical sensor. The device further comprises at least one light-transmissive optical component arranged to receive concurrently the left image and the right image, the at least one light-transmissive optical component further arranged to direct a first portion of each of the left and right images to the left and right optical sensors, respectively, of the user while directing a second portion of each of the left and right images to the light sensor. The at least one processor detects a binocular misalignment between the left and right images based on output of the light sensor and to control the imagers to correct for the misalignment.

First claim

What is claimed is:

1. A near-to-eye display (NED) device, comprising:
one or more imagers to generate light representing a left image of an object and light representing a right image of the object;
at least one light-transmissive optical component arranged to:
receive the light representing the left image and the light representing the right image,
direct a first portion of the light representing the left image and a first portion of the light representing the right image along respective first optical paths for displaying the left image and the right image to a user of the NED device, and
direct a second portion of the light representing the left image and a second portion of the light representing the right image along respective second optical paths,
wherein the first portion of the light representing the left image is a greater portion of light than the second portion of the light representing the left image, and the first portion of the light representing the right image is a greater portion of light than the second portion of the light representing the right image;

a light sensor configured to:
receive the second portion of the light representing the left image and the second portion of the light representing the right image from the respective second optical paths,
detect a binocular misalignment between the second portion of the light representing the left image and the second portion of the light representing the right image, and
generate an output based on the binocular misalignment; and

at least one processor configured to receive the output from the light sensor, and to control the one or more imagers to align the left image to the right image based on the binocular misalignment.

2. The NED device of claim 1 , wherein the at least one processor is configured to align the left image to the right image without requiring any input from the user.

3. The NED device of claim 1 , wherein the at least one light-transmissive optical component comprises two light-transmissive optical components, one for each of a left optical sensor and a right optical sensor of the user.

4. The NED device of claim 1 , wherein the at least one light-transmissive optical component is partially light-reflective.

5. The NED device of claim 1 , wherein the NED device is arranged to provide the user with an augmented reality (AR) display.

6. The NED device of claim 1 , wherein the at least one light-transmissive optical component is further arranged to provide the user with a real-world view of an environment of the user through the at least one light-transmissive optical component while the left image and the right image are overlaid on the real-world view of the environment of the user.

7. The NED device of claim 1 , wherein a first portion of the at least one light-transmissive optical component has a birdbath shape, the first portion of the at least one light-transmissive optical component being arranged to direct at least one of the first portion of the light representing the left image or the first portion of the light representing the right image along respective first optical paths.

8. The NED device of claim 7 , wherein a second portion of the at least one light-transmissive optical component has a second shape different from the birdbath shape, to direct at least one of the second portion of the light representing the left image or a second portion of the light representing the right image along respective second optical paths.

9. The NED device of claim 1 , further comprising a prism coupled optically between the at least one light-transmissive optical component and the light sensor and arranged to convey at least one of the second portion of the light representing the left image or the second portion of the light representing the right image to the light sensor.

10. The NED device of claim 1 , further comprising a second light-transmissive component coupled optically between the at least one light-transmissive optical component and the light sensor, the second light-transmissive component being adjustable for an interpupillary distance of the user.

11. The NED device of claim 1 , further comprising a second light-transmissive component coupled optically between the at least one light-transmissive optical component and the light sensor and arranged to convey at least one of the second portion of the light representing the left image or the second portion of the light representing the right image to the light sensor, the second light-transmissive component including a plurality of optical segments that are movably coupled to each other.

12. The NED device of claim 11 , wherein the plurality of optical segments are movable relative to each other to allow adjustment for an interpupillary distance of the user.

13. The NED device of claim 1 , further comprising a second light-transmissive component coupled optically between the at least one light-transmissive optical component and the light sensor and arranged to convey at least one of the second portion of the light representing the left image or the second portion of the light representing the right image to the light sensor, the second light-transmissive component including a plurality of optical segments connected by a pivot and rotatable with respect to each other about the pivot to allow adjustment for an interpupillary distance of the user.

14. The NED device of claim 1 , wherein the light sensor is configured to detect the binocular misalignment by comparing the second portion of the light representing the left image and the second portion of the light representing the right image.

15. The NED device of claim 1 , wherein the at least one processor is further configured to control the one or more imagers to move one or both of the light representing left image and the light representing the right image to align the left image and the right image.

16. A method comprising:
generating light representing a left image of an object for a left optical sensor of a user of a near-to-eye display (NED) device and light representing a right image of the object for a right optical sensor of the user of the NED device;
directing a first portion of the light representing the left image and a first portion of the light representing the right image along a first optical path to the left optical sensor and the right optical sensor, respectively, of the user, and a second portion of the light representing the left image and a second portion of the light representing the right image along a second optical path different from the first optical path, wherein the first portion of the light representing the left image is a greater portion of light than the second portion of the light representing the left image, and the first portion of the light representing the right image is a greater portion of light than the second portion of the light representing the right image;
detecting a binocular misalignment between the second portion of the light representing the left image and the second portion of the light representing the right image; and
controlling one or more imagers to align the left image to the right image based on the binocular misalignment.

17. The method claim 16 , further comprising:
providing the user with a real-world view of an environment of the user while overlaying the left and right images on the real-world view.

18. The method of claim 16 , further comprising:
detecting the binocular misalignment by comparing the second portion of the light representing the left image and the second portion of the light repr

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Bohn David D

Classifications

• G02B2027/0181

  Adaptation to the pilot/driver · CPC title

• G02B27/017

  Head mounted · CPC title

• G02B27/0179

  Display position adjusting means not related to the information to be displayed · CPC title

• G02B2027/0187

  slaved to motion of at least a part of the body of the user, e.g. head, eye · CPC title

• H04N13/327 Primary

  Calibration thereof · CPC title