Autofocus virtual reality headset

Patent metadata

Field	Value
Publication number	US-10445860-B2
Application number	US-201514963127-A
Country	US
Kind code	B2
Filing date	Dec 8, 2015
Priority date	Dec 8, 2015
Publication date	Oct 15, 2019
Grant date	Oct 15, 2019

Abstract

A scene presented by a headset is adjusted to correct for distortion from optical errors of an optics block in the headset. To correct for the distortion, the scene is pre-distorted when presented based on previously modeled distortion of the optics block, so distortion from the optics block corrects the pre-distortion. To model the distortion, the headset displays calibration image including features and images of the calibration image are captured from multiple positions. Differences between locations of features in the calibration images and locations of corresponding features in captured images of the calibration image are identified and a distortion correction is determined based on the differences.

First claim

What is claimed is:

1. A method comprising:
instructing a head mounted display (HMD) to display a calibration image on a display of the HMD, the HMD including an optics block configured to focus light from the display to an exit pupil of the HMD;
capturing images of the displayed calibration image via a camera at the exit pupil from a plurality of positions;
determining, for each image, differences between expected locations of features of the calibration image and locations of the corresponding features in the image of the displayed calibration image captured via the camera;
generating a distortion correction map for at least a set of the plurality of positions, the distortion correction map correcting distortion caused by one or more optical errors inherent to the optics block; and
providing the generated distortion correction maps corresponding to the plurality of positions to a rendering system of the HMD, each distortion correction map modifying information displayed on the display to compensate for the distortion caused by the optics block.

2. The method of claim 1 , wherein capturing images of the displayed calibration image via the camera at the exit pupil from the plurality of positions of the camera relative to the exit pupil comprises:
moving a robotic arm coupled to the camera to position the camera in different positions at the exit pupil.

3. The method of claim 1 , further comprising:
instructing an eye tracking system of the HMD to determine a current position of each eye of a user relative to the exit pupil;
instructing the rendering system of the HMD to select a distortion correction map for the current position of each eye relative to the exit pupil from the provided distortion correction maps;
instructing the rendering system of the HMD to apply the selected distortion correction map for the current position of each eye relative to the exit pupil to image data; and
instructing the display to display the image data for focusing to the exit pupil by the optics block after application of the selected distortion correction map.

4. The method of claim 3 , further comprising:
instructing the eye tracking system of the HMD to track each eye of the user to an updated position;
instructing the rendering system of the HMD to select an alternative distortion correction map for the updated position of each eye of the user relative to the exit pupil from the provided distortion correction maps;
instructing the rendering system of the HMD to apply the alternative distortion correction map for the updated position of each eye relative to the exit pupil to image data; and
instructing the display to display the image data for focusing to the exit pupil by the optics block after application of the alternative distortion correction map.

5. The method of claim 1 , wherein generating the distortion correction map for at least the set of the plurality of positions relative to the exit pupil comprises:
determining distortion correction maps for positions between positions in the set of the plurality of positions by interpolating distortion correction maps for multiple positions in the set of the plurality of positions.

6. The method of claim 1 , wherein the distortion correction map based on the determined differences between expected locations of objects in the calibration image and locations of the corresponding objects in one or more images captured via the camera at the position relative to the exit pupil is based at least in part on a wavefront from the optics block at the position relative to the exit pupil.

7. The method of claim 1 , wherein the camera is a camera having a field of view capable of including the displayed calibration image its entirety from each of the plurality of positions relative to the exit pupil, and wherein the plurality of positions relative to the exit pupil include a plurality of different distances from the exit pupil and a plurality of different viewing angles relative to the exit pupil.

8. A method comprising:
capturing images of a calibration image displayed on a display from a plurality of positions at an exit pupil, light of the calibration image being directed from the display through an optics block configured to provide a plurality of focal lengths to the exit pupil;
determining, for each image, one or more differences between expected locations of features of the calibration image and locations of the corresponding features of in the image of the displayed calibration image captured via the camera at the exit pupil; and
generating a distortion correction map for at least a set of focal lengths of the optics block, the distortion correction map for a focal length of the optics block
(1) being generated based on the determined differences between expected locations of features of the calibration image and locations of the corresponding features of in one or more images captured via the camera at the exit pupil from one or more positions relative to the exit pupil for the focal length of the optics block, and
(2) correcting distortion created by the optics block at the focal length.

9. The method of claim 8 , further comprising:
providing distortion correction maps for one or more of the set of focal lengths of the optics block to a rendering system, each distortion correction map modifying information displayed on the display to compensate for the distortion based at least in part on the focal length of the optics block.

10. The method of claim 9 , further comprising:
instructing the rendering system to determine a current focal length of the optics block;
instructing the rendering system to select a distortion correction map for the current focal length of the optics block from the provided distortion correction maps;
instructing the rendering system to apply the selected distortion correction map for the current focal length to image data; and
instructing the display to display the image data for focusing to the exit pupil by the optics block after application of the selected distortion correction map.

11. The method of claim 10 , further comprising:
instructing a varifocal system to adjust the current focal length of the optics block;
instructing the rendering system to select an alternative distortion correction map for the adjusted current focal length of the optics block from the provided distortion correction maps;
instructing the rendering system to apply the alternative distortion correction map for the adjusted current focal length to image data; and
instructing the display to display the image data for focusing to the exit pupil by the optics block after application of the alternative distortion correction map.

12. The method of claim 9 , wherein capturing images of the calibration image displayed on the display from a plurality of positions relative to the exit pupil comprises:
moving a robotic arm coupled to the camera to position the camera in different positions relative to the exit pupil.

13. The method of claim 8 , wherein the display and optics block are included in a virtual reality (VR) HMD.

14. The method of claim 8 , wherein the plurality of positions include a plurality of different distances from the exit pupil and a plurality of different viewing angles relative to the exit pupil corresponding to potential eye positions.

15. A system comprising:
a virtual reality (VR) headset configured to display a calibration image on a display, the VR headset including an optics block configured to focus light from the display to an exit pupil and to provide a plurality of focal lengths;
a camera configured to capture images of

Assignees

• Facebook Tech Llc

Inventors

• Fix Alexander Jobe
• Lanman Douglas Robert
• Geng Ying

Classifications

• G09G5/00

  Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T) · CPC title

• G09G2320/0693

  Calibration of display systems · CPC title

• G06K9/00604

  Physics · mapped topic

• G06T5/00 Primary

  Image enhancement or restoration · CPC title

• G06V40/19 Primary

  Sensors therefor · CPC title