Head-wearable device disparity sensing and disparity correction, and systems and methods of use thereof

Patent metadata

Field	Value
Publication number	US-2025199314-A1
Application number	US-202418972711-A
Country	US
Kind code	A1
Filing date	Dec 6, 2024
Priority date	Dec 19, 2023
Publication date	Jun 19, 2025
Grant date	—

Abstract

Systems and methods of calibrating a head-wearable device are disclosed. An example method includes, while a position of an artificial-reality glasses relative to a storage device satisfies position criteria, causing the artificial-reality glasses to display calibration patterns using a lens assemblies of the artificial-reality glasses, and capturing, using an imaging device communicatively coupled to the storage device and associated with the lens assemblies, calibration images of the calibration patterns displayed using the lens assemblies of the artificial-reality glasses. The method further includes, in accordance with a determination, based on the calibration images, that an amount of disparity between the respective calibration patterns displayed using the lens assemblies satisfies calibration criteria, causing the artificial-reality glasses to apply, based on the amount of disparity, a disparity correction to one or more of the lens assemblies.

First claim

What is claimed is:

1 . A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by artificial-reality glasses that are in communication with a storage device for the artificial-reality glasses, cause the artificial-reality glasses to:
while a position of the artificial-reality glasses relative to the storage device satisfies relative position criteria:
cause the artificial-reality glasses to display one or more calibration patterns using a first lens assembly and a second lens assembly of the artificial-reality glasses, and
capture, using one or more imaging devices communicatively coupled to the storage device and associated with the first lens assembly and the second lens assembly, one or more calibration images of the one or more calibration patterns displayed using the first lens assembly and the second lens assembly of the artificial-reality glasses;
in accordance with a determination, based on the one or more calibration images, that an amount of disparity between the respective calibration patterns displayed using the first lens assembly and the second lens assembly satisfies calibration criteria:
cause the artificial-reality glasses to apply, based on the amount of disparity, a disparity correction to one or both of the first lens assembly and the second lens assembly.

2 . The non-transitory computer readable storage medium of claim 1 , wherein:
the amount of disparity is determined based on a pixel-level difference between a first calibration image of the one or more calibration images and a second calibration image of the one or more calibration images, wherein the first calibration image is associated with the first lens assembly and the second calibration is associated with the second lens assembly; and the instructions that, when executed by the artificial-reality glasses, also cause the artificial-reality glasses to determine based on the pixel-level difference between the first calibration image and the second calibration image, the disparity correction, wherein the disparity correction reduces the pixel-level difference between the first calibration image and the second calibration image.

3 . The non-transitory computer readable storage medium of claim 1 , wherein the causing the artificial-reality glasses to apply, based on the amount of disparity, the disparity correction to one or both of the first lens assembly and the second lens assembly includes:
causing the artificial-reality glasses to apply the disparity correction to one or more images prior to displaying the one or more images using the first lens assembly and the second lens assembly.

4 . The non-transitory computer readable storage medium of claim 1 , wherein:
the artificial-reality glasses displays the one or more calibration patterns using a first projector assembly associated with the first lens assembly and a second project assembly associated with the second lens assembly; and the causing the artificial-reality glasses to apply, based on the amount of disparity, the disparity correction to one or both of the first lens assembly and the second lens assembly includes:
causing the artificial-reality glasses to modify a first image projection from the first projector assembly associated with the first lens assembly and/or a second image projection from the second project assembly associated with the second lens assembly to reduce the amount of disparity.

5 . The non-transitory computer readable storage medium of claim 1 , wherein the amount of disparity is a first amount of disparity, the disparity correction is a first disparity correction, and the instructions that, when executed by the artificial-reality glasses, also cause the artificial-reality glasses to:
in accordance with a determination that the artificial-reality glasses is being donned: cause the artificial-reality glasses to capture deformation data regarding deformation of a frame of the artificial-reality glasses, wherein the deformation data includes at least deformation data before the artificial-reality glasses are donned and deformation data while the artificial-reality glasses are donned; and in accordance with a determination, based on the deformation data, that a second amount of disparity while the artificial-reality glasses are donned satisfies the calibration criteria: cause the artificial-reality glasses to apply, based on the second amount of disparity, a second disparity correction to one or both of the first lens assembly and the second lens assembly, wherein the second disparity correction is based on a difference between the deformation data before the artificial-reality glasses are donned and the deformation data while the artificial-reality glasses are donned such that the difference is reduced.

6 . The non-transitory computer readable storage medium of claim 5 , wherein:
the deformation data regarding the deformation of the frame of the artificial-reality glasses includes one or more images captured by the one or more imaging devices coupled to the frame of the artificial-reality glasses; and the second amount of disparity is based on a difference between at least a first image of the one or more images before the artificial-reality glasses are donned and at least a second image of the one or more images while the artificial-reality glasses are donned.

7 . The non-transitory computer readable storage medium of claim 5 , wherein:
the data regarding the deformation of the frame of the artificial-reality glasses is captured by one or more force sensors coupled to the frame of the artificial-reality glasses, wherein the one or more force sensors are configured to detect deformation of the frame of the artificial-reality glasses; and the amount of disparity is based on a change in measurements from the one or more force sensors before the artificial-reality glasses are donned and while the artificial-reality glasses are donned.

8 . The non-transitory computer readable storage medium of claim 1 , wherein:
a first imaging device of the one or more imaging devices is configured to capture the one or more calibration patterns displayed using the first lens assembly, wherein the first imaging device is positioned at a first region associated with the first lens assembly; a second imaging device of the one or more imaging devices is configured to capture the one or more calibration patterns displayed using the second lens assembly, wherein the second imaging device is positioned at a second region associated with the second lens assembly; and wherein:
the first region and the second region are a predefined distance apart, including a distance within an interpupillary distance range associated with the artificial-reality glasses; and
the first region and the second region are located proximate to a focal point associated with the first lens assembly and the second lens assembly, respectively.

9 . The non-transitory computer readable storage medium of claim 8 , wherein the first imaging device and the second imaging device are further positioned at a backplane associated with the storage device.

10 . The non-transitory computer readable storage medium of claim 1 , wherein:
the storage device includes: a first optical element configured to redirect the one or more calibration patterns displayed using the first lens assembly towards an imaging device of the one or more imaging devices, and a second optical element configured to redirect the one or more calibration patterns displayed using the second lens assembly towards the imaging device; and the imaging device is configured to capture the one or more calibration patterns

Assignees

• Meta Platforms Tech Llc

Inventors

• Khan Saara
• Markovsky Igor
• Rahmani Helia
• Callens Michiel Koen
• David Tony
• Mcclure Stephen

Classifications

• G02B2027/014

  comprising information/image processing systems · CPC title

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G02B2027/0134

  of stereoscopic type · CPC title

• G02B2027/0178

  Eyeglass type (eyeglass details G02C) · CPC title

• G02B2027/011

  comprising device for correcting geometrical aberrations, distortion · CPC title