Reverse pass-through glasses for augmented reality and virtual reality devices

Patent metadata

Field	Value
Publication number	US-11736679-B2
Application number	US-202117396449-A
Country	US
Kind code	B2
Filing date	Aug 6, 2021
Priority date	Jan 27, 2021
Publication date	Aug 22, 2023
Grant date	Aug 22, 2023

Abstract

A device for providing a reverse pass-through view of a user of a headset display to an onlooker includes an eyepiece comprising an optical surface configured to provide an image to a user on a first side of the optical surface. The device also includes a first camera configured to collect an image of a portion of a face of the user reflected from the optical surface in a first field of view, a display adjacent to the optical surface and configured to project forward an image of the face of the user, and a screen configured to receive light from the display and provide the image of the face of the user to an onlooker.

First claim

What is claimed is:

1. A device, comprising:
a near-eye display configured to provide an image to a user;
an eye imaging system configured to collect an image of a face of the user; and
a light field display configured to provide an autostereoscopic image of a three-dimensional reconstruction of the face of the user to an onlooker, wherein the autostereoscopic image is configured to depict a perspective-corrected view of the face of the user from multiple viewpoints within a field of view of the light field display.

2. The device of claim 1 , wherein the light field display comprises a pixel array and a multi-lenslet array, wherein the pixel array is configured to provide a segmented view of the face of the user to the multi-lenslet array, the segmented view including multiple portions of the field of view of the light field display at a selected viewpoint.

3. The device of claim 1 , wherein the eye imaging system comprises two cameras to collect a binocular view of the face of the user; and wherein the near-eye display provides the user a three-dimensional representation of an environment, including the onlooker.

4. The device of claim 1 , further comprising one or more processors and a memory storing instructions which, when executed by the one or more processors, generate a three-dimensional representation of the face of the user from the image of the face of the user.

5. The device of claim 1 , wherein the eye imaging system includes an infrared camera that receives the image from the user in a reflective mode from a dichroic mirror adjacent to the light field display.

6. The device of claim 1 , wherein light field display comprises a micro lens array having multiple micro lenses arranged in a two-dimensional pattern having a pre-selected pitch to avoid cross-talk between the perspective-corrected view for two viewpoints, for the onlooker, and wherein the light field display further comprises an immersed stop adjacent to the micro lens array, the immersed stop including multiple apertures such that each aperture is aligned with a center of each micro lens in the micro lens array.

7. The device of claim 1 , wherein the light field display includes a pixel array split in multiple active segments, wherein each active segment in the pixel array has a dimension corresponding to a diameter of a refractive element in a multi-lenslet array.

8. The device of claim 1 , further comprising one or more processors and a memory storing instructions which, when executed by the one or more processors, cause the light field display to split a pixel array into multiple active segments, each active segment configured to provide a portion of the field of view of the light field display at a selected viewpoint for the onlooker.

Assignees

• Meta Platforms Tech Llc

Inventors

• Matsuda Nathan
• Wheelwright Brian
• Hegland Joel

Classifications

• H04N13/322 Primary

  using varifocal lenses or mirrors · CPC title

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• H04N13/344 Primary

  with head-mounted left-right displays · CPC title

• H04N13/366

  using viewer tracking · CPC title