Visual effect system including perspective-correct autostereoscopic retroreflective projection

Patent metadata

Field	Value
Publication number	US-2022283445-A1
Application number	US-202217827541-A
Country	US
Kind code	A1
Filing date	May 27, 2022
Priority date	Mar 31, 2020
Publication date	Sep 8, 2022
Grant date	—

Abstract

A system creating an autostereoscopic augmented reality (AR), virtual reality (VR), or other visual display experience involving 3D images, presented to a viewer without glasses or other head-gear. The system includes a projection screen, which includes a reflective surface formed using retroreflective material. The system includes a projection assembly and a beamsplitter, which is disposed between an outlet of the projection assembly and the projection screen. The system includes a physical scenic space facing a lower side of the beamsplitter and a viewing space facing an upper side of the beamsplitter. A controller operates the projector assembly to project left and right eye images toward the projection screen. The left and right eye images are then directed to left and right eye positions so a viewer with eyes positioned at the left and right eye positions perceives a virtual object concurrently with light from the physical scenic space.

First claim

We claim:

1 . A method for providing a three-dimensional (3D) image-based visual effect, comprising:
operating a projection assembly to project left eye images toward a reflective surface of a projection screen; operating the projection assembly to project right eye images toward the reflective surface of the projection screen; and concurrently with the operating of the projection assembly to project the left and right eye images, transmitting light from the projection assembly through a first side of a beamsplitter and receiving light from the projection screen on a second side of the beamsplitter, wherein the reflective surface comprises a retroreflector, wherein the beamsplitter is disposed between an outlet of the projection assembly and the reflective surface of the projection screen, and wherein the left and right eye images are viewable from a left eye position and a right eye position, respectively, within a viewing space adjacent and facing the second side of the beamsplitter, to allow a viewer with eyes positioned at the left and right eye positions to perceive a three-dimensional (3D) virtual object in a physical scenic space, opposite the second side of the beamsplitter, concurrently with light from physical objects or scenery in the physical scenic.

2 . The method of claim 1 , further comprising tracking the left and right eye positions and rendering the left and right eye images as stereo images of a 3D scene for viewpoints matching the tracked left and right eye positions.

3 . The method of claim 2 , wherein the left and right eye images are provided in a variable and expandable set of locations that collectively constitute a viewing volume.

4 . The method of claim 1 , wherein the projection assembly comprises a left eye projector and a right eye projector projecting the left and right eye images, respectively, and wherein the method further comprises moving the left and right eye projectors to modify positions of eyeboxes within a viewing volume to correspond with sensed ones of the right and left eye positions for the viewer.

5 . The method of claim 1 , wherein the projection assembly is configured to project the left and right eye images using Köhler illumination.

6 . The method of claim 1 , wherein the projection assembly further includes a shutter array and the method comprises operating the shutter array to switch between a left eye shutter and a right eye shutter to emit the left and right eye images, respectively, in a time multiplexed manner during tracking of the left and right eye positions to provide stereo imagery and wherein the left and right eye shutters vary with changes in the left and right eye positions.

7 . The method of claim 1 , wherein the projection assembly includes a light emitting diode (LED) array as a light source for the left and right eye images and wherein the method comprises operating the LED array to switch among individual LEDs of the LED array to emit the left and right eye images in a time multiplexed manner based on tracking of the left and right eye positions to alternate between providing a left eye viewpoint at the left eye position and a right eye viewpoint at the right eye position.

8 . The method of claim 7 , wherein the projection assembly includes a projection lens comprising a concave mirror, a beamsplitter disposed between the concave mirror and the LED array, and a quarter-wave film disposed between the concave mirror and the beamsplitter of the projection lens.

9 . The method of claim 7 , wherein a one-dimensional (1D) diffuser is disposed between the reflective surface and the beamsplitter.

10 . The method of claim 7 , wherein the projection assembly is adapted to use retroreflective autostereo projection including retroreflected illumination to provide the left and right eye images.

11 . The method of claim 10 , wherein the projection assembly further comprises:
a polarization selective beamsplitter disposed at a 45-degree angle between the LED array and the reflective surface of the projection screen; a transparent LCD with a backing film comprising a polarization-preserving retroreflector; a projection mirror, wherein the polarization selective beamsplitter is disposed between the transparent LCD and the projection mirror with the backing film on a side of the transparent LCD opposite the projection mirror; and a quarter-wave film or plate disposed between the projection mirror and the polarization selective beamsplitter.

12 . The method of claim 11 , wherein the retroreflector providing the reflective surface of the projection screen comprises a polarization-preserving retroreflective screen, wherein the beamsplitter comprises a polarization selective mirror, and further including a polarization wave plate disposed between the beamsplitter and reflective surface of the projection screen.

13 . The method of claim 10 , wherein the projection assembly further comprises:
a polarization selective beamsplitter with a first side at a 45-degree angle to the reflective surface of the projection screen and with the first side facing the LED array; a transparent LCD facing a second side of the polarization selective beamsplitter and having a backing film comprising a polarization-preserving retroreflector opposite the LED array; a projection mirror comprising a curved half-mirrored projection mirror with a concave side facing the transparent LCD and with a convex side facing the LED array; a quarter-wave film or plate disposed between the projection mirror and the polarization selective beamsplitter; and a circular polarizer disposed between the LED array and the convex side of the projection mirror.

14 . The method of claim 13 , wherein the retroreflector providing the reflective surface of the projection screen comprises a polarization-preserving retroreflective screen, wherein the beamsplitter comprises a polarization selective mirror, and further including a polarization wave plate disposed between the beamsplitter and reflective surface of the projection screen.

15 . The method of claim 1 , further comprising displaying a mask providing light occlusion in the physical space for the 3D virtual object.

16 . The method of claim 1 , wherein the projection screen, the beamsplitter, and the projection assembly are mounted upon a vehicle body or upon a display structure.

17 . The method of claim 1 , wherein the projection screen is mounted on a ceiling or surface defining the physical space and wherein the projection assembly is mounted adjacent the physical space to emit light onto the reflective surface of the projection screen.

18 . The method of claim 1 , further supporting the viewer in a vehicle, wherein the projection assembly is mounted on the vehicle or adjacent the physical space and wherein the projection screen and beamsplitter are positioned in or adjacent to the physical space.

19 . A method for providing 3D image-based visual effect, comprising:
tracking left and right eye positions proximate to a second side of a beamsplitter that is disposed between an outlet of a projection assembly and a reflective surface of a projection screen, wherein the beamsplitter is configured to transmit light from the projector through a first side and receive light from the projection screen on the second side and wherein the reflective surface comprises a retroreflector; and emitting, with the projector assembly, stereo images toward the reflective surface of the projection screen, wherein the stereo images are directed to the tracked

Assignees

• Disney Entpr Inc

Inventors

• Smithwick Quinn Y J
• Dill Dawson Mcleod
• Ilardi Michael John
• Papadopoulos Elisabeth C
• Bristow Robert J
• Bristow-Campbell Colleen L
• Smith Chad Michael

Classifications

• G03B21/60 Primary

  characterised by the nature of the surface · CPC title

• G02B30/33 Primary

  involving directional light or back-light sources · CPC title

• G03B21/2066

  Reflectors in illumination beam (in projection beam G03B21/28) · CPC title

• G03B21/2033

  LED or laser light sources · CPC title

• G03B21/006

  using LCD's · CPC title