Multifocal display

Patent metadata

Field	Value
Publication number	US-9864205-B2
Application number	US-201514642104-A
Country	US
Kind code	B2
Filing date	Mar 9, 2015
Priority date	Nov 25, 2014
Publication date	Jan 9, 2018
Grant date	Jan 9, 2018

Abstract

A multifocal display for rendering a 3D scene as a series of 2D images. In one aspect, the multifocal display includes a display, an optical imaging system, a refractive focus actuator and a controller. The display renders the 2D images. The optical imaging system is image-side telecentric and creates an image of the display. The refractive focus actuator is positioned at the pupil of the optical imaging system. Thus, adjusting the refractive focus actuator alters a location of the image of the display but does not significantly alter a size of the image. The controller coordinates adjustment of the refractive focus actuator with rendering of the 2D images on the display. The waveform driving the focus actuator is preferably designed to reduce ringing and jitter effects.

First claim

What is claimed is:

1. A multifocal display for rendering a 3D scene as a series of 2D images, the multifocal display comprising:
a display, on which 2D images are rendered;
an optical imaging system positioned to create an image of the display, wherein the optical imaging system is image-side telecentric, the optical imaging system having a pupil;
a refractive focus actuator positioned at the pupil of the optical imaging system, wherein adjusting the refractive focus actuator alters a location of the image of the display but does not significantly alter a size of the image; and
a controller that coordinates adjustment of the refractive focus actuator with rendering of the 2D images on the display, wherein the controller produces a drive signal to adjust the refractive focus actuator and the drive signal optimizes an image error metric of an ideal rendering of 3D scenes versus the 3D scenes rendered on the multifocal display.

2. The multifocal display of claim 1 further comprising:
an eyepiece positioned to allow viewing the images of the display.

3. The multifocal display of claim 2 further comprising:
an optical combiner positioned to overlay the images of the display on a user's natural view to implement an augmented reality.

4. The multifocal display of claim 2 further comprising:
a negative field lens located between the refractive focus actuator and the eyepiece.

5. The multifocal display of claim 2 wherein the multifocal display covers a field of view of at least 30 degrees.

6. The multifocal display of claim 1 wherein the refractive focus actuator is a deformable lens.

7. The multifocal display of claim 6 wherein the deformable lens is a liquid lens that can be adjusted over a range of five diopters.

8. The multifocal display of claim 1 wherein the image error metric is a difference between locations of points in the ideal rendered 3D scenes versus locations of those points in the 3D scenes rendered on the multifocal display.

9. The multifocal display of claim 1 further comprising:
an adjustable aperture within the optical imaging system, wherein the controller also coordinates adjustment of the aperture with adjustment of the refractive focus actuator.

10. The multifocal display of claim 1 wherein the optical imaging system is also object-side telecentric.

11. The multifocal display of claim 1 wherein the multifocal display can render 3D scenes at a rate of at least 60 scenes per second.

12. A multifocal display for rendering a 3D scene as a series of 2D images, the multifocal display comprising:
a display, on which 2D images are rendered;
an optical imaging system positioned to create an image of the display, wherein the optical imaging system is image-side telecentric, the optical imaging system having a pupil;
a refractive focus actuator positioned at the pupil of the optical imaging system, wherein adjusting the refractive focus actuator alters a location of the image of the display but does not significantly alter a size of the image; and
a controller that coordinates adjustment of the refractive focus actuator with rendering of the 2D images on the display, wherein the controller adjusts the refractive focus actuator such that the locations of the images are realized in a temporal order that is not monotonically ascending or descending.

13. The multifocal display of claim 12 wherein the controller adjusts the refractive focus actuator such that the locations of the images are realized in a temporal order that is monotonically ascending/descending for the odd image locations and then monotonically descending/ascending for the even image locations.

14. The multifocal display of claim 12 wherein the controller produces a drive signal to adjust the refractive focus actuator and the drive signal is a filtered version of a piece-wise flat signal.

15. The multifocal display of claim 12 wherein the controller produces a drive signal to adjust the refractive focus actuator and the drive signal optimizes an image quality metric of 3D scenes rendered on the multifocal display.

16. The multifocal display of claim 15 wherein the image quality metric accounts for image defocus.

17. A multifocal display for rendering a 3D scene as a series of 2D images, the multifocal display comprising:
a display, on which 2D images are rendered;
an optical imaging system positioned to create an image of the display, wherein the optical imaging system is image-side telecentric, the optical imaging system having a pupil;
a refractive focus actuator positioned at the pupil of the optical imaging system, wherein adjusting the refractive focus actuator alters a location of the image of the display but does not significantly alter a size of the image; and
a controller that coordinates adjustment of the refractive focus actuator with rendering of the 2D images on the display, wherein the controller produces a drive signal to adjust the refractive focus actuator and the drive signal optimizes an image quality metric of 3D scenes rendered on the multifocal display, wherein the image quality metric accounts for temporal quality.

18. A method for rendering a 3D scene as a series of 2D images on a multifocal display comprising a display, an optical imaging system and a refractive focus actuator, the method comprising:
rendering on the display 2D images derived from the 3D scene, the optical imaging system creating an image of the display at a location;
adjusting the refractive focus actuator to alter the location of the image of the display, wherein adjusting the refractive focus actuator does not significantly alter a size of the image; and
coordinating adjustment of the refractive focus actuator with rendering of the 2D images on the display, wherein adjusting the refractive focus actuator comprises producing a drive signal to adjust the refractive focus actuator and the drive signal optimizes an image error metric of an ideal rendering of 3D scenes versus the 3D scenes rendered on the multifocal display.

19. A controller for use in a multifocal display that renders a 3D scene as a series of 2D images; the multifocal display comprising a display, an optical imaging system that is image-side telecentric, and a refractive focus actuator; the controller coordinating adjustment of the refractive focus actuator with rendering of the 2D images on the display; the controller producing a drive signal to adjust the refractive focus actuator wherein the drive signal optimizes an image error metric of an ideal rendering of 3D scenes versus the 3D scenes rendered on the multifocal display.

20. The controller of claim 19 wherein the drive signal adjusts the refractive focus actuator such that the locations of the images are realized in a temporal order that is not monotonically ascending or descending.

Assignees

• Bedard Noah
• Llull Patrick
• Tosic Ivana
• Wu Wanmin
• Berkner Kathrin
• Ricoh Co Ltd

Inventors

• Bedard Noah
• Llull Patrick
• Tosic Ivana
• Wu Wanmin
• Berkner Kathrin

Classifications

• H04N13/322

  using varifocal lenses or mirrors · CPC title

• G02B30/52 Primary

  the three-dimensional [3D] volume being constructed from a stack or sequence of two-dimensional [2D] planes, e.g. depth sampling systems · CPC title

• G02B25/001

  Eyepieces · CPC title

• G02B13/22

  Telecentric objectives or lens systems · CPC title

• H04N13/398

  Synchronisation thereof; Control thereof · CPC title