Methods and systems for augmented reality

Patent metadata

Field	Value
Publication number	US-11762199-B2
Application number	US-202017094419-A
Country	US
Kind code	B2
Filing date	Nov 10, 2020
Priority date	Jul 3, 2015
Publication date	Sep 19, 2023
Grant date	Sep 19, 2023

Abstract

A method and system for image display with a head-mounted device, which use a seethrough tunable diffractive mirror, such as a see-through tunable holographic mirror or seethrough tunable LCD array mirror, which mirror is useful in providing augmented reality.

First claim

The invention claimed is:

1. A head-mounted device (HMD) to be worn by an ametropic wearer, the head-mounted device being configured for display and visualization, by the wearer, of computer-generated images, said head-mounted device (HMD) comprising:
an image source;
a see-through tunable diffractive mirror, situated in front of one eye of the wearer; and
a controller configured to tune the mirror,
wherein the image source is configured to emit a light beam towards said mirror, wherein said emitted light beam is reflected onto said mirror and thereby is directed towards said eye of the wearer, so as to cause visualization of a computer-generated image by the wearer;
an ophthalmic lens configured to correct the wearer's ametropia in natural vision, the ophthalmic lens being a multifocal lens selected from bifocal lenses and progressive addition lenses; and
at least one sensor comprising a sensor selected from luminance sensors, luminosity sensors and eye-trackers,
wherein the mirror:
is provided on the ophthalmic lens, being provided on a front face, on a rear face, or within a bulk of the ophthalmic lens,
comprises at least an area for near vision and an area for far vision corresponding to distinct values of distance of visualization of the computer-generated image by the wearer, and
is tuned to adjust vision of the wearer for the visualization of the computer-generated image, the mirror being tuned to correct the wearer's ametropia for the visualization of the computer-generated image by the wearer,

wherein the head-mounted device (HMD) is configured to tune the mirror to adjust a distance and/or gaze direction of visualization by the wearer of the computer-generated image, as a function of the distance and/or gaze direction determined by the at least one sensor, and
wherein the at least one sensor further comprises at least one scene camera which is a plenoptic camera provided with a micro-lens array placed in front of a sensor matrix configured to analyze the scene in natural vision, in which each micro-lens corresponds to a group of pixels so that beams from the scene are distributed by each micro-lens onto the pixel groups according to their direction and distance of an object in the scene, in order to obtain an image containing the position, distance and direction of the object in natural vision,
the head-mounted device being configured to integrate into the scene the adjusted computer-generated image, which evolves within the scene.

2. The head-mounted device (HMD) according to claim 1 , wherein the at least one sensor comprises at least one luminance sensor or luminosity sensor, and wherein the mirror is tuned to adjust the gaze direction of visualization, by the wearer, of the computer-generated image as a function of the distance or gaze direction determined by the at least one sensor.

3. The head-mounted device (HMD) according to claim 1 , wherein the at least one sensor comprises an eye-tracker, and wherein the mirror is tuned to adjust the distance and/or gaze direction of visualization, by the wearer, of the computer-generated image as a function of the distance and/or gaze direction determined by the eye-tracker.

4. The head-mounted device (HMD) according to claim 1 , wherein the mirror comprises one or more areas of tunable refractive index/indices.

5. The head-mounted device (HMD) according to claim 1 , wherein the mirror comprises an array of individually tunable pixels.

6. The head-mounted device (HMD) according to claim 1 , wherein the mirror comprises an array of individually tunable recorded holographic pixels, the array being an array of polymer dispersed liquid crystals (PDLC) or of holographic polymer dispersed liquid crystals (H-PDLC).

7. The head-mounted device (HMD) according to claim 1 , wherein the mirror comprises a tunable transparent array of liquid crystal,
wherein the array is active or passive and is a transmission phase-only spatial light modulator (SLM).

8. A method for the display and visualization of computer-generated images by a head-mounted device (HMD) to be worn by an ametropic wearer, the head-mounted device (HMD) comprising
an image source,
a see-through tunable diffractive mirror, situated in front of one eye of the wearer; and
a controller configured to tune the mirror,
wherein the image source is configured to emit a light beam towards said mirror, wherein said emitted light beam is reflected onto said mirror and thereby is directed towards said eye of the wearer, so as to cause visualization of a computer-generated image by the wearer;
an ophthalmic lens configured to correct the wearer's ametropia in natural vision, the ophthalmic lens being a multifocal lens selected from bifocal lenses and progressive addition lenses; and
at least one sensor comprising a sensor selected from luminance sensors, luminosity sensors and eye-trackers, wherein the at least one sensor further comprises at least one scene camera which is a plenoptic camera provided with a micro-lens array placed in front of a sensor matrix configured to analyze the scene in natural vision, in which each micro-lens corresponds to a group of pixels so that beams from the scene are distributed by each micro-lens onto the pixel groups according to their direction and distance of an object in the scene, in order to obtain an image containing the position, distance and direction of the object in natural vision,
the head-mounted device being configured to integrate into the scene the adjusted computer-generated image, which evolves within the scene,
wherein the mirror:
is provided on the ophthalmic lens, being provided on a front face, on a rear face, or within a bulk of the ophthalmic lens,
comprises at least an area for near vision and an area for far vision corresponding to distinct values of distance of visualization of the computer-generated image by the wearer, and
is tuned to adjust vision of the wearer for the visualization of the computer-generated image, the mirror being tuned to correct the wearer's ametropia for the visualization of the computer-generated image by the wearer, and

wherein the head-mounted device (HMD) is configured to tune the mirror to adjust a distance and/or gaze direction of visualization by the wearer of the computer-generated image, as a function of the distance and/or gaze direction determined by the at least one sensor, the method comprising:

tuning the mirror to:
correct at least partially the wearer's ametropia for the visualization of the computer-generated image by the wearer, and
adjust the distance of visualization and/or the gaze direction of visualization of the computer-generated image by the wearer.

9. The method according to claim 8 , wherein the tuning further comprises tuning the mirror so as to perform at least one amongst the following:
adjust an apparent size of visualization of the computer-generated image by the wearer,
adjust a focal point for visualization of the computer-generated image to the position of the eye of the wearer,
correct secondary optical aberrations in the visualization of the computer-generated image by the wearer, which are selected from aspherization and field aberrations, and
partially or fully switch OFF or ON the visualization of the computer-generated image by the wearer.

10. The method according to claim 8 , wherein the at least one sensor comprises the at least one luminance sensor or luminosity sensor, and wherein the tuning further comprises:
(i) determining at least one value of luminance or of luminosity, based on data collected from the luminance sensor or luminosity sensor, and
(ii) tuning the mirror so as to adjust the gaze direction of visualization by the wearer of the computer-

Assignees

• Essilor Int

Inventors

• Bouchier Aude
• Cano Jean-Paul
• Archambeau Samuel

Classifications

• G02B27/0172 Primary

  characterised by optical features · CPC title

• G02F1/13342

  Holographic polymer dispersed liquid crystals · CPC title

• G02B5/1828

  having means for producing variable diffraction (controlling the direction of light by means of one or more diffracting elements G02B26/0808; acousto-optical elements G02F1/11, G02F1/33; electro- or magneto-optical diffraction G02F1/292, G02F1/2955) · CPC title

• G02C7/083

  Electrooptic lenses · CPC title

• G02C7/086

  Auxiliary lenses located directly on a main spectacle lens or in the immediate vicinity of main spectacles · CPC title