Display with eye tracking and adaptive optics

Patent metadata

Field	Value
Publication number	US-11966044-B2
Application number	US-202217967496-A
Country	US
Kind code	B2
Filing date	Oct 17, 2022
Priority date	Jan 31, 2020
Publication date	Apr 23, 2024
Grant date	Apr 23, 2024

Abstract

This document relates to an optical device that uses adaptive optics as part of an optical system. The adaptive optics can be used to correct light rays that correspond to a portion of an eye box based on information received from an eye-tracking unit, and can also correct for aberrations in the optics in the optical device. The adaptive optics include corrective elements that can be modified using modifying elements to correct the angle of light rays, such that rays associated with a specific pupil position and gaze direction of a user's eye can be made parallel and ensure a high quality image is viewed by the user.

First claim

The invention claimed is:

1. A method comprising:
capturing eye-tracking information associated with an eye of a user of a device;
determining aberrations that are associated with optics used in the device, the aberrations including non-parallel light rays;
determining corrections to adaptive optics based on the eye-tracking information and the aberrations, the corrections including modifying local refractive indexes associated with a subset portion of a plurality of corrective elements of the adaptive optics; and
applying the corrections to the adaptive optics to correct the non-parallel light rays that are within an area associated with the eye-tracking information to be parallel.

2. The method of claim 1 , wherein applying the corrections to the adaptive optics comprises applying a modification to the subset portion of the plurality of corrective elements of the adaptive optics.

3. The method of claim 2 , wherein the plurality of corrective elements comprises a liquid crystal element.

4. The method of claim 3 , wherein applying the modification comprises applying a voltage to the liquid crystal element using an electrode.

5. The method of claim 1 , wherein capturing the eye-tracking information comprises detecting a pupil position and a gaze direction of the eye of the user.

6. The method of claim 1 , wherein applying the corrections to the adaptive optics comprises modifying the subset portion of the plurality of corrective elements using a subset of a plurality of modifying elements.

7. The method of claim 6 , wherein modifying the subset of the plurality of corrective elements comprises applying a voltage to the subset of the plurality of modifying elements.

8. The method of claim 7 , further comprising:
determining the voltage based on a lookup table.

9. The method of claim 7 , further comprising:
determining the voltage based on a neural network.

10. The method of claim 7 , wherein the subset portion of the plurality of corrective elements applies the corrections to the non-parallel light rays based on the voltage received from the subset of the plurality of modifying elements.

11. The method of claim 7 , wherein a greater voltage applied to the subset of the plurality of modifying elements causes greater modifications to the local refractive indexes associated with the subset portion of the plurality of corrective elements.

12. The method of claim 11 , wherein the greater voltage applied to the subset of the plurality of modifying elements causes greater tilting of liquid crystal molecules in the subset portion of the plurality of corrective elements.

13. The method of claim 7 , wherein the voltage provides a change in a surface sag of the subset portion of the plurality of corrective elements.

14. The method of claim 1 , wherein modifying the subset portion of the plurality of corrective elements comprises applying varying voltages to liquid crystal modules in the subset portion of the plurality of corrective elements to provide an asymmetric difference surface sag pattern.

15. The method of claim 1 , wherein the plurality of corrective elements comprises at least one of: liquid crystal elements, diffractive gratings, or deformable membranes.

16. The method of claim 1 , wherein correcting the non-parallel light rays to be parallel provides a higher resolution imagery in the area associated with eye-tracking information.

17. The method of claim 1 , wherein the area associated with the eye-tracking information corresponds to an eye box associated with the user.

18. The method of claim 1 , wherein the area associated with the eye-tracking information is less than an entire eye box associated with the user.

19. The method of claim 1 , wherein the area associated with the eye-tracking information corresponds to a fovea of the eye of the user.

20. The method of claim 4 , wherein applying the modification comprises tilting liquid crystal molecules in the subset portion of the plurality of corrective elements.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Georgiou Andreas
• Lunardhi Alfonsus D
• Kollin Joel Steven
• Kress Bernard C
• Chatterjee Ishan
• Possiwan Mario

Classifications

• G02B27/0068 Primary

  having means for controlling the degree of correction, e.g. using phase modulators, movable elements (controlling the phase of light using moving or deformable elements G02B26/06) · CPC title

• G02B27/0093 Primary

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G02B27/0172

  characterised by optical features · CPC title

• G02F1/29

  for the control of the position or the direction of light beams, i.e. deflection · CPC title

• G02B2027/011

  comprising device for correcting geometrical aberrations, distortion · CPC title