Systems, devices, and methods that integrate eye tracking and scanning laser projection in wearable heads-up displays

Patent metadata

Field	Value
Publication number	US-10488661-B2
Application number	US-201615167484-A
Country	US
Kind code	B2
Filing date	May 27, 2016
Priority date	May 28, 2015
Publication date	Nov 26, 2019
Grant date	Nov 26, 2019

Abstract

Systems, devices, and methods that integrate eye tracking capability into scanning laser projector (“SLP”)-based wearable heads-up displays are described. An infrared laser diode is added to an RGB SLP and an infrared photodetector is aligned to detect reflections of the infrared light from features of the eye. A holographic optical element (“HOE”) may be used to combine visible light, infrared light, and environmental light into the user's “field of view.” The HOE may be heterogeneous and multiplexed to apply positive optical power to the visible light and zero or negative optical power to the infrared light.

First claim

The invention claimed is:

1. A heterogeneous holographic optical element (“HOE”) comprising:
a first layer of holographic material that includes a red hologram, a green hologram, and a blue hologram, the red hologram to apply a first optical power to a red light, the green hologram to apply the first optical power to a green light, and the blue hologram to apply the first optical power to a blue light, wherein the first optical power is a positive optical power to cause the red light, the green light, and the blue light all to converge to a first exit pupil at an eye of a user for image projection purposes; and
a second layer of holographic material that includes an infrared hologram, the infrared hologram to apply a second optical power to an infrared light, wherein the second optical power is less than the first optical power to cause the infrared light to form a second exit pupil at the eye of the user for eye tracking purposes, the second exit pupil larger than and completely encompassing the first exit pupil at the eye of the user, wherein the first layer of holographic material and the second layer of holographic material are two distinct layers of a laminate in which the red hologram, the green hologram, the blue hologram, and the infrared hologram all overlap.

2. The heterogeneous HOE of claim 1 wherein:
the red hologram redirects the red light and applies the first optical power to the red light upon redirection of the red light;
the green hologram redirects the green light and applies the first optical power to the green light upon redirection of the green light;
the blue hologram redirects the blue light and applies the first optical power to the blue light upon redirection of the blue light; and
the infrared hologram redirects the infrared light and applies the second optical power to the infrared light upon redirection of the infrared light.

3. The heterogeneous HOE of claim 1 wherein the red hologram causes the red light to converge at a first rate of convergence, the green hologram causes the green light to converge at the first rate of convergence, and the blue hologram causes the blue light to converge at the first rate of convergence.

4. The heterogeneous HOE of claim 3 wherein the second optical power is positive, and wherein the infrared hologram causes the infrared light to converge at a second rate of convergence that is less than the first rate of convergence.

5. The heterogeneous HOE of claim 1 wherein the second optical power is zero.

6. The heterogeneous HOE of claim 1 wherein the second optical power is a negative optical power and the infrared hologram causes the infrared light to diverge.

7. The heterogeneous HOE of claim 1 wherein the first optical power is greater than or equal to forty diopters and the second optical power is less than or equal to zero diopters.

8. The heterogeneous HOE of claim 1 wherein the red light, the green light, and the blue light are all selected from a first range of 390 nm to 700 nm and the infrared light is selected from a second range of 700 nm to 10 um.

9. The heterogeneous HOE of claim 1 , further comprising:
an eyeglass lens, wherein both the first layer of holographic material and the second layer of holographic material are carried by the eyeglass lens.

10. The heterogenous HOE of claim 1 wherein:
the red hologram is responsive to the red light and unresponsive to the green light, the blue light, and the infrared light;
the green hologram is responsive to the green light and unresponsive to the red light, the blue light, and the infrared light;
the blue hologram is responsive to the blue light and unresponsive to the red light, the green light, and the infrared light; and
the infrared hologram is responsive to the infrared light and unresponsive to the red light, the green light, and the blue light.

11. The heterogenous HOE of claim 10 wherein the laminate is oriented to position the red hologram, the green hologram, and the blue hologram all in front of the infrared hologram with respect to an optical path of the infrared light, and wherein the infrared light passes through the red hologram, the green hologram, and the blue hologram to impinge on the infrared hologram.

12. The heterogenous HOE of claim 11 wherein the infrared hologram redirects the infrared light and applies the second optical power to the infrared light upon redirection of the infrared light, and wherein the infrared light passes through the red hologram, the green hologram, and the blue hologram after being redirected by the infrared hologram.

13. The heterogenous HOE of claim 1 wherein the first layer of holographic material and the second layer of holographic material are layered one on top of the other and the first hologram and the second hologram overlap completely.

Assignees

• North Inc

Inventors

• Alexander Stefan
• Chapeskie Jake
• Holland Lloyd Frederick
• Mahon Thomas

Classifications

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G02B26/0833

  the reflecting element being a micromechanical device, e.g. a MEMS mirror, DMD (G02B26/0825 takes precedence; micromechanical devices in general B81B) · CPC title

• G02B2027/0178

  Eyeglass type (eyeglass details G02C) · CPC title

• G02B27/0189 Primary

  Sight systems · CPC title