Absolute phase unwrapping for fringe analysis in an eye tracking application

Patent metadata

Field	Value
Publication number	US-12360593-B2
Application number	US-202318110725-A
Country	US
Kind code	B2
Filing date	Feb 16, 2023
Priority date	Aug 16, 2022
Publication date	Jul 15, 2025
Grant date	Jul 15, 2025

Abstract

An eye tracking system for absolute phase unwrapping includes a fringe projector, a camera, and an illumination module. The projector provides a periodical fringe pattern onto the eye and the camera captures a reflection of the fringe pattern. Fourier transform, wavelet transform, phase shifting, and/or variants thereof may be used to determine a phase of the fringe pattern and generate a wrapped phase map. Spatial phase unwrapping is used for phase unwrapping resulting in a relative unwrapped phase map. The illumination module with a known relative position between the fringe projector and the camera is used to create glint(s) on the eye. Detected glints on the original image are used to convert the relative unwrapped phase map to an absolute unwrapped phase map.

First claim

The invention claimed is:

1. An eye tracking system, comprising:
a fringe projector to provide structured light onto an eye;
one or more illuminators to generate glints on the eye;
an eye tracking camera to capture a reflection of the structured light and the glints on the eye; and
a processor communicatively coupled to the fringe projector, the one or more illuminators, and the eye tracking camera, the processor to:
generate a wrapped phase map from the captured reflection of the structured light and the glints on the eye;
generate a relative unwrapped phase map from the wrapped phase map using spatial phase unwrapping; and
generate an absolute unwrapped phase map from the relative unwrapped phase map using the reflection of the glints as anchors,

wherein the one or more illuminators are positioned such that the reflection of the glints is within an overlap region of the fringe projector and the eye tracking camera on a surface of the eye.

2. The eye tracking system of claim 1 , wherein the structured light is a periodic fringe pattern.

3. The eye tracking system of claim 1 , wherein the processor is to generate the wrapped phase map employing one or more of a Fourier transform, a wavelet transform, a phase shifting technique, or a variant thereof.

4. The eye tracking system of claim 1 , wherein the one or more illuminators comprise a side-emitting laser diode, a vertical-cavity surface-emitting laser diode, a superluminescent light-emitting diode, or a light-emitting diode (LED).

5. The eye tracking system of claim 4 , wherein the one or more illuminators emit one or more of visible light, infrared light, or near-infrared (NIR) light.

6. The eye tracking system of claim 1 , wherein the one or more illuminators are positioned such that the reflection of the glints is within a field of view (FOV) of the eye tracking camera.

7. The eye tracking system of claim 1 , wherein the one or more illuminators comprise up to ten illuminators.

8. The eye tracking system of claim 1 , wherein the one or more illuminators are part of a glint detection system.

9. The eye tracking system of claim 1 , wherein the processor is integrated into the eye tracking camera.

10. A method, comprising:
projecting, by a fringe projector, a structured light onto an eye;
generating, by one or more illuminators, one or more glints on the eye;
capturing, by an eye tracking camera, a reflection of the structured light and the glints on the eye;
generating, by a processor, a wrapped phase map from the captured reflection of the structured light and the glints on the eye;
generating, by the processor, a relative unwrapped phase map from the wrapped phase map using spatial phase unwrapping; and
generating, by the processor, an absolute unwrapped phase map from the relative unwrapped phase map using the reflection of the glints as anchors,
wherein the one or more illuminators generating the one or more glints on the eye are positioned such that the reflection of the one or more glints is within an overlap region of the fringe projector and the eye tracking camera on a surface of the eye.

11. The method of claim 10 , wherein projecting the structured light onto an eye comprises:
projecting a periodic fringe pattern onto the eye.

12. The method of claim 10 , wherein generating the wrapped phase map comprises:
employing one or more of a Fourier transform, a wavelet transform, a phase shifting technique, or a variant thereof.

13. The method of claim 10 , wherein the one or more illuminators are positioned such that the reflection of the glints is within a field of view (FOV) of the eye tracking camera.

14. The method of claim 13 , wherein generating the one or more glints by the one or more illuminators comprises:
emitting one or more of visible light, infrared light, or near-infrared (NIR) light.

15. A near-eye display device, comprising:
a display to provide an image on an eye box;
a fringe projector to provide structured light onto an eye;
one or more illuminators to generate glints on the eye;
an eye tracking camera to capture a reflection of the structured light and the glints on the eye; and
a processor communicatively coupled to the fringe projector, the one or more illuminators, and the eye tracking camera, the processor to:
generate a wrapped phase map from the captured reflection of the structured light and the glints on the eye;
generate a relative unwrapped phase map from the wrapped phase map using spatial phase unwrapping; and
generate an absolute unwrapped phase map from the relative unwrapped phase map using the reflection of the glints as anchors,

wherein the one or more illuminators are positioned such that the reflection of the glints is within an overlap region of the fringe projector and the eye tracking camera on a surface of the eye.

16. The near-eye display device of claim 15 , wherein the processor is to generate the wrapped phase map employing one or more of a Fourier transform, a wavelet transform, a phase shifting technique, or a variant thereof.

17. The near-eye display device of claim 15 , wherein the one or more illuminators:
emit one or more of visible light, infrared light, or near-infrared (NIR) light, and
are positioned such that the reflection of the glints is within a field of view (FOV) of the eye tracking camera.

18. The near-eye display device of claim 15 , wherein the structured light is a periodic fringe pattern.

19. The near-eye display device of claim 15 , wherein the processor is integrated into the eye tracking camera.

Assignees

• Meta Platforms Tech Llc

Inventors

• An Yatong
• Wang Youmin
• Aiello Gaetano

Classifications

• G06T7/521

  from laser ranging, e.g. using interferometry; from the projection of structured light · CPC title

• G06V10/60

  relating to illumination properties, e.g. using a reflectance or lighting model · CPC title

• G06V10/141

  Control of illumination · CPC title

• H04N23/11 Primary

  for generating image signals from visible and infrared light wavelengths · CPC title

• G06T5/10

  using non-spatial domain filtering · CPC title