Pupil-aware eye tracking for eye safety

Patent metadata

Field	Value
Publication number	US-12544263-B2
Application number	US-202318107344-A
Country	US
Kind code	B2
Filing date	Feb 8, 2023
Priority date	Feb 8, 2023
Publication date	Feb 10, 2026
Grant date	Feb 10, 2026

Abstract

Eye safety and eye tracking accuracy is enhanced through pupil-aware eye tracking, where a fringe pattern projection or illumination onto the eye is locally dimmed in an area corresponding to the pupil. Fringe projection local dimming is accomplished by modifying (locally dimming) the fringe pattern at the projector. Illumination local dimming is accomplished at the light source (e.g., a laser source) before the light is provided by a micro-electromechanical system (MEMS) to the eye. An amount of light provided to non-pupil areas such as sclera may be increased to enhance a signal-to-noise ratio (SNR), which may lead to more accurate eye tracking.

First claim

The invention claimed is:

1 . An eye tracking system, comprising:
a projector to project a fringe pattern to a visible surface of an eye; a sensor to capture a reflection of the projected fringe pattern from the visible surface of the eye; and a controller communicatively coupled to the projector and the sensor, the controller to: receive at least one image of the captured reflection from the sensor; identify a location of a pupil of the eye; and instruct the projector to dim a portion of the projected fringe pattern corresponding to the location of the pupil.

2 . The eye tracking system of claim 1 , wherein the controller is further to:
identify a dimension of the pupil; and select a size of the dimmed portion of the projected fringe pattern based on the identified dimension of the pupil.

3 . The eye tracking system of claim 1 , wherein the controller is to identify the location of the pupil during a first pass of an eye tracking operation.

4 . The eye tracking system of claim 1 , wherein the controller is further to:
instruct the projector to increase a brightness of another portion of the projected fringe pattern corresponding to an area of the visible surface of the eye other than the pupil.

5 . The eye tracking system of claim 4 , wherein the area of the visible surface of the eye other than the pupil corresponds to a sclera.

6 . The eye tracking system of claim 1 , wherein the sensor comprises a camera or a single photon avalanche diode (SPAD) sensor.

7 . An eye tracking system, comprising:
an illuminator to project a structured illumination to a visible surface of an eye, wherein the illuminator comprises: a light source to provide light; and a micro-electro-mechanical system (MEMS) device to provide the illumination to the visible surface of the eye through a two-dimensional (2D) scan; a sensor to capture a reflection of the structured illumination from the visible surface of the eye; and a controller communicatively coupled to the illuminator and the sensor, the controller to: receive at least one image of the captured reflection from the sensor; identify a location of a pupil of the eye; and instruct the illuminator to dim a portion of the structured illumination corresponding to the location of the pupil.

8 . The eye tracking system of claim 7 , wherein the controller is further to:
identify a dimension of the pupil; and select a size of the dimmed portion of the structured illumination based on the identified dimension of the pupil.

9 . The eye tracking system of claim 7 , wherein the controller is to identify the location of the pupil during a first pass of an eye tracking operation.

10 . The eye tracking system of claim 7 , wherein the micro-electro-mechanical system (MEMS) is to steer at least one mirror for the 2D scan.

11 . The eye tracking system of claim 10 , wherein the at least one mirror is a galvanometric mirror.

12 . The eye tracking system of claim 7 , wherein the light source comprises a side-emitting laser diode, a vertical-cavity surface-emitting laser (VCSEL) diode, a superluminescent light-emitting diode (SLED), or a light-emitting diode (LED).

13 . The eye tracking system of claim 7 , wherein the light source emits at least one of visible light, infrared light, or near-infrared (NIR) light.

14 . The eye tracking system of claim 7 , wherein the controller is further to:
instruct the light source to increase a brightness of another portion of the structured illumination corresponding to an area of the visible surface of the eye other than the pupil.

15 . The eye tracking system of claim 14 , wherein the area of the visible surface of the eye other than the pupil corresponds to a sclera.

16 . A method, comprising:
identifying a location of a pupil on a visible surface of an eye; generating a fringe pattern, wherein a portion of the fringe pattern corresponding to the location of the pupil is dimmed; projecting the fringe pattern from a projector to the visible surface of the eye; capturing a reflection of the projected fringe pattern from the visible surface of the eye; and tracking a gaze of a user based on the captured reflection of the projected fringe pattern.

17 . The method of claim 16 , further comprising:
identifying a dimension of the pupil; and selecting a size of the dimmed portion of the fringe pattern based on the identified dimension of the pupil.

18 . The method of claim 16 , further comprising:
increasing a brightness of another portion of the projected fringe pattern corresponding to an area of the visible surface of the eye other than the pupil.

19 . The method of claim 16 , further comprising:
generating a structured illumination, wherein a portion of the structured illumination corresponding to the location of the pupil is dimmed; projecting the structured illumination from an illuminator comprising a light source and a micro-electro-mechanical system (MEMS) device to the visible surface of the eye; capturing a reflection of the structured illumination from the visible surface of the eye; and tracking a gaze of a user based on the captured reflection of the structured illumination.

20 . The method of claim 19 , further comprising:
increasing a brightness of another portion of the structured illumination corresponding to an area of the visible surface of the eye other than the pupil.

Assignees

• Meta Platforms Tech Llc

Inventors

• An Yatong
• Wang Youmin
• Aiello Gaetano

Classifications

• A61F2009/00865

  Sclera · CPC title

• A61F2009/00897

  Scanning mechanisms or algorithms · CPC title

• A61B3/112

  for measuring diameter of pupils · CPC title

• A61F2009/00846

  Eyetracking · CPC title

• A61F9/00804 Primary

  Refractive treatments · CPC title