Eye-tracking arrangement

Patent metadata

Field	Value
Publication number	US-11733774-B2
Application number	US-202117451219-A
Country	US
Kind code	B2
Filing date	Oct 18, 2021
Priority date	Oct 20, 2020
Publication date	Aug 22, 2023
Grant date	Aug 22, 2023

Abstract

The invention relates to an eye tracking arrangement that includes a camera configured to capture images of an eye at a first scanning rate, a laser velocimeter configured to capture an eye velocity of a movement of the eye by laser Doppler velocimetry at a second scanning rate and a control device configured to determine an absolute eye position based on the images, and track a gaze direction of the eye based on the absolute eye position and the eye velocity.

First claim

The invention claimed is:

1. An eye tracking arrangement comprising:
a camera which is arranged to capture images of an eye at a first scanning rate,
a laser velocimeter configured to detect an eye velocity of a movement of the eye by laser Doppler velocimetry at a second scanning rate, and
a control device configured to determine an absolute eye position based on the images, and to track a gaze direction of the eye based on the absolute eye position and the eye velocity, wherein the control device is configured to track the gaze direction starting from the absolute eye position determined based on the image and by determining interpolated eye positions based on the determined eye velocity.

2. The eye tracking arrangement according to claim 1 , wherein the first scanning rate is 40 Hz at the maximum, in particular at least 1 Hz, and wherein in particular the second scanning rate is at least 500 Hz.

3. The eye tracking arrangement according to claim 2 , wherein the first scanning rate is at least 5 Hz.

4. The eye tracking arrangement according to claim 2 , wherein the second scanning rate is a maximum of 5 kHz.

5. The eye tracking arrangement according to claim 1 , wherein the laser velocimeter comprises at least one surface emitter with integrated photodiode.

6. A smart glasses comprising an eye tracking arrangement according to claim 1 .

7. The smart glasses according to claim 6 , wherein the laser velocimeter comprises at least one laser source, which is arranged on a spectacle frame, which especially surrounds a spectacle lens, and/or on a spectacle temple and/or in a spectacle lens, and/or
wherein the camera is arranged on the spectacle frame, and/or on the spectacle temple and/or in the spectacle lens.

8. The smart glasses according to claim 6 , further comprising an input and/or output unit which is arranged to receive an input from the user and/or to output an output to the user, wherein the control device is arranged to actuate the input and/or output unit based on the tracked gaze direction of the eye.

9. A method of eye tracking of an eye, comprising the steps of:
capturing an image of the eye by means of a camera,
determining an absolute eye position of the eye based on the image of the eye,
irradiating at least one wavelength modulated laser beam to the eye,
determining a Doppler shift between the irradiated laser beam and a portion of the irradiated laser beam backscattered by the eye based on laser feedback interferometry of the irradiated laser beam and the portion backscattered by the eye,
determining an eye velocity based on the Doppler shift, and
tracking an eye movement of the eye based on the absolute eye position and the eye velocity, wherein tracking of eye movement is performed starting from an absolute eye position determined based on the image and by determining interpolated eye positions based on the determined eye velocity.

10. The method of claim 9 , wherein images of the eye are captured at a first scanning rate to determine absolute eye positions at the first scanning rate, and wherein wavelength modulated laser beams are irradiated onto the eye at a second scanning rate to determine eye velocities at the second scanning rate.

11. The method according to claim 9 , wherein determining the eye velocity is performed based on the following equation:
F D =2 v cos(α)/λ,

wherein:
v is the eye velocity;
F D is a Doppler frequency F D corresponding to the Doppler shift between the irradiated laser beam and the backscattered portion of the irradiated laser beam;
α is an angle between a direction of the irradiated laser beam and a tangent to an ocular surface which contacts the ocular surface at an impingement point where the irradiated laser beam impinges on the eye and which also is located in the plane spanned by a wave vector and a surface normal at the impingement point; and
λ is a wavelength of the irradiated laser beam.

12. The method according to claim 11 , further comprising the step of:
calibrating by determining the angle α,
wherein the angle α is based on the image of the eye captured by means of the camera while the wavelength modulated laser beam is irradiated to the eye.

13. The method according to claim 11 , further comprising the steps of:
determining a calibration eye velocity based on at least two consecutive images,
calibrating by determining the angle α,
wherein the angle α is determined based on the determined calibration eye velocity.

14. The method according to claim 9 , further comprising the steps of:
determining a maximum eye velocity during an eye movement, and
predicting an eye movement end position based on the maximum velocity.

15. The method according to claim 9 , wherein at least two laser beams are irradiated onto the eye, and wherein the two irradiated laser beams are aligned such that an angle and/or a distance between a wave vector of each irradiated laser beam and at least one of two mutually orthogonal rotational axes of the eye, respectively, is not zero.

Assignees

• Bosch Gmbh Robert
• Trumpf Photonic Components Gmbh

Inventors

• Petersen Andreas
• Schlebusch Thomas Alexander
• Spruit Hans
• Hellmig Jochen

Classifications

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06V40/19

  Sensors therefor · CPC title

• G02B27/0093 Primary

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G02C11/10

  Electronic devices other than hearing aids · CPC title

• G02B27/0172

  characterised by optical features · CPC title