Method for operating a pair of smart glasses

Patent metadata

Field	Value
Publication number	US-11513594-B2
Application number	US-202117336849-A
Country	US
Kind code	B2
Filing date	Jun 2, 2021
Priority date	Jun 2, 2020
Publication date	Nov 29, 2022
Grant date	Nov 29, 2022

Abstract

A method for operating smart glasses includes an input unit and/or output unit and a gaze detection arrangement, wherein the gaze detection arrangement detects any eye movement of an eye including the steps of irradiating at least one wavelength-modulated laser beam to the eye, detecting an optical path length of the emitted laser beam based on laser feedback interferometry of the emitted laser radiation with backscattered radiation from the eye, detecting a Doppler shift of the emitted and backscattered radiation based on the laser feedback interferometry, and detecting an eye velocity based on the Doppler shift, and wherein the input unit and/or output unit is operated based on the optical path length and/or the eye velocity.

First claim

The invention claimed is:

1. A method for operating a pair of smart glasses comprising an input unit and/or output unit and a gaze detection arrangement, wherein the gaze detection arrangement detects any eye movement of an eye by the method comprising the steps of:
irradiating at least one wavelength-modulated laser beam onto the eye,
detecting an optical path length of the irradiated laser beam based on laser feedback interferometry of the irradiated laser beam and the portion of the laser beam backscattered from the eye,
detecting a Doppler shift of the irradiated laser beam and the backscattered portion based on the laser feedback interferometry, and
detecting an eye velocity based on the Doppler shift, and
wherein the input unit and/or output unit is operated based on the optical path length and/or the eye velocity,
wherein triangle-modulated laser light is emitted as a wavelength-modulated laser beam, and wherein the optical path length is determined by analyzing the radiation which is interferingly emitted and backscattered by calculating an average of the resulting interference frequencies with respect to the two edges of the triangle-modulated signal.

2. The method according to claim 1 , wherein the input unit and/or output unit is activated or deactivated based on the optical path length and/or the eye velocity.

3. The method according to claim 1 , wherein the gaze detection arrangement directs a single laser beam towards the eye, wherein it is detected when the single laser beam enters into the eye through a pupil, based on the detected optical path length, and wherein the input unit and/or output unit and/or a portion of the gaze detection arrangement is operated, based on the detected entrance of the single laser beam into the eye.

4. The method according claim 1 , wherein an eye gesture is detected based on the optical path length and/or the eye velocity, and wherein the input unit and/or output unit is operated based on a detected predefined eye gesture.

5. The method according to claim 1 , wherein the input unit and/or output unit comprises an image projection unit projecting an image onto a retina.

6. The method according to claim 5 , wherein image parameters of the image projected by the image projection unit are adjusted based on the optical path length and/or eye velocity.

7. The method according to claim 6 , wherein an image sharpness and/or an image resolution and/or a brightness and/or a color distribution of the image projected by the image projection unit will be adjusted.

8. The method according to claim 1 , further comprising the steps of:
detecting maximum eye velocity during eye movement, and
predicting an eye movement end position based on the maximum eye velocity,
wherein the input unit and/or output unit is operated based on the eye movement end position, preferably wherein the image parameters of the image projected by the image projection unit are adjusted based on the eye movement end position.

9. The method according to claim 1 , wherein the input unit and/or output unit comprises a sound reproduction unit and/or an electronic user device, which is preferably provided as a separate device.

10. The method according to claim 1 , wherein a lid closure of the eye is detected, based on the optical path length and/or the eye velocity.

11. The method according to claim 1 , wherein at least a portion of the eye tracking arrangement is active at all times.

12. The method according to claim 1 , further comprising the step of:
detecting any reflectivity of the eye based on an amplitude and phase of the radiation backscattered from the eye,
wherein the input unit and/or output unit is operated based on the reflectivity.

13. A pair of smart glasses, comprising:
an input unit and/or output unit arranged to receive an input from the user and/or output an output to the user; and
a gaze detection arrangement for detecting any eye movement of an eye,
wherein the gaze detection arrangement comprises a laser device adapted to irradiate at least one laser beam to the eye, and a control device adapted to operate the laser device, and
wherein the smart glasses are adapted to:
irradiate the at least one laser beam onto the eye,
detect an optical path length of the irradiated laser beam based on laser feedback interferometry of the irradiated laser beam and the portion of the laser beam backscattered from the eye,
detect a Doppler shift of the irradiated laser beam and the backscattered portion based on the laser feedback interferometry, and
detect an eye velocity based on the Doppler shift, and
wherein the input unit and/or output unit is operated based on the optical path length and/or the eye velocity, and
wherein triangle-modulated laser light is emitted as a wavelength-modulated laser beam, and wherein the optical path length is determined by analyzing the radiation which is interferingly emitted and backscattered by calculating an average of the resulting interference frequencies with respect to the two edges of the triangle-modulated signal.

14. The pair of smart glasses according to claim 13 , wherein the laser device comprises at least one surface emitter having a photodiode integrated therein.

15. The pair of smart glasses according to claim 14 , wherein the at least one surface emitter having a photodiode integrated therein is arranged on a spectacle frame, which especially surrounds a spectacle lens, and/or on a spectacle temple, and/or in a spectacle lens.

Assignees

• Bosch Gmbh Robert
• Trumpf Photonic Components Gmbh

Inventors

• Petersen Andreas
• Schlebusch Thomas Alexander
• Meyer Johannes
• Spruit Hans
• Hellmig Jochen

Classifications

• G02B2027/0147

  comprising a device modifying the resolution of the displayed image · CPC title

• G02B2027/0118

  comprising devices for improving the contrast of the display / brillance control visibility · CPC title

• G02B27/0093 Primary

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G02B27/0172

  characterised by optical features · CPC title