Optical eye tracking

Patent metadata

Field	Value
Publication number	US-11740692-B2
Application number	US-201414537818-A
Country	US
Kind code	B2
Filing date	Nov 10, 2014
Priority date	Nov 9, 2013
Publication date	Aug 29, 2023
Grant date	Aug 29, 2023

Abstract

Methods, systems, and devices are disclosed for optical sensing and tracking of eye movement. In one aspect, a method for tracking the movement of an eye includes emitting a first modulated light and a second modulated light toward an eye of a user, wherein the first modulated light and the second modulated light have substantially the same modulation frequency, but the modulation phases of the two modulated lights are substantially opposite to each other; receiving at a photodetector module a returned light including at least a partial retroreflected light from the eye of the user based on the first and second modulated lights; and processing the output signal from the photodetector module to determine positional and dimensional parameters of the eye of the user based at least on the partial retroreflected light corresponding to the first and second modulated lights.

First claim

What is claimed are techniques and structures as described and shown, including:

1. A method for controlling a cursor on a display screen based at least partly on detection of an eye gaze of a user with respect to the display screen, comprising:
presenting a display interface on the display screen to the user;
emitting a first modulated light from a first group of light sources positioned to be coaxial with a photodetector, wherein the first modulated light is modulated according to a first frequency;
emitting a second modulated light from a second group of light sources positioned along a periphery of a display screen, wherein the second modulated light is modulated according to a second frequency, wherein the second frequency is a different frequency from the first frequency;
generating, by the photodetector positioned to receive a first light from the first group of light sources retroreflected from a retina of an eye, a first signal;
receiving, by the photodetector, images of reflections of the second group of light sources from a cornea of the eye;
demodulating the first signal according to the first frequency to generate a first demodulated signal;
demodulating the second modulated light in the images according to the second frequency to generate demodulated images;
processing the first demodulated signal to determine first center coordinates of a pupil of the eye;
processing the demodulated images to determine second center coordinates of the display interface on the eye, wherein the second center coordinates of the display interface on the eye are determined from a center location of the images of reflections of the second group of light sources from the cornea;
comparing the determined first center coordinates and the determined second center coordinates to determine a gaze point of the eye on the display interface, wherein in a case that the first center coordinates are below the second center coordinates, the gaze point is below a center of the display screen, and in another case that the first center coordinates are above the second center coordinates, the gaze point is above the center of the display screen; and
displaying, on the display interface, the cursor based on the determined gaze point.

2. The method of claim 1 , wherein the first group of light sources is modulated according to a first modulation and the second group of light sources is modulated according a second modulation, wherein the first modulation and the second modulation differ in at least a frequency, and wherein the eye pupil center coordinates and the screen center coordinates are determined at substantially the same time.

3. The method of claim 1 , further comprising:
adjusting a position of the cursor on the display screen based on updated coordinates of the gaze point.

4. The method of claim 1 , wherein a first and a second scattered lights are generated when the first and second modulated lights scatter off a face and other surfaces near the face.

5. The method of claim 4 , wherein the first frequency at which the first group of light sources is modulated is the same as the second frequency at which the second group of light sources is modulated, and wherein the first modulation and the second modulation differ by a phase of 180 degrees.

6. A portable device for high speed communication with another portable device, comprising:
a front panel including a display screen;
a first group of light sources positioned to be coaxial with a multi-element sensor and positioned outside the display screen, the first group of light sources configured to emit first modulated light modulated at a first frequency;
a second group of light sources positioned along a periphery of the display screen and positioned inside the display screen, the second group of light sources configured to emit second modulated light modulated at a second frequency, wherein at least one light source of the first group or the second group is operable to transmit data to the other portable device by emitting a light beam carrying a data signal toward the other portable device,
wherein the multi-element sensor is positioned on the front panel outside of the display screen, wherein the multi-element sensor is configured to receive a light beam carrying another data signal emitted by the other portable device, wherein the multi-element sensor is positioned to receive a first light from the first group of light sources retroreflected from a retina of an eye,
wherein a signal representative of the first modulated light retroreflected from the retina is demodulated according to the first frequency rejecting signals not modulated at the first frequency, and from the demodulated signal first center coordinates of a pupil of the eye are determined,
wherein second center coordinates of the display screen on the eye are determined from a center location of images of reflections of the second group of light sources from a cornea of the eye, and wherein second signals corresponding to the images are demodulated according to the second frequency rejecting signals not modulated at the second frequency, and wherein a gaze point of the eye on the display screen is determined by comparing the first center coordinates to the second center coordinates.

7. The portable device of claim 6 , wherein more than one of the first group and the second group of light sources is used as a different communication channel for data transmission.

8. The portable device of claim 7 , wherein different sensor elements in the multi-element sensor represent detectors for the different communication channels.

9. The portable device of claim 6 , wherein the first group and the second group of light sources and the multi-element sensor are collectively used to perform eye pupil detection and eye-track functions.

10. The portable device of claim 6 , wherein the portable device includes a mobile phone.

11. The portable device of claim 6 , wherein the portable device includes a tablet computer.

12. The portable device of claim 6 , wherein the portable device includes a portable computer.

13. The portable device of claim 6 , wherein the portable device includes a laptop.

14. The portable device of claim 6 , wherein in a case that the first center coordinates are below the second center coordinates, the gaze point is below a center of the display screen, and in another case that the first center coordinates are above the second center coordinates, the gaze point is above the center of the display screen.

Assignees

• Shenzhen Goodix Tech Co Ltd

Inventors

• He Yi
• Pi Bo

Classifications

• A61B3/113 Primary

  for determining or recording eye movement · CPC title

• A61B3/0041

  characterised by display arrangements · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title