Controlling settings of an image sensor device in an eye tracking system

Patent metadata

Field	Value
Publication number	US-11632501-B2
Application number	US-202017128896-A
Country	US
Kind code	B2
Filing date	Dec 21, 2020
Priority date	Dec 20, 2019
Publication date	Apr 18, 2023
Grant date	Apr 18, 2023

Abstract

There is provided a method, system, and non-transitory computer-readable storage medium for controlling the exposure settings of an rolling shutter image sensor device with global reset. This is achieved by obtaining a first image captured by the image sensor device at a current exposure setting that comprises a partial readout parameter representing a number image parts for partial readout by the image sensor device; determining an intensity value of the first image, comparing the intensity value of the first image to a desired intensity value. If the intensity values differ more than an allowed deviation, an updated number of image parts for partial readout is determined based on the current number of image parts and the intensity value of the first image. Thereafter, the current exposure setting is updated by setting the value of the partial readout parameter to the updated number of image parts.

First claim

The invention claimed is:

1. A computer implemented method for controlling the exposure settings of an image sensor device associated with an eye tracking system, the image sensor device being a rolling shutter image sensor device with global reset comprising an image sensor of i*j pixels, the method comprising:
obtaining, in the eye tracking system, a first image comprising i*j pixels captured using the image sensor device at a current exposure setting, wherein the current exposure setting comprises a partial readout parameter, PR, having a value that corresponds to a number, N, of image parts, I PART(1 . . . N) , for partial readout by the image sensor device, the number of image parts, N, being an integer ≥1;
determining, by processing circuitry in the eye tracking system, an intensity value, I 1 , of the first image;
comparing, by the processing circuitry, the intensity value, I 1 , of the first image to a preset desired intensity value, I des ; and
if the intensity value, I 1 , of the first image differs more than a preset allowed deviation, d, from the preset desired intensity value, I des :
determining, by the processing circuitry, an updated number, N updated , of image parts for partial readout by the image sensor device based on the current number of image parts and the intensity value, I 1 , of the first image, the updated number of image parts, N updated being an integer ≥1; and
updating, by the processing circuitry, the current exposure setting by setting the value of the partial readout parameter, PR, to the updated number, N updated , of image parts.

2. The method of claim 1 , further comprising performing the method steps of claim 1 repeatedly until the intensity value, I 1 , of the first image is within the preset allowed deviation, d, from the preset desired intensity value, I des .

3. The method of claim 1 , wherein the method further comprises:
reading out a number of image parts, I PART(1 . . . N) , one at a time, by the image sensor device, wherein the number of image parts corresponds to the value of the partial readout parameter, PR; and
generating a second image by combining, by the processing circuitry, the read out image parts, I PART(1 . . . N) , into a combined image of i*j pixels.

4. The method of claim 1 , wherein the determining, by the processing circuitry, the updated number, N updated , of image parts for partial readout by the image sensor device based on the current number of image parts and the intensity value, I 1 , of the first image comprises:
obtaining, by the processing circuitry, a factor α, the factor α being a numeric value; and
if I des >I 1 , setting, by the processing circuitry, the updated number, N updated , of image parts to: N updated =round(N*α); or
if I des <I 1 , setting, by the processing circuitry, the updated number, N updated , of image parts to: N updated =round(N/α).

5. The method of claim 1 , wherein the determining, by the processing circuitry, the updated number, N updated , of image parts for partial readout by the image sensor device based on the current number of image parts and the intensity value, I 1 , of the first image comprises:
determining, by the processing circuitry, a factor α=I des /I 1 ; and
setting, by the processing circuitry, the updated number, N updated , of image parts to: N updated =round(N*α).

6. The method of claim 4 , wherein obtaining the factor α, by the processing circuitry, comprises receiving input indicative of the factor α via a user input device.

7. The method of claim 4 , wherein obtaining the factor α, by the processing circuitry, comprises receiving or retrieving a preset factor α from a memory comprised in or communicatively connected to the eye tracking system.

8. The method of claim 1 , wherein determining the intensity value, I 1 , of the first image comprises setting, by the processing circuitry, the intensity value, I 1 , of the first image to the X th percentile of a histogram of the intensities of the first image, X being a preset percentage between 0% and 100%.

9. The method of claim 1 , wherein the image parts, I PART(1 . . . N) , are non-overlapping.

10. An eye tracking system configured to control the exposure settings of an image sensor device, the system comprising:
an image sensor device in the form of a rolling shutter image sensor device with global reset comprising an image sensor of i*j pixels, the image sensor device being configured to perform partial readouts; and
processing circuitry;
wherein the eye tracking system is configured to obtain a first image comprising i*j pixels captured using the image sensor device at a current exposure setting, wherein the current exposure setting comprises a partial readout parameter, PR, having a value that correspond to a number, N, of image parts, I PART(1 . . . N) , for partial readout by the image sensor device, the number of image parts, N, being an integer ≥1;
wherein the processing circuitry is configured to:
determine an intensity value, I 1 , of the first image;
compare the intensity value, I 1 , of the first image to a preset desired intensity value, I des ; and
if the intensity value, I 1 , of the first image differs more than a preset allowed deviation, d, from the preset desired intensity value, I des :
determine an updated number, N updated , of image parts for partial readout by the image sensor device based on the current number of image parts and the intensity value, I 1 , of the first image, the updated number of image parts, N updated being an integer ≥1; and
update the current exposure setting by setting the value of the partial readout parameter, PR, to the updated number, N updated , of image parts.

11. The eye tracking system of claim 10 , further being configured to repeat the steps of:
reading out a number of image parts, IPART (1 . . . N), one at a time, by the image sensor device, wherein the number of image parts corresponds to the value of the partial readout parameter, PR; and
generating a second image by combining, by the processing circuitry, the read out image parts, IPART(1 . . . N), into a combined image of i*j pixels until the intensity value, I 1 , of the first image is within the preset allowed deviation, d, from the preset desired intensity value, I des .

12. The eye tracking system of claim 10 , wherein the image sensor device is further configured to read out a number of image parts, I PART(1 . . . N) , one at a time, wherein the number of image parts corresponds to the value of the partial readout parameter, PR; and wherein the processing circuitry is further configured to generate a second image by combining the read out image parts, I PART(1 . . . N) , into a combined image of i*j pixels.

13. The eye tracking system of claim 10 , wherein the processing circuitry is configured to determine the updated number, N updated , of image parts for partial readout by the image sensor device based on the current number of image parts and the intensity value, I 1 , of the first image by:
obtaining a factor α, the factor α being a numeric value; and
if I des >I 1 , setting the updated number, N updated , of image parts to: N updated =round(N*α); or
if I des <I 1 , setting the updated number, N updated , of image parts to: N updated =round(N/α).

14. The eye tracking system of claim 10 , wherein the processing circuitry is configured to determine the updated number, N updated , of image parts for partial readout by the image sensor device based on the current number of image parts and the intensity value, I 1 , of the first image by:
determining a factor α=I des /I 1 ; and
setting the updated number, N updated , o

Assignees

• Tobii Ab
• Tobil AB

Inventors

• Åberg Viktor
• Ollesson Niklas
• Redz Anna
• Ivarsson Magnus

Classifications

• H04N23/71

  Circuitry for evaluating the brightness variation · CPC title

• H04N23/60 Primary

  Control of cameras or camera modules · CPC title

• H04N23/73 Primary

  by influencing the exposure time · CPC title

• H04N25/531

  by controlling rolling shutters in CMOS SSIS · CPC title

• H04N23/611

  where the recognised objects include parts of the human body · CPC title