Method for controlling read-out from a digital image sensor

Patent metadata

Field	Value
Publication number	US-11438542-B2
Application number	US-202016906228-A
Country	US
Kind code	B2
Filing date	Jun 19, 2020
Priority date	Jun 19, 2019
Publication date	Sep 6, 2022
Grant date	Sep 6, 2022

Abstract

A computer implemented method for controlling read-out from a digital image sensor device, comprising a plurality of pixels, the method comprising the steps of setting a first read-out scheme, based on a first level of pixel binning and/or pixel skipping, reading, based on the first read-out scheme, from the digital image sensor device, a first image, determining an exposure value for the first image, based on the intensity value of each one of the first plurality of regions of the first image and comparing the exposure value with a predetermined maximum value. A second read-out scheme based on a second level of pixel binning and/or pixel skipping is set. The level of pixel binning and/or pixel skipping in the second read-out scheme is increased compared to the first read-out scheme, if the exposure value is higher than the predetermined maximum value. Based on the second read-out scheme, a subsequent second image is read. A system configured to perform the method is also described.

First claim

The invention claimed is:

1. A computer implemented method for controlling read-out from a digital image sensor device, comprising a plurality of pixels, the method comprising the steps of:
setting a first read-out scheme, defining a first plurality of regions to be read based on a first level of pixel binning and/or pixel skipping,
reading, based on the first read-out scheme, from the digital image sensor device, a first image, comprising an intensity value of each one of the first plurality of regions of the first image,
determining an exposure value for the first image, based on the intensity value of each one of the first plurality of regions of the first image,
comparing the exposure value with a predetermined maximum value,
setting a second read-out scheme defining a second plurality of regions to be read based on a second level of pixel binning and/or pixel skipping, wherein the level of pixel binning and/or pixel skipping in the second read-out scheme is increased compared to the first read-out scheme, if the exposure value is higher than the predetermined maximum value;
reading, based on the second read-out scheme, from the digital image sensor device, a subsequent second image, comprising an intensity value of each one of the second plurality of regions of the second image, and;
comparing the exposure value with a predetermined minimum value, wherein the level of pixel binning and/or pixel skipping in the second read-out scheme is decreased compared to the first read-out scheme, if the exposure value is lower than the predetermined minimum value.

2. The method according to claim 1 , wherein the level of pixel binning and/or pixel skipping of the first read-out scheme is maintained in the second read-out scheme, if the exposure value is between the predetermined minimum value and the predetermined maximum value.

3. The method according to claim 1 , wherein the step of determining an exposure value comprises determining the maximum intensity value of any of the plurality of regions.

4. The method according to claim 1 , wherein the step of determining an exposure value comprises determining the average intensity value for the plurality of regions.

5. The method according to claim 1 , wherein the step of determining an exposure value comprises calculating an exposure value from the intensity values using a predetermined function of the intensity values.

6. The method according to claim 1 , wherein the step of determining an exposure value comprises determining the number of regions having an intensity value above a threshold value.

7. The method according to claim 1 , wherein, in the step of setting a second read-out scheme when the exposure value is higher than the predetermined maximum value, no more than one of the level of pixel binning and the level of pixel skipping is increased compared to the first read-out scheme.

8. The method according to claim 1 , wherein, in the step of setting a second read-out scheme when the exposure value is lower than the predetermined minimum value, no more than one of the level of pixel binning and the level of pixel skipping is decreased compared to the first read-out scheme.

9. The method according to claim 1 , comprising the step of adding digital gain and/or offset for the intensity values.

10. The method according to claim 1 , wherein the images are used for eye tracking.

11. The method according to claim 1 , wherein the digital image sensor device is configured with a rolling shutter and global reset.

12. A non-transitory computer-readable storage medium storing a computer program for controlling a digital image sensor device, the computer program comprising instructions which, when executed by at least one processor cause the at least one processor to carry out the steps of:
setting a first read-out scheme, defining a first plurality of regions to be read based on a first level of pixel binning and/or pixel skipping,
reading, based on the first read-out scheme, from the digital image sensor device, a first image, comprising an intensity value of each one of the first plurality of regions of the first image,
determining an exposure value for the first image, based on the intensity value of each one of the first plurality of regions of the first image,
comparing the exposure value with a predetermined maximum value,
setting a second read-out scheme defining a second plurality of regions to be read based on a second level of pixel binning and/or pixel skipping, wherein the level of pixel binning and/or pixel skipping in the second read-out scheme is increased compared to the first read-out scheme, if the exposure value is higher than the predetermined maximum value;
reading, based on the second read-out scheme, from the digital image sensor device, a subsequent second image, comprising an intensity value of each one of the second plurality of regions of the second image, and;
comparing the exposure value with a predetermined minimum value, wherein the level of pixel binning and/or pixel skipping in the second read-out scheme is decreased compared to the first read-out scheme, if the exposure value is lower than the predetermined minimum value.

13. A system comprising a digital image sensor device, comprising a plurality of pixels, and a processor configured to:
set a first read-out scheme, defining a first plurality of regions to be read based on a first level of pixel binning and/or pixel skipping,
read, based on the first read-out scheme, from the digital image sensor device, a first image, comprising an intensity value of each one of the first plurality of regions of the first image,
determine an exposure value for the first image, based on the intensity value of each one of the plurality of regions of the image,
compare the exposure value with a predetermined maximum value,
set a second read-out scheme defining a second plurality of regions to be read based on a second level of pixel binning and/or pixel skipping, wherein the level of pixel binning and/or pixel skipping in the second read-out scheme is increased compared to the first read-out scheme, if the exposure value is higher than the predetermined maximum value;
read, based on the second read-out scheme, from the digital image sensor device, a subsequent second image comprising an intensity value of each one of the second plurality of regions of the second image, and;
comparing the exposure value with a predetermined minimum value, wherein the level of pixel binning and/or pixel skipping in the second read-out scheme is decreased compared to the first read-out scheme, if the exposure value is lower than the predetermined minimum value.

Assignees

• Tobii Ab

Inventors

• Ollesson Niklas
• Ivarsson Magnus
• Åberg Viktor
• Redz Anna

Classifications

• G06T7/20 Primary

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• H04N25/583

  with different integration times · CPC title

• H04N25/531 Primary

  by controlling rolling shutters in CMOS SSIS · CPC title

• H04N25/445

  by skipping some contiguous pixels within the read portion of the array · CPC title

• H04N25/46

  by combining or binning pixels · CPC title