High dynamic-range image sensor

Patent metadata

Field	Value
Publication number	US-10798322-B2
Application number	US-201816140862-A
Country	US
Kind code	B2
Filing date	Sep 25, 2018
Priority date	Dec 4, 2013
Publication date	Oct 6, 2020
Grant date	Oct 6, 2020

Abstract

A pixel array within an integrated-circuit image sensor is exposed to light representative of a scene during a first frame interval and then oversampled a first number of times within the first frame interval to generate a corresponding first number of frames of image data from which a first output image may be constructed. One or more of the first number of frames of image data are evaluated to determine whether a range of luminances in the scene warrants adjustment of an oversampling factor from the first number to a second number, if so, the oversampling factor is adjusted such that the pixel array is oversampled the second number of times within a second frame interval to generate a corresponding second number of frames of image data from which a second output image may be constructed.

First claim

What is claimed is:

1. A method of operation within an integrated-circuit image sensor having a pixel array, the method comprising:
exposing the pixel array to light representative of a scene during first and second frame intervals of equal duration;
oversampling the pixel array a first number of times within the first frame interval to generate a corresponding first number of frames of image data from which a first output image may be constructed;
evaluating one or more of the first number of frames of image data to determine whether a range of luminances in the scene warrants adjustment of an oversampling factor from the first number to a different second number; and
oversampling the pixel array the second number of times within the second frame interval to generate a corresponding second number of frames of image data from which a second output image may be constructed if the range of luminances in the scene is determined to warrant adjustment of the oversampling factor.

2. The method of claim 1 wherein evaluating one or more of the first number of frames of image data comprises generating statistics regarding the range of luminances within the scene.

3. The method of claim 2 wherein generating statistics regarding the range of luminances within the scene comprises counting, within the one or more of the first number of frames of image data, occurrences of pixel values within pixel-value ranges that correspond to respective luminance ranges.

4. The method of claim 3 wherein counting occurrences of pixel values within pixel-value ranges that correspond to respective luminance ranges comprises generating respective counts of occurrences of the pixel values within the pixel value ranges for each of a plurality of colors of a color filter array.

5. The method of claim 1 further comprising evaluating the one or more of the first number of frames of image data to determine whether the range of luminances in the scene warrants adjustment of (i) the second frame interval such that the second frame interval is longer or shorter than the first frame interval, (ii) a lens aperture or (iii) a signal gain applied when sampling individual pixels of the pixel array.

6. The method of claim 1 wherein oversampling the pixel array the first number of times to generate the first number of frames of image data comprises generating each of the first number of frames of image data in accordance with a first scan sequence definition selected from a predetermined set of scan sequence definitions, and oversampling the pixel array the second number of times to generate the second number of frames of image data comprises generating each of the second number of frames of image data in accordance with a second scan sequence definition selected from the predetermined set of scan sequence definitions.

7. The method of claim 6 wherein each scan sequence definition within the predetermined set of scan sequence definitions, including the first and second scan sequence definitions, indicates, as an oversampling factor for the scan sequence, a number of frames of image data to be generated and respective subexposure durations corresponding to each of the frames of image data.

8. The method of claim 7 wherein the subexposure durations indicated by each scan sequence definition within the predetermined set of scan sequence definitions sum to a frame-interval duration that matches the duration of each of the first and second frame intervals.

9. The method of claim 8 wherein each of the scan sequence definitions which indicate that the pixel array is to be oversampled during the frame-interval duration constitute respective oversampling scan sequence definitions, each of the oversampling scan sequence definitions specifying at least one long subexposure and a nonzero number of short subexposures that is different from the number of short subexposures within at least one other of the oversampling scan sequence definitions.

10. The method of claim 9 wherein the at least one long subexposure duration is specified to be the same in each of the oversampling scan sequence definitions, and wherein the duration of each of the nonzero number of short subexposures for at least one of the oversampling scan sequence definitions is uniform and different from a uniform duration of each of the nonzero number of short subexposures for at least one other of the oversampling scan sequence definitions.

11. An integrated-circuit image sensor comprising:
a pixel array; and
read-out circuitry to:
expose the pixel array to light representative of a scene during first and second frame intervals of equal duration;
oversample the pixel array a first number of times within the first frame interval to generate a corresponding first number of frames of image data from which a first output image may be constructed;
evaluate one or more of the first number of frames of image data to determine whether a range of luminances in the scene warrants adjustment of an oversampling factor from the first number to a different second number; and
oversample the pixel array the second number of times within the second frame interval to generate a corresponding second number of frames of image data from which a second output image may be constructed if the range of luminances in the scene is determined to warrant adjustment of the oversampling factor.

12. The integrated-circuit image sensor of claim 11 wherein the read-out circuitry to evaluate one or more of the first number of frames of image data comprises histogram circuitry to generate statistics regarding the range of luminances within the scene.

13. The integrated-circuit image sensor of claim 12 wherein the histogram circuitry to generate statistics regarding the range of luminances within the scene comprises circuitry to count, within the one or more of the first number of frames of image data, occurrences of pixel values within pixel-value ranges that correspond to respective luminance ranges.

14. The integrated-circuit image sensor of claim 13 wherein the circuitry to count occurrences of pixel values within pixel-value ranges that correspond to respective luminance ranges comprises circuitry to generate respective counts of occurrences of the pixel values within the pixel value ranges for each of a plurality of colors of a color filter array.

15. The integrated-circuit image sensor of claim 11 wherein the read-out circuitry comprises auto-exposure control circuitry to evaluate the one or more of the first number of frames of image data to determine whether the range of luminances in the scene warrants adjustment of (i) the second frame interval such that the second frame interval is longer or shorter than the first frame interval, (ii) a lens aperture or (iii) a signal gain applied when sampling individual pixels of the pixel array.

16. The integrated-circuit image sensor of claim 11 wherein the read-out circuitry to oversample the pixel array the first number of times and the second number of times comprises scan sequence selection circuitry to generate each of the first number of frames of image data and second number of frames of image data in accordance with respective first and second scan sequence definitions selected from a predetermined set of scan sequence definitions.

17. The integrated-circuit image sensor of claim 16 wherein each scan sequence definition within the predetermined set of scan sequence definitions, including the first and second scan sequence definitions, indicates, as an oversampling factor for the scan sequence, a number of frames of image data to be generated

Assignees

• Rambus Inc

Inventors

• Smith Craig M
• Armstrong Frank
• Endsley Jay
• Vogelsang Thomas
• Harris James E
• Ladd John
• Guidash Michael

Classifications

• H04N25/46

  by combining or binning pixels · CPC title

• H04N25/134

  based on three different wavelength filter elements · CPC title

• H04N23/843

  Demosaicing, e.g. interpolating colour pixel values · CPC title

• H04N25/70

  SSIS architectures; Circuits associated therewith · CPC title

• H04N25/57

  Control of the dynamic range · CPC title