Adaptive gain adjustment for histogram equalization in an imaging system

Patent metadata

Field	Value
Publication number	US-11276152-B2
Application number	US-202016883871-A
Country	US
Kind code	B2
Filing date	May 26, 2020
Priority date	May 28, 2019
Publication date	Mar 15, 2022
Grant date	Mar 15, 2022

Abstract

Systems and methods may be provided that improve the application of Histogram Equalization (HE) transfer functions for converting image system source data to display compatible image frames. Histograms developed from source data may be measured and depending on their properties, the gain of the HE transfer function may be adaptively adjusted. In some embodiments the property measured is a histogram width.

First claim

What is claimed is:

1. A method for producing a display image from a source image in an imaging system, wherein the source image comprises frames of two dimensional array of digital pixel values, and the display image is a two dimensional array of digital pixel values derived from the source image and formatted for display, comprising:
producing a histogram of the source image, wherein the histogram is a plot of a number of pixels versus pixel value;
developing a transfer function converting the source image to the display image, wherein the transfer function is at least partially derived from Histogram Equalization (HE) techniques for the purpose of efficient utilization of available display levels, and the HE transfer function includes a gain term that can be adjusted;
determining one or more properties of the source histogram; and
adaptively adjusting the gain term of the transfer function based on the one or more properties of the histogram.

2. The method of claim 1 , wherein the source image pixels are a different digital word size than the display image pixels.

3. The method of claim 2 , wherein the display image pixel size is 8 bits, corresponding to display greyscale.

4. The method of claim 1 , wherein the histogram has a pixel value axis comprising sequential bins, wherein each bin comprises a range of possible pixel values, the number of bins is less than the number of possible pixel values, and the source pixels are allocated to the bins.

5. The method of claim 4 , wherein the pixel value range is greater than 13 bits and the number of bins is 4096.

6. The method of claim 4 , wherein the HE transfer function is derived from a histogram accumulation curve of the histogram, and the gain term is the maximum slope of the accumulation curve, for both full pixel histograms and pixel excluded histograms.

7. The method of claim 6 , wherein, for pixel excluded histograms, a pixel exclusion includes at least one of limiting the number of pixels allowed per bin or excluding pixels from a portion of at least one of the high or low end of the histogram.

8. The method of claim 1 wherein the one or more properties used to determine gain adjustment comprise a width of the histogram.

9. The method of claim 8 , wherein for histograms whose width is above a predetermined threshold, the gain is not adjusted, and for histograms below the threshold width, the gain is adjusted by a function of the width of the histogram.

10. The method of claim 1 , further comprising producing a display image frame histogram for displaying the display image, wherein the display image frame histogram is an alpha blend of a number of previous frame histograms with a current frame histogram, and a time for the current frame to update completely is a time period settable by a user.

11. A thermal imaging system for producing a display image from a source image, the thermal imaging system comprising an array of photodetectors, each photodetector configured to output image frames, whose pixels correspond to an acquired thermal intensity of a portion of an imaged scene, the pixels comprising a digital word whose value is an analog-to-digital conversion (ADC) of the intensity and wherein the digital word is within a conversion range of the system, the thermal imaging system further comprising at least one processor for acquiring and processing image data from the photodetector array, and a display for image data, the thermal imaging system configured to:
produce a histogram of the source image, wherein the histogram is a plot of a number of pixels versus pixel value;
develop a transfer function converting the source image to the display image, wherein the transfer function is at least partially derived from Histogram Equalization (HE) techniques for the purpose of efficient utilization of available display levels, and the HE transfer function includes a gain term that can be adjusted;
determine one or more properties of the source histogram; and
adaptively adjust the gain term of the transfer function based on the one or more properties of the histogram.

12. The system of claim 11 , wherein the source image pixels are a different digital word size than the display image pixels.

13. The system of claim 12 , wherein the display image pixel size is 8 bits, corresponding to display greyscale.

14. The system of claim 11 , wherein the histogram has a pixel value axis comprising sequential bins, wherein each bin comprises a range of possible pixel values, the number of bins is less than the number of possible pixel values, and the source pixels are allocated to the bins.

15. The system of claim 14 , wherein the pixel value range is greater than 13 bits and the number of bins is 4096.

16. The system of claim 14 , wherein the HE transfer function is derived from a histogram accumulation curve of the histogram, and the gain term is the maximum slope of the accumulation curve, for both full pixel histograms and pixel excluded histograms.

17. The system of claim 16 , wherein, for pixel excluded histograms, a pixel exclusion includes at least one of limiting the number of pixels allowed per bin or excluding pixels from a portion of at least one of the high or low end of the histogram.

18. The system of claim 11 wherein the one or more properties used to determine gain adjustment comprise a width of the histogram.

19. The system of claim 18 , wherein for histograms whose width is above a predetermined threshold, the gain is not adjusted, and for histograms below the threshold width, the gain is adjusted by a function of the width of the histogram.

20. The system of claim 11 , wherein the thermal imaging system is further configured to produce a display image frame histogram for displaying the display image, wherein the display image frame is an alpha blend of a number of previous frame histograms with a current frame histogram, and a time for the current frame to update completely is a time period settable by a user.

Assignees

• Seek Thermal Inc

Inventors

• Wolfe Jason
• Nehring Brian

Classifications

• G06T5/40 Primary

  using histogram techniques · CPC title

• G06T2207/10048

  Infrared image · CPC title

• G06T5/009

  Physics · mapped topic

• G06T5/92 Primary

  based on global image properties · CPC title