Local contrast adjustment for digital images

Patent metadata

Field	Value
Publication number	US-9727954-B2
Application number	US-201514817989-A
Country	US
Kind code	B2
Filing date	Aug 4, 2015
Priority date	Aug 5, 2014
Publication date	Aug 8, 2017
Grant date	Aug 8, 2017

Abstract

Edge enhancement of a digital image can include using at least two signal processing paths to adjust a display-formatted pixel value to enhance the appearance of edges in displayed image data. A digital image can be filtered by producing an edge enhancement factor, α, per pixel from at least one look up table (LUT). Digital image data can also be adjusted using at least two signal processing paths, where the image data is adjusted if a pixel value and its neighboring pixel values are all within a smoothing range or where the pixel delta value is outside of a bad pixel range and its neighboring pixel delta values are all within the bad pixel range. In such cases, the image data can be adjusted by replacing the pixel value with an average or median value of the neighboring pixels.

First claim

What is claimed is:

1. A method for performing efficient edge enhancement of a digital image representing data from an infrared sensor, wherein the method is performed by a processor operating in association with a memory storing a computer program and at least one look up table (LUT), the method comprising;
receiving, by the processor, image data acquired with an infrared sensor, the image data comprising an imaging array of pixel values, P ij ;
formatting for display, using a first signal processing path of the processor, individual pixel values of the imaging array to generate an array of display-formatted pixel values, Pd ij ;
for individual pixels in the imaging array, determining, using a second signal processing path of the processor operating parallel to the first signal processing path, an average or median pixel value, Pave ij , by averaging the values of pixels surrounding the individual pixel;
for individual pixels in the imaging array, retrieving an edge enhancement factor, α ij , from the at least one look up table (LUT) based on the value of the individual pixel, P ij , and at least one of an average or median pixel value, Pave ij , or an adjusted pixel value, Δ ij , where the adjusted pixel value is a difference between the pixel value, P ij , and the average or median pixel value, Pave ij ;
for individual display-formatted pixel values, multiplying each image display-formatted pixel value, Pd ij , by the edge enhancement factor, α ij , to generate an enhanced display-formatted array of pixel values, Pe ij ; and
displaying an enhanced image based on the enhanced display-formatted array of pixel values, Pe ij , on a display.

2. The method of claim 1 , wherein formatting for display comprises utilizing histogram equalization based methods (HEBM) where Pd ij is grey scale display-formatted data.

3. The method of claim 1 , wherein the edge enhancement factor is 1 if the adjusted pixel value, Δ ij , is within a noise range N.

4. The method of claim 3 , wherein the noise range N is symmetrical about 0 such that the adjusted pixel value, Δ ij , is within the noise range N when −Nr≦Δ ij ≦Nr.

5. The method of claim 4 , wherein the edge enhancement factor, α ij , is set to 1 without performing a LUT operation to retrieve the edge enhancement factor, α ij , if the adjusted pixel value, Δ ij , is within the noise range N, wherein the LUT does not contain entries for the case where −Nr<Δ ij <Nr.

6. The method of claim 4 , wherein the value of Nr is between 1 and 10 counts.

7. The method of claim 4 , wherein the edge enhancement factor, α ij , is set to a constant value if the adjusted pixel value, Δ ij , is outside an enhancement limit range M.

8. The method of claim 7 , wherein the enhancement limit range M is symmetrical about 0 such that the adjusted pixel value, Δ ij , is within the enhancement range M when −Mr≦Δ ij ≦Mr.

9. The method of claim 8 , wherein the edge enhancement factor, α ij , is directly set to a constant value without performing a LUT operation to retrieve the edge enhancement factor, α ij , if the adjusted pixel value, Δ ij , is outside the enhancement limit range M, wherein the LUT does not contain entries for the cases where Δ ij <−Mr and Δ ij >Mr.

10. The method of claim 9 , wherein the edge enhancement factor, α ij , is set to a value C L if Δ ij <−Mr, set to a value C H if Δ ij >+Mr, set to a value that varies from C L to 1 when −Mr<Δ ij <−Nr, and set to a value that varies from 1 to C H when +N r <Δ ij <+M r .

11. The method of claim 10 , wherein the LUT uses as input a normalized, adjusted pixel value, Δ ij /Pave ij .

12. The method of claim 10 , wherein C L is 0.25 and C H is 4.

13. The method of claim 10 , wherein C L is 0.5 and C H is 2.

14. The method of claim 3 , wherein the noise range N is configured to discriminate between noise/low variation regions and true edges.

15. The method of claim 1 , wherein the LUT uses as input a normalized, adjusted pixel value, Δ ij /Pave ij .

16. The method of claim 1 further comprising, using the second signal processing path:
looking up values of 1/Pave ij in a Pave lookup table for individual pixels;
calculating a normalized, adjusted pixel value, Δ ij /Pave ij ; and
looking up values of the edge enhancement factor, α ij , for individual pixels, the edge enhancement factor, α ij , corresponding to the adjusted pixel value, Δ ij /Pave ij , in the LUT different from the Pave lookup table.

17. The method of claim 16 further comprising converting the imaging array of pixel values, P ij to a corresponding array of 32-bit fixed point formatted values for processing in fixed point arithmetic.

18. The method of claim 17 further comprising adding 1 to Δ ij /Pave ij and looking up values of the edge enhancement factor, α ij , corresponding to 1+Δ ij /Pave ij in the LUT.

19. The method of claim 1 , wherein the infrared sensor comprises an infrared focal plane array in a thermal imaging camera.

Assignees

• Seek Thermal Inc

Inventors

• Engberg Andreas
• Parrish William J

Classifications

• H04N1/4092

  Edge or detail enhancement · CPC title

• G06T2207/10048

  Infrared image · CPC title

• H04N5/21

  Circuitry for suppressing or minimising disturbance, e.g. moiré or halo · CPC title

• H04N5/142

  Edging; Contouring · CPC title

• G06T2207/20192

  Edge enhancement; Edge preservation · CPC title