Image processing device and method to correct brightness signal of an input image

Patent metadata

Field	Value
Publication number	US-9349168-B2
Application number	US-201314380629-A
Country	US
Kind code	B2
Filing date	Feb 21, 2013
Priority date	Mar 2, 2012
Publication date	May 24, 2016
Grant date	May 24, 2016

Abstract

A region determination circuit ( 60 ) determines whether or not each of the pixels in an image is within a region subject to correction, in which pixels having at most a predetermined brightness level appear with a frequency equal to or less than a predetermined value. An offset level generation circuit ( 10 ) generates an offset level (Offset) on the basis of the brightness of the pixels determined to be within the region subject to correction. An offset subtraction circuit ( 1 ) subtracts the offset level (Offset) from the image signal (Yi) to generate an offset image signal (Yofst). A gain generation circuit ( 20 ) generates a gain for the offset image signal (Yofst). A gain multiplication circuit ( 2 ) multiplies the offset image signal (Yofst) by the gain to generate a corrected image signal (Ya).

First claim

What is claimed is:

1. An image processing method comprising:
a region decision step of deciding whether each pixel of an image represented by an image signal is disposed within a region subject to correction, in which pixels having at most a predetermined brightness level appear with a frequency equal to or less than a predetermined value;
an offset level generation step of generating an offset level on a basis of the brightness of those pixels in the image represented by the image signal which are determined in the region decision step to be within the region subject to correction;
an offset subtraction step of subtracting the offset level generated in the offset level generation step from the image signal to generate an offset image signal;
a gain generation step of generating a gain for the offset image signal; and
a gain multiplication step of multiplying the offset image signal by the gain to generate a corrected image signal;
a mixing ratio generation step of generating a mixing ratio for each pixel of the image represented by the image signal on a basis of a low brightness pixel ratio, which is a proportion of pixels having at most the predetermined brightness level to pixels surrounding said each pixel; and
a mixing step of mixing the image signal and the corrected image signal on a basis of the mixing ratio.

2. An image processing device comprising:
a region decision circuit for deciding whether each pixel of an image represented by an image signal is disposed within a region subject to correction, in which pixels having at most a predetermined brightness level appear with a frequency equal to or less than a predetermined value:
an offset level generation circuit for generating an offset level on a basis of the brightness of those pixels in the image represented by the image signal which are determined by the region decision circuit to be within the region subject to correction;
an offset subtraction circuit for subtracting the offset level generated by the offset level generation circuit from the image signal to generate an offset image signal;
a gain generation circuit for generating a gain for the offset image signal;
a gain multiplication circuit for multiplying the offset image signal by the gain to generate a corrected image signal;
a mixing ratio generation circuit for generating a mixing ratio for each pixel of the image represented by the image signal on a basis of a low brightness pixel ratio, which is a proportion of pixels having at most the predetermined brightness level to pixels surrounding said each pixel; and
a mixing circuit for mixing the image signal and the corrected image signal on a basis of the mixing ratio.

3. The image processing device of claim 2 , wherein the region decision circuit comprises:
a brightness level discrimination circuit for comparing the pixel value of each pixel of the image represented by the image signal with the predetermined brightness level and identifying pixels having at most the predetermined brightness level;
a pixel ratio calculation circuit for taking each pixel of the image represented by the image signal in turn as a pixel of interest and calculating the proportion of those pixels in a predetermined range of surrounding pixels centered on the pixel of interest, which are determined by the brightness level discrimination circuit as having at most the predetermined brightness level, as the low brightness ratio; and
a pixel-subject-to-correction designation circuit for deciding that each pixel is disposed within the region subject to correction if the low brightness pixel ratio of the pixel is equal to or less than a predetermined threshold, and outputting a signal indicating the decision result as a subject-to-correction identification signal.

4. The image processing device of claim 3 , wherein the mixing ratio generation circuit generates the mixing ratio by converting the low brightness pixel ratio calculated by the pixel ratio calculation circuit, in accordance with a predetermined conversion characteristic.

5. The image processing device of claim 4 , wherein the mixing ratio generation circuit has a conversion characteristic such that when the low brightness pixel ratio is equal to or more than a predetermined upper limit, the mixing ratio is 100%, and when the low brightness pixel ratio is within the range from 0% to the upper limit, the mixing ratio increases linearly from 0% to 100% as the low brightness pixel ratio increases.

6. The image processing device of claim 4 , wherein the mixing ratio generation circuit has a conversion characteristic such that when the low brightness pixel ratio is equal to or less than a predetermined lower limit, the mixing ratio is 0%, and when the low brightness pixel ratio is within the range from the lower limit to 100%, the mixing ratio increases linearly from 0% to 100% as the low brightness pixel ratio increases.

7. An image processing device comprising:
a region decision circuit for deciding whether each pixel of an image represented by an image signal is disposed within a region subject to correction, in which pixels having at most a predetermined brightness level appear with a frequency equal to or less than a predetermined value;
an offset level generation circuit for generating an offset level on a basis of the brightness of those pixels in the image represented by the image signal which are determined by the region decision circuit to be within the region subject to correction;
an offset subtraction circuit for subtracting the offset level generated by the offset level generation circuit from the image signal to generate an offset image signal;
a gain generation circuit for generating a gain for the offset image signal; and
a gain multiplication circuit for multiplying the offset image signal by the gain to generate a corrected image signal, wherein:
the gain generation circuit comprises
a white correction gain calculation circuit for generating a white correction gain on a basis of the offset level of the image signal and a predetermined target upper limit, and
an average brightness correction gain generation circuit for generating an average brightness correction gain on a basis of an average brightness value of the image signal, an average brightness value of the corrected image signal, and a color saturation correction level; and
the gain multiplication circuit comprises
a white correction gain brightness multiplication circuit for multiplying the offset image signal by the white correction gain to generate a white corrected image signal, and
an average brightness correction gain brightness multiplication circuit for multiplying the white corrected image signal by the average brightness correction gain to generate an average brightness corrected image signal.

8. The image processing device of claim 7 , wherein the average brightness correction gain generation circuit comprises:
an average pre-correction brightness value calculation circuit for generating an average brightness value of the image signal;
an average post-correction brightness value calculation circuit for generating an average brightness value of the corrected image signal;
a representative primary color signal pixel value generation circuit for converting the corrected image signal to three primary color signals and generating their maximum value for each pixel;
a color saturated pixel counting circuit for counting, for each frame, the number of color saturated pixels having a maximum value equal to or greater than a predetermined level;
a color saturation correction level generation circuit for generating a color saturation correction level on a basis of the number of color saturated pixels and the maximum values; and
an average brightness

Assignees

• ONDA Tsubasa
• Toyoda Yoshitaka
• Suzuki Daisuke
• Yamashita Koichi
• Matoba Narihiro
• Mitsubishi Electric Corp

Inventors

• ONDA Tsubasa
• Toyoda Yoshitaka
• Suzuki Daisuke
• Yamashita Koichi
• Matoba Narihiro

Classifications

• H04N23/741

  by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors · CPC title

• H04N23/70

  Circuitry for compensating brightness variation in the scene · CPC title

• H04N9/73

  Colour balance circuits, e.g. white balance circuits or colour temperature control (camera processing pipelines for colour balance H04N23/88) · CPC title

• G06T5/009 Primary

  Physics · mapped topic

• H04N1/6027 Primary

  Correction or control of colour gradation or colour contrast (H04N1/6058 takes precedence) · CPC title