Image processing apparatus, imaging device, image processing method, and computer-readable recording medium

Patent metadata

Field	Value
Publication number	US-9357144-B2
Application number	US-201314370280-A
Country	US
Kind code	B2
Filing date	Jan 4, 2013
Priority date	Jan 6, 2012
Publication date	May 31, 2016
Grant date	May 31, 2016

Abstract

An image processing apparatus includes a decimating unit configured to decimate pixels in a target image to obtain a decimated image containing a smaller number of pixels than the target image; an extracting unit configured to extract similar pixels at each of which a similarity to a pixel of interest is a threshold or more, from a region containing the pixel of interest among pixels of the decimated image; a first calculating unit configured to calculate a correction candidate value based on pixel values of the similar pixels; a second calculating unit configured to calculate a correction candidate value for each decimated pixel, based on the correction candidate value calculated for each pixel of the decimated image; and a correcting unit configured to correct a target pixel value of a target pixel in the target image, based on the correction candidate value calculated by the first or second calculating unit.

First claim

The invention claimed is:

1. An image processing apparatus comprising:
circuitry configured to:
decimate pixels in a target image to be processed to obtain a decimated image containing a smaller number of pixels than the target image;
extract similar pixels at each of which a similarity to a pixel of interest to be processed is equal to or greater than a first threshold, from a region containing the pixel of interest among pixels contained in the decimated image;
calculate a first correction candidate value used to correct a pixel value, based on pixel values of the similar pixels;
calculate a second correction candidate value for each of the pixels, based on the first correction candidate value calculated for each of the pixels contained in the decimated image;
calculate a weight coefficient of a target pixel value and the first or second correction candidate value of the target pixel, based on the first or second correction candidate value of the target pixel, wherein the target pixel value is a value of a target pixel to be corrected in the target image; and
correct the target pixel value of the target pixel, based on the first correction candidate value or the second correction candidate value, wherein the target pixel value is corrected by performing weighted addition of the target pixel value and the first or second correction candidate value by using the weight coefficient.

2. The image processing apparatus according to claim 1 , wherein the circuitry is further configured to extract a low-frequency component having a predetermined frequency or smaller from the target image,
wherein, when decimating the pixels, the circuitry is further configured to decimate a pixel corresponding to the low-frequency component from the target image to obtain the decimated image.

3. The image processing apparatus according to claim 2 , wherein, when calculating the first correction candidate value, the circuitry is further configured to calculate a mean of the pixel values of the similar pixels as the first correction candidate value.

4. The image processing apparatus according to claim 3 , wherein the circuitry is further configured to:
store therein a noise variance estimating function indicating a relationship between the first or second correction candidate value of the target pixel and noise variance values of the similar pixels of the target pixel; and
calculate a noise variance value of the target pixel based on the first or second correction candidate value and the noise variance estimating function,
wherein, when calculating the weight coefficient, the circuitry is further configured to calculate the weight coefficient based on the noise variance value.

5. The image processing apparatus according to claim 4 , wherein the circuitry is further configured to:
calculate a mean square of the pixel values of the extracted similar pixels for each of the pixels contained in the decimated image;
calculate a pixel variance value for the pixel value of each of the pixels in the decimated image, based on the mean square of each of the pixels contained in the decimated image; and
calculate a pixel variance value for each of the decimated pixels, based on the pixel variance value calculated for each of the pixels in the decimated image,
wherein, when calculating the weight coefficient, the circuitry is further configured to calculate the weight coefficient based on the noise variance value and the pixel variance value.

6. The image processing apparatus according to claim 4 , wherein the circuitry is further configured to:
calculate a first mean square of the pixel values of the extracted similar pixels for each of the pixels contained in the decimated image;
calculate a second mean square of the pixel values of the similar pixels with respect to each of the decimated pixels, based on the first mean square calculated for each of the pixels in the decimated image; and
calculate a pixel variance value of the pixel values of the similar pixels of the target pixel, based on the first mean square or the second mean square,
wherein, when calculating the weight coefficient, the circuitry is further configured to calculate the weight coefficient based on the noise variance value and the pixel variance value.

7. The image processing apparatus according to claim 3 ,
wherein the target image is a color image, and
wherein, when correcting the target pixel value, the circuitry is further configured to:
project a difference between the target pixel value and the first or second correction candidate value of the target pixel in a first specified direction within a predetermined color space; and
perform weighted addition of the target pixel value and the first or second correction candidate value projected in the first specified direction by using the weight coefficient, to correct the target pixel value to a value in the first specified direction.

8. The image processing apparatus according to claim 7 , wherein the circuitry is further configured to:
calculate a maximum variance direction as the first specified direction based on pixel values of the similar pixels and variance-covariance of noise with respect to the target pixel value of the target pixel, and
wherein, when correcting the target pixel value, the circuitry is further configured to correct the target pixel value by using the first specified direction.

9. The image processing apparatus according to claim 8 ,
wherein the target image is a specular image, and
wherein, when correcting the target pixel value, the circuitry is further configured to:
project a difference between the target pixel value and the first or second correction candidate value of the target pixel in a second specified direction within a specular space, and
perform weighted addition of the target pixel value and the first or second correction candidate value by using the weight coefficient, to correct the target pixel value to a value in the second specified direction.

10. The image processing apparatus according to claim 9 , wherein the circuitry is further configured to:
calculate a maximum variance direction as the second specified direction based on pixel values of the similar pixels and variance-covariance of noise with respect to the target pixel value of the target pixel,
wherein, when correcting the target pixel value, the circuitry is further configured to correct the target pixel value by using the second specified direction.

11. An imaging device comprising:
the image processing apparatus according to claim 1 ; and
circuitry configured to:
capture an image;
store a plurality of noise variance estimating functions, each indicating a relationship between the first or second correction candidate value of the target pixel and the noise variance value of each of the similar pixels of the target pixel and each being associated with an imaging condition;
acquire an imaging condition set in the circuitry or an imaging condition input from an external apparatus;
select a noise variance estimating function that is stored in association with the acquired imaging condition;
calculate a noise variance value of the target pixel based on the selected noise variance estimating function and based on the first or second correction candidate value,
wherein, when calculating the weight coefficient, the circuitry is further configured to calculate the weight coefficient of the target pixel value and the first or second correction candidate value of the target pixel based on the noise variance value.

12. An image processing method implemented by an image processing apparatus, the image processing method comprising:
decimating pix

Assignees

• Hara Takayuki
• Yoshida Kazuhiro
• Watanabe Yoshikazu
• Kataoka Akira
• Ricoh Co Ltd

Inventors

• Hara Takayuki
• Yoshida Kazuhiro
• Watanabe Yoshikazu
• Kataoka Akira

Classifications

• H04N25/63 Primary

  applied to dark current · CPC title

• H04N23/84

  for processing colour signals · CPC title

• G06T5/20

  using local operators · CPC title

• H04N5/361

  Electricity · mapped topic

• G06T2207/20016

  Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform · CPC title