Image processing device, imaging device, and image processing program

Patent metadata

Field	Value
Publication number	US-9838665-B2
Application number	US-201414513729-A
Country	US
Kind code	B2
Filing date	Oct 14, 2014
Priority date	Apr 25, 2012
Publication date	Dec 5, 2017
Grant date	Dec 5, 2017

Abstract

An image processing apparatus is provided, that is configured to: extract a first pixel value corresponding to a first viewpoint that is one of a plurality of viewpoints to capture a subject image, at a target pixel position from image data having the first pixel value; extract second and third luminance values corresponding to second and third viewpoints that are different from the first viewpoint, at the target pixel position from luminance image data having the second and third luminance values; and calculate at least any of second and third pixel values of the second and third viewpoints such that a relational expression between the second or third pixel value and the first pixel value extracted by the pixel value extracting unit remains correlated with a relational expression defined by the second and third luminance values.

First claim

What is claimed is:

1. An image processing apparatus comprising:
a pixel value extracting unit that extracts a first pixel value at a target pixel position from image data having the first pixel value, the first pixel value corresponding to a first viewpoint that is one of a plurality of viewpoints to capture a subject image;
a luminance value extracting unit that extracts a second luminance value and a third luminance value at the target pixel position from luminance image data having the second luminance value and the third luminance value, the second luminance value and the third luminance value corresponding to a second viewpoint and a third viewpoint that are different from the first viewpoint; and
a calculating unit that calculates at least any of a second pixel value of the second viewpoint and a third pixel value of the third viewpoint such that (i) a ratio between the second pixel value and the first pixel value extracted by the pixel value extracting unit or a ratio between the third pixel value and the first pixel value remains correlated with (ii) a ratio defined by the second luminance value and the third luminance value.

2. The image processing apparatus according to claim 1 , wherein the calculating unit calculates at least any of the second pixel value and the third pixel value according to calculation formulae:
P C2 =2 P C1 ×P B2 /( P B2 +P B3 )
P C3 =2 P C1 ×P B3 /( P B2 +P B3 )

(P C2 : second pixel value, P C3 : third pixel value, P C1 : first pixel value, P B2 : second luminance value, P B3 : third luminance value).

3. The image processing apparatus according to claim 1 , wherein the calculating unit calculates at least any of the second pixel value and the third pixel value according to calculation formulae:
P C2 =P C1 ×P B2 /√( P B2 ×P B3 )

P C3 =P C1 ×P B3 /√( P B2 ×P B3 )

(P C2 : second pixel value, P C3 : third pixel value, P C1 : first pixel value, P B2 : second luminance value, P B3 : third luminance value).

4. The image processing apparatus according to claim 1 , wherein the first pixel value extracted by the pixel value extracting unit, and each of the second luminance value and the third luminance value extracted by the luminance value extracting unit are linear gradation values that are proportional to a received light amount.

5. An image processing apparatus comprising:
a pixel value extracting unit that extracts a first pixel value at a target pixel position from image data having the first pixel value, the first pixel value corresponding to a first viewpoint that is one of a plurality of viewpoints to capture a subject image;
a luminance value extracting unit that extracts a second luminance value and a third luminance value at the target pixel position from luminance image data having the second luminance value and the third luminance value, the second luminance value and the third luminance value corresponding to a second viewpoint and a third viewpoint that are different from the first viewpoint; and
a calculating unit that calculates at least any of a second pixel value of the second viewpoint and a third pixel value of the third viewpoint such that (i) a difference between the second pixel value and the first pixel value extracted by the pixel value extracting unit or a difference between the third pixel value and the first pixel value remains correlated with (ii) a difference between the second luminance value and the third luminance value.

6. The image processing apparatus according to claim 5 , wherein the calculating unit calculates at least any of the second pixel value and the third pixel value according to:
P C2 −P C1 =k ( P B2 −P B3 )
P C3 −P C1 =k ( P B3 −P B2 )

(P C1 : first pixel value, P C2 : second pixel value, P C3 : third pixel value, P B2 : second luminance value, P B3 : third luminance value, k: proportionality coefficient).

7. The image processing apparatus according to claim 5 , wherein the first pixel value extracted by the pixel value extracting unit, and each of the second luminance value and the third luminance value extracted by the luminance value extracting unit are gamma-converted values.

8. A non-transitory computer-readable medium having stored thereon an image processing program that causes a computer to:
extract a first pixel value at a target pixel position from image data having the first pixel value, the first pixel value corresponding to a first viewpoint that is one of a plurality of viewpoints to capture a subject image;
extract a second luminance value and a third luminance value at the target pixel position from luminance image data having the second luminance value and the third luminance value, the second luminance value and the third luminance value corresponding to a second viewpoint and a third viewpoint that are different from the first viewpoint; and
calculate at least any of a second pixel value of the second viewpoint and a third pixel value of the third viewpoint such that (i) a ratio between the second pixel value and the first pixel value extracted in the extracting of the first pixel value or a ratio between the third pixel value and the first pixel value remains correlated with (ii) a ratio defined by the second luminance value and the third luminance value.

9. The non-transitory computer-readable medium according to claim 8 , wherein at least any of the second pixel value and the third pixel value are calculated according to calculation formulae:
P C2 =2 P C1 ×P B2 /( P B2 +P B3 )
P C3 =2 P C1 ×P B3 /( P B2 +P B3 )

(P C2 : second pixel value, P C3 : third pixel value, P C1 : first pixel value, P B2 : second luminance value, P B3 : third luminance value).

10. The non-transitory computer-readable medium according to claim 8 , wherein at least any of the second pixel value and the third pixel value are calculated according to calculation formulae:
P C2 =P C1 ×P B2 /√( P B2 ×P B3 )

P C3 =P C1 ×P B3 /√( P B2 ×P B3 )

(P C2 : second pixel value, P C3 : third pixel value, P C1 : first pixel value, P B2 : second luminance value, P B3 : third luminance value).

11. The non-transitory computer-readable medium according to claim 8 , wherein the first pixel value, and each of the second luminance value and the third luminance value are linear gradation values that are proportional to a received light amount.

12. A non-transitory computer-readable medium having stored thereon an image processing program that causes a computer to:
extract a first pixel value at a target pixel position from image data having the first pixel value, the first pixel value corresponding to a first viewpoint that is one of a plurality of viewpoints to capture a subject image;
extract a second luminance value and a third luminance value at the target pixel position from luminance image data having the second luminance value and the third luminance value, the second luminance value and the third luminance value corresponding to a second viewpoint and a third viewpoint that are different from the first viewpoint; and
calculate at least any of a second pixel value of the second viewpoint and a third pixel value of the third viewpoint such that (i) a difference between the second pixel value and the first pixel value extracted in the extracting of the first pixel value or a difference between the third pixel value and the first pixel value remains correlated with (ii) a difference between the second luminance value and the third luminance value.

13. The non-transi

Assignees

• Nippon Kogaku Kk

Inventors

• Shibazaki Kiyoshige
• Hamashima Muneki
• Mori Susumu
• Ishiga Kenichi

Classifications

• H04N25/134

  based on three different wavelength filter elements · CPC title

• H04N23/843

  Demosaicing, e.g. interpolating colour pixel values · CPC title

• H04N13/218 Primary

  using spatial multiplexing · CPC title

• H04N13/0037 Primary

  Electricity · mapped topic

• H04N13/0257

  Electricity · mapped topic