Image processing apparatus, image capturing apparatus, image processing method and storage medium storing image processing program

Patent metadata

Field	Value
Publication number	US-2016110851-A1
Application number	US-201514882813-A
Country	US
Kind code	A1
Filing date	Oct 14, 2015
Priority date	Oct 21, 2014
Publication date	Apr 21, 2016
Grant date	—

Abstract

The image processing apparatus performs an image process on a first image produced by image capturing. The apparatus includes: a memory storing coefficient data containing coefficients to be used in an approximation function to approximate a PSF of an image capturing optical system, and a processor performs the image process. The processor produces an approximated point spread function by using the coefficient of the coefficient data corresponding to an optical state of the optical system in the image capturing and two of a pixel pitch of an image sensor, a kernel size of a filter to be used for a sharpening process on the first image and number of taps of the filter; produce the filter by using the approximated PSF; and produce a second image that is a sharpened image by applying the filter to the first image.

First claim

What is claimed is:

1 . An image processing apparatus configured to perform an image process on a first image produced by image capturing through an image capturing optical system, the image processing apparatus comprising:
a memory storing coefficient data containing coefficients to be used in an approximation function to approximate a point spread function of the image capturing optical system, the coefficients having values different depending on an optical state of the image capturing optical system; and a processor configured to perform the image process, wherein the processor is configured to: produce an approximated point spread function by using (a) the coefficient of the coefficient data corresponding to the optical state in the image capturing and (b) two of a pixel pitch of an image sensor used for the image capturing, a kernel size of a filter to be used for a sharpening process on the first image and number of taps of the filter; produce the filter by using the approximated point spread function; and produce a second image that is a sharpened image by applying the filter to the first image.

2 . An image processing apparatus according to claim 1 , wherein the processor is configured to produce the coefficient data by fitting the approximation function with the point spread function calculated by using reference value data of the image capturing optical system.

3 . An image processing apparatus according to claim 1 , wherein the coefficient data contains a coefficient that provides asymmetry to the approximated point spread function.

4 . An image processing apparatus according to claim 1 , wherein the coefficient data contains a coefficient to adjust a gain of the filter.

5 . An image processing apparatus according to claim 1 , wherein the processor is configured to produce an unsharp mask by using the approximated point spread function and to produce the filter by using the unsharp mask.

6 . An image processing apparatus according to claim 1 , wherein the processor is configured to produce the filter depending on the approximated point spread function without producing the unsharp mask.

7 . An image processing apparatus according to claim 1 , wherein the processor is configured to perform a normalization process for setting a sum of values of the taps of the filter to a predetermined value and to apply the filter subjected to the normalization process to the first image.

8 . An image processing apparatus according to claim 1 ,
wherein: the processor is configured to:
perform an adjustment of the approximated point spread function such that the approximated point spread function has a distribution that continuously decreases to zero from its central area toward its marginal area; and
to produce the filter by using the approximated point spread function subjected to the adjustment.

9 . An image capturing apparatus comprising:
an image sensor configured to perform image capturing through an image capturing optical system; and an image processing apparatus configured to perform an image process on a first image produced by using output from the image sensor, wherein the image processing apparatus comprises: a memory storing coefficient data containing coefficients to be used in an approximation function to approximate a point spread function of the image capturing optical system, the coefficients having values different depending on an optical state of the image capturing optical system; and a processor configured to perform the image process, wherein the processor is configured to: produce, as the image process, an approximated point spread function by using (a) the coefficient of the coefficient data corresponding to the optical state in the image capturing and (b) two of a pixel pitch of an image sensor used for the image capturing, a kernel size of a filter to be used for a sharpening process on the first image and number of taps of the filter; produce the filter by using the approximated point spread function; and produce a second image that is a sharpened image by applying the filter to the first image.

10 . An image processing method configured to perform an image process on a first image produced by image capturing through an image capturing optical system, the method comprising:
providing coefficient data containing coefficients to be used in an approximation function to approximate a point spread function of the image capturing optical system, the coefficients having values different depending on an optical state of the image capturing optical system; and performing the image process,
wherein the image process comprises:
producing an approximated point spread function by using (a) the coefficient of the coefficient data corresponding to the optical state in the image capturing and (b) two of a pixel pitch of an image sensor used for the image capturing, a kernel size of a filter to be used for a sharpening process on the first image and number of taps of the filter;
producing the filter by using the approximated point spread function; and
producing a second image that is a sharpened image by applying the filter to the first image.

11 . A non-transitory computer-readable storage medium storing an image processing program as a computer program configured to cause a computer to:
provide coefficient data containing coefficients to be used in an approximation function to approximate a point spread function of an image capturing optical system, the coefficients having values different depending on an optical state of the image capturing optical system; and perform the image process,
wherein the image process comprises:
producing an approximated point spread function by using (a) the coefficient of the coefficient data corresponding to the optical state in the image capturing and (b) two of a pixel pitch of an image sensor used for the image capturing, a kernel size of a filter to be used for a sharpening process on the first image and number of taps of the filter;
producing the filter by using the approximated point spread function; and
producing a second image that is a sharpened image by applying the filter to the first image.

Assignees

• Canon Kk

Inventors

• Oniki Takashi
• Hatakeyama Koshi

Classifications

• H04N5/23229

  Electricity · mapped topic

• G06T5/003 Primary

  Physics · mapped topic

• G06T5/20 Primary

  using local operators · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T2207/20021

  Dividing image into blocks, subimages or windows · CPC title