Image processing device, image capture device, image processing method, and program

Patent metadata

Field	Value
Publication number	US-9906732-B2
Application number	US-201615012239-A
Country	US
Kind code	B2
Filing date	Feb 1, 2016
Priority date	Aug 2, 2013
Publication date	Feb 27, 2018
Grant date	Feb 27, 2018

Abstract

A restoration filter based on a point spread function of an optical system is applied to source image data acquired through photographing using the optical system to acquire restored image data (S 13 : filter application step). Adjustment of an amplification factor of the difference between source image data and restored image data is performed, and recovered image data is acquired from the difference after adjustment and source image data (S 15 : gain adjustment step). In the filter application step, a common filter determined regardless of a value of a magnification of an optical zoom of the optical system is used as the restoration filter, and in the gain adjustment step, the amplification factor is determined based on the magnification of the optical zoom of the optical system.

First claim

What is claimed is:

1. An image processing device comprising:
a filter application circuit which applies a restoration filter based on a point spread function of an optical system to source image data acquired through photographing using the optical system to acquire restored image data; and
a gain adjustment circuit which performs adjustment of an amplification factor of a difference between the source image data and the restored image data and acquires recovered image data from the difference and the source image data,
wherein the filter application circuit uses a common filter determined regardless of a value of a magnification of an optical zoom of the optical system as the restoration filter, and
the gain adjustment circuit determines the amplification factor based on the magnification of the optical zoom of the optical system.

2. The image processing device according to claim 1 ,
wherein the restoration filter is determined based on a diaphragm value of the optical system for acquiring the source image data.

3. The image processing device according to claim 1 ,
wherein the filter application circuit acquires the restored image data using a common filter determined regardless of the value of the magnification of the optical zoom of the optical system as the restoration filter in case where the diaphragm value of the optical system for acquiring the source image data is a value on a diaphragm side smaller than a first diaphragm value, and
the gain adjustment circuit determines the amplification factor based on the magnification of the optical zoom of the optical system in case where the diaphragm value of the optical system for acquiring the source image data is a value on a diaphragm side smaller than the first diaphragm value.

4. The image processing device according to claim 2 ,
wherein the filter application circuit acquires the restored image data using a common filter determined regardless of the value of the magnification of the optical zoom of the optical system as the restoration filter in case where the diaphragm value of the optical system for acquiring the source image data is a value on a diaphragm side smaller than a first diaphragm value, and
the gain adjustment circuit determines the amplification factor based on the magnification of the optical zoom of the optical system in case where the diaphragm value of the optical system for acquiring the source image data is a value on a diaphragm side smaller than the first diaphragm value.

5. The image processing device according to claim 1 ,
wherein the filter application circuit selects a filter for use as the restoration filter from among a plurality of filter candidates as a candidate of a common filter determined regardless of the value of the magnification of the optical zoom of the optical system based on the difference between a modulation transfer function of an image height central portion in the optical system on an optical axis or in the vicinity of the optical axis and a modulation transfer function of an image height peripheral portion in the optical system having an image height greater than the image height central portion.

6. The image processing device according to claim 2 ,
wherein the filter application circuit selects a filter for use as the restoration filter from among a plurality of filter candidates as a candidate of a common filter determined regardless of the value of the magnification of the optical zoom of the optical system based on the difference between a modulation transfer function of an image height central portion in the optical system on an optical axis or in the vicinity of the optical axis and a modulation transfer function of an image height peripheral portion in the optical system having an image height greater than the image height central portion.

7. The image processing device according to claim 3 ,
wherein the filter application circuit selects a filter for use as the restoration filter from among a plurality of filter candidates as a candidate of a common filter determined regardless of the value of the magnification of the optical zoom of the optical system based on the difference between a modulation transfer function of an image height central portion in the optical system on an optical axis or in the vicinity of the optical axis and a modulation transfer function of an image height peripheral portion in the optical system having an image height greater than the image height central portion.

8. The image processing device according to claim 5 ,
wherein the plurality of filter candidates include a first filter candidate and a second filter candidate different from the first filter candidate, and
the filter application circuit uses the first filter candidate as the restoration filter in case where the difference between the modulation transfer function of the image height central portion and the modulation transfer function of the image height peripheral portion is smaller than a first threshold value, and uses the second filter candidate as the restoration filter in case where the difference between the modulation transfer function of the image height central portion and the modulation transfer function of the image height peripheral portion is equal to or greater than the first threshold value.

9. The image processing device according to claim 6 ,
wherein the plurality of filter candidates include a first filter candidate and a second filter candidate different from the first filter candidate, and
the filter application circuit uses the first filter candidate as the restoration filter in case where the difference between the modulation transfer function of the image height central portion and the modulation transfer function of the image height peripheral portion is smaller than a first threshold value, and uses the second filter candidate as the restoration filter in case where the difference between the modulation transfer function of the image height central portion and the modulation transfer function of the image height peripheral portion is equal to or greater than the first threshold value.

10. The image processing device according to claim 1 ,
wherein, in case where the source image data is a moving image, the filter application circuit acquires the restored image data using a common filter determined regardless of the value of the magnification of the optical zoom of the optical system as the restoration filter, and
in case where the source image data is a moving image, the gain adjustment circuit determines the amplification factor based on the magnification of the optical zoom of the optical system.

11. The image processing device according to claim 10 ,
wherein, in case where the source image data is a still image, the filter application circuit acquires the restored image data using the restoration filter determined based on the magnification of the optical zoom of the optical system.

12. The image processing device according to claim 11 ,
wherein, in case where the source image data is acquired by still image photographing during moving image photographing, the filter application circuit acquires the restored image data using the restoration filter determined based on the magnification of the optical zoom of the optical system.

13. The image processing device according to claim 1 ,
wherein the optical system has a lens unit which modulates a phase to extend a depth of field.

14. An image capture device comprising:
an image capture element which acquires source image data by photographing using an optical system; and
the image processing device according to claim 1 .

Assignees

• Fujifilm Corp

Inventors

• Irie Kosuke
• Sugimoto Masahiko
• Naruse Yousuke
• Hayashi Kenkichi

Classifications

• H04N23/631

  Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N25/6153

  for colour signals · CPC title

• H04N23/75

  by influencing optical camera components · CPC title

• H04N23/69

  Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming · CPC title