Image processing device, imaging device, image processing method, and image processing program

Patent metadata

Field	Value
Publication number	US-9892495-B2
Application number	US-201615265301-A
Country	US
Kind code	B2
Filing date	Sep 14, 2016
Priority date	Mar 31, 2014
Publication date	Feb 13, 2018
Grant date	Feb 13, 2018

Abstract

Disclosed are an image processing device, an imaging device, an image processing method, and an image processing program capable of, when recovering a deteriorated image due to a point spread function of an optical system, effectively performing phase recovery and suppressing the occurrence of artifact due to frequency recovery processing. The image processing device includes a phase recovery processing unit which subjects image data acquired from an imaging element by capturing an object image using an optical system to phase recovery processing using a phase recovery filter based on a point spread function of the optical system, a gradation correction processing unit which subjects image data subjected to the phase recovery processing to nonlinear gradation correction, and a frequency recovery processing unit which subjects image data subjected to the gradation correction to frequency recovery processing using a frequency recovery filter based on the point spread function of the optical system.

First claim

What is claimed is:

1. An image processing device comprising:
a phase recovery processing circuit which subjects image data acquired from an imaging element by capturing an object image using an optical system to phase recovery processing using a phase recovery filter based on a point spread function of the optical system;
a gradation correction processing circuit which subjects image data subjected to the phase recovery processing to nonlinear gradation correction; and
a frequency recovery processing circuit which subjects image data subjected to the gradation correction to frequency recovery processing using a frequency recovery filter based on the point spread function of the optical system.

2. The image processing device according to claim 1 , further comprising:
a storage which stores the phase recovery filter and the frequency recovery filter,
wherein the phase recovery processing circuit reads the phase recovery filter from the storage and uses the phase recovery filter in the phase recovery processing, and
the frequency recovery processing circuit reads the frequency recovery filter from the storage and uses the frequency recovery filter in the frequency recovery processing.

3. The image processing device according to claim 1 , further comprising:
a storage which stores the point spread function of the optical system, an optical transfer function obtained by Fourier-transforming the point spread function, or a modulation transfer function indicating an amplitude component of the optical transfer function and a phase transfer function indicating a phase component of the optical transfer function,
wherein the phase recovery processing circuit reads the point spread function, the optical transfer function, or the phase transfer function from the storage, generates the phase recovery filter, and uses the generated phase recovery filter in the phase recovery processing, and
the frequency recovery processing circuit reads the point spread function, the optical transfer function, or the modulation transfer function from the storage, generates the frequency recovery filter, and uses the generated frequency recovery filter in the frequency recovery processing.

4. The image processing device according to claim 1 ,
wherein the phase recovery processing circuit subjects image data acquired from the imaging element, which is image data for each color channel, to phase recovery processing using a phase recovery filter, and
the frequency recovery processing circuit subjects the image data subjected to the gradation correction, which is image data for each color channel, to frequency recovery processing using a frequency recovery filter.

5. The image processing device according to claim 2 ,
wherein the phase recovery processing circuit subjects image data acquired from the imaging element, which is image data for each color channel, to phase recovery processing using a phase recovery filter, and
the frequency recovery processing circuit subjects the image data subjected to the gradation correction, which is image data for each color channel, to frequency recovery processing using a frequency recovery filter.

6. The image processing device according to claim 3 ,
wherein the phase recovery processing circuit subjects image data acquired from the imaging element, which is image data for each color channel, to phase recovery processing using a phase recovery filter, and
the frequency recovery processing circuit subjects the image data subjected to the gradation correction, which is image data for each color channel, to frequency recovery processing using a frequency recovery filter.

7. The image processing device according to claim 1 ,
wherein the phase recovery processing circuit subjects image data acquired from the imaging element, which is image data for each color channel, to phase recovery processing using the phase recovery filter, and
the frequency recovery processing circuit subjects image data subjected to gradation correction by the gradation correction processing circuit, which is image data indicating a brightness component generated from image data for each color channel, to frequency recovery processing using the frequency recovery filter.

8. The image processing device according to claim 2 ,
wherein the phase recovery processing circuit subjects image data acquired from the imaging element, which is image data for each color channel, to phase recovery processing using the phase recovery filter, and
the frequency recovery processing circuit subjects image data subjected to gradation correction by the gradation correction processing circuit, which is image data indicating a brightness component generated from image data for each color channel, to frequency recovery processing using the frequency recovery filter.

9. The image processing device according to claim 3 ,
wherein the phase recovery processing circuit subjects image data acquired from the imaging element, which is image data for each color channel, to phase recovery processing using the phase recovery filter, and
the frequency recovery processing circuit subjects image data subjected to gradation correction by the gradation correction processing circuit, which is image data indicating a brightness component generated from image data for each color channel, to frequency recovery processing using the frequency recovery filter.

10. The image processing device according to claim 1 ,
wherein the phase recovery processing circuit subjects image data acquired from the imaging element, which is image data indicating a brightness component generated from image data for each color channel, to phase recovery processing using the phase recovery filter, and
the frequency recovery processing circuit subjects the image data subjected to the gradation correction, which is image data indicating a brightness component generated from image data for each color channel, to frequency recovery processing using the frequency recovery filter.

11. The image processing device according to claim 2 ,
wherein the phase recovery processing circuit subjects image data acquired from the imaging element, which is image data indicating a brightness component generated from image data for each color channel, to phase recovery processing using the phase recovery filter, and
the frequency recovery processing circuit subjects the image data subjected to the gradation correction, which is image data indicating a brightness component generated from image data for each color channel, to frequency recovery processing using the frequency recovery filter.

12. The image processing device according to claim 3 ,
wherein the phase recovery processing circuit subjects image data acquired from the imaging element, which is image data indicating a brightness component generated from image data for each color channel, to phase recovery processing using the phase recovery filter, and
the frequency recovery processing circuit subjects the image data subjected to the gradation correction, which is image data indicating a brightness component generated from image data for each color channel, to frequency recovery processing using the frequency recovery filter.

13. The image processing device according to claim 10 , further comprising:
a brightness data generation circuit which generates brightness data indicating a brightness component from image data for each color channel acquired from the imaging element,
wherein the phase recovery processing circuit subjects brightness data generated by the brightness data generation circuit to phase recovery processing using the phase recovery filter,
the gradation correctio

Assignees

• Fujifilm Corp

Inventors

• Naruse Yousuke
• Sugimoto Masahiko
• Hayashi Kenkichi

Classifications

• H04N25/6153

  for colour signals · CPC title

• H04N25/615

  involving a transfer function modelling the optical system, e.g. optical transfer function [OTF], phase transfer function [PhTF] or modulation transfer function [MTF] · CPC title

• H04N5/3572

  Electricity · mapped topic

• H04N9/045

  Electricity · mapped topic

• G06T5/10

  using non-spatial domain filtering · CPC title