Point image restoration device and method

Patent metadata

Field	Value
Publication number	US-10748256-B2
Application number	US-201816110164-A
Country	US
Kind code	B2
Filing date	Aug 23, 2018
Priority date	Feb 26, 2016
Publication date	Aug 18, 2020
Grant date	Aug 18, 2020

Abstract

Provided are an image processing device, an imaging device, and an image processing method which are capable of obtaining a captured image with desired image quality. An image processing unit functioning as an image processing device includes a point image restoration processing unit that performs point image restoration processing using a restoration filter based on a point spread function of a lens unit on image data obtained from an imaging element through imaging of a subject using an imaging unit having a lens unit including a lens and the imaging element, and a determination unit that determines whether or not to perform the point image restoration processing using the point image restoration processing unit based on spherical aberration of the lens changed by an imaging condition. The point image restoration processing unit performs the point image restoration processing only in a case where the determination unit determines to perform the point image restoration processing.

First claim

What is claimed is:

1. An image processing device comprising:
processing circuitry configured to:
perform point image restoration processing using a restoration filter based on a point spread function of an imaging optical system on image data obtained from an imaging element through imaging of a subject using an imaging unit having the imaging optical system and the imaging element; and
determine whether or not to perform the point image restoration processing based on spherical aberration of the imaging optical system changed by an imaging condition,

wherein the processing circuitry performs the point image restoration processing only in a case where it is determined by the processing circuitry to perform the point image restoration processing,
wherein a first spherical aberration is a spherical aberration of the image optical system in a case where a diaphragm constituting the image optical system is a full aperture,
wherein a second spherical aberration is a spherical aberration of the imaging optical system that is changed by the imaging condition, and
wherein, if a ratio of the second spherical aberration to the first spherical aberration exceeds a second threshold value, the processing circuitry determines to perform the point image restoration processing.

2. The image processing device according to claim 1 ,
wherein the imaging condition is an F number of a diaphragm constituting the imaging optical system.

3. The image processing device according to claim 2 ,
wherein the processing circuitry determines whether or not to perform the point image restoration processing using the processing circuitry based on the F number of the diaphragm.

4. The image processing device according to claim 1 ,
wherein, in a case where the spherical aberration of the imaging optical system changed by the imaging condition is equal to or greater than a first threshold value, the processing circuitry determines to perform the point image restoration processing using the processing circuitry.

5. The image processing device according to claim 4 ,
wherein, in a case where a wavelength for determining the spherical aberration is λ, the first threshold value is 0.6λ.

6. The image processing device according to claim 1 ,
wherein the second threshold value is 0.5.

7. The image processing device according to claim 1 ,
wherein the imaging condition is a kind of a light source that illuminates the subject or a wavelength of the light source.

8. The image processing device according to claim 7 ,
wherein the processing circuitry uses the spherical aberration corresponding to the kind of the light source that illuminates the subject or the wavelength of the light source, as the spherical aberration of the imaging optical system changed by the imaging condition.

9. The image processing device according to claim 1 ,
wherein, in a case where the diaphragm constituting the imaging optical system is at least an full aperture, the imaging optical system has the spherical aberration at which the processing circuitry determines to perform the point image restoration processing.

10. An imaging device comprising:
the image processing device according to claim 1 ; and
the imaging unit.

11. The imaging device according to claim 10 ,
wherein the imaging device is used as an industrial camera.

12. An image processing method comprising:
a step of performing point image restoration processing using a restoration filter based on a point spread function of an imaging optical system on image data obtained from an imaging element through imaging of a subject using an imaging unit having the imaging optical system and the imaging element; and
a step of determining whether or not to perform the point image restoration processing based on spherical aberration of the imaging optical system changed by an imaging condition,
wherein, in the step of performing the point image restoration processing, the point image restoration processing using a restoration filter is performed only in a case where it is determined to perform the point image restoration processing,
wherein a first spherical aberration is a spherical aberration of the image optical system in a case where a diaphragm constituting the image optical system is a full aperture,
wherein a second spherical aberration is a spherical aberration of the imaging optical system that is changed by the imaging condition, and
wherein, in the step of determining whether or not to perform the point image restoration processing, if a ratio of the second spherical aberration to the first spherical aberration exceeds a second threshold value, it is determined to perform the point image restoration processing.

13. The image processing method according to claim 12 ,
wherein the imaging condition is an F number of a diaphragm constituting the imaging optical system.

14. The image processing method according to claim 13 ,
wherein, in the step of determining whether or not to perform the point image restoration processing, it is determined to whether or not to perform the point image restoration processing based on the F number of the diaphragm.

15. The image processing method according to claim 12 ,
wherein, in a case where the spherical aberration of the imaging optical system changed by the imaging condition is equal to or greater than a first threshold value, it is determined to perform the point image restoration processing in the step of determining whether or not to perform the point image restoration processing.

16. The image processing method according to claim 15 ,
wherein, in a case where a wavelength for determining the spherical aberration is λ, the first threshold value is 0.6λ.

17. The image processing method according to claim 12 ,
wherein the second threshold value is 0.5.

Assignees

• Fujifilm Corp

Inventors

• Hayashi Kenkichi
• Naruse Yousuke
• Kishine Yasunobu

Classifications

• H04N23/60

  Control of cameras or camera modules · CPC title

• H04N23/10

  for generating image signals from different wavelengths · CPC title

• H04N25/61

  the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4" · CPC title

• H04N1/407

  Control or modification of tonal gradation or of extreme levels, e.g. background level · CPC title

• G06T2207/20008

  Globally adaptive · CPC title