Image capturing apparatus, calibration method, and non-transitory computer-readable medium for calculating parameter for a point image restoration process

Patent metadata

Field	Value
Publication number	US-10171803-B2
Application number	US-201514837709-A
Country	US
Kind code	B2
Filing date	Aug 27, 2015
Priority date	Mar 27, 2013
Publication date	Jan 1, 2019
Grant date	Jan 1, 2019

Abstract

An image capturing apparatus according to an aspect of the present invention includes an image capturing unit, a display unit that displays an imaged picture imaged by the image capturing unit and a guide linearly shaped along a sagittal direction or a tangential direction in the imaged picture, the guide assisting imaging of a calibration image used for calibration in a point image restoration process, and a parameter calculation unit that calculates a parameter for the point image restoration process on the basis of the calibration image imaged by the image capturing unit with assistance from the guide.

First claim

What is claimed is:

1. An image capturing apparatus comprising:
an image capturing unit;
a display unit, including a processor, that displays an imaged picture imaged by the image capturing unit and a guide linearly shaped along a sagittal direction or a tangential direction in at least one of four corners of the imaged picture, the guide assisting imaging of a calibration image used for calibration in a point image restoration process;
a guide indication control unit included in the display unit that performs display control of the guide assisting the imaging of the calibration image used for the calibration in the point image restoration process; and
a parameter calculation unit that calculates a parameter for the point image restoration process on the basis of the calibration image imaged by the image capturing unit with assistance from the guide.

2. The image capturing apparatus according to claim 1 , wherein the guide displayed on the display unit is arranged depending on an image height of the imaged picture.

3. The image capturing apparatus according to claim 1 , wherein the guide displayed on the display unit is a first guide or a second guide not parallel with the first guide.

4. The image capturing apparatus according to claim 1 , wherein
the image capturing unit has a bracketing imaging mode, and
the parameter calculation unit calculates the parameter for the point image restoration process on the basis of a plurality of the calibration images imaged with bracketing by the image capturing unit with assistance from the guide.

5. The image capturing apparatus according to claim 4 , wherein the image capturing unit images the calibration image for each f-number in the bracketing imaging mode.

6. The image capturing apparatus according to claim 1 , wherein the parameter calculation unit calculates the parameter for the point image restoration process on the basis of the plurality of the calibration images imaged by the image capturing unit with assistance from the guide.

7. The image capturing apparatus according to claim 1 , wherein
the display unit further displays an imaging condition for imaging the calibration image, and
the parameter calculation unit calculates the parameter for the point image restoration process under the imaging condition on the basis of the calibration image imaged by the image capturing unit with assistance from the guide.

8. The image capturing apparatus according to claim 1 , wherein the image capturing unit has an interchangeable lens.

9. The image capturing apparatus according to claim 1 , wherein the image capturing unit has a lens which modulates a phase to extend a depth of field.

10. The image capturing apparatus according to claim 1 , further comprising a parameter holding unit that stores therein in advance the parameter for the point image restoration process,
wherein
the parameter calculation unit adjusts the parameter stored in the parameter holding unit on the basis of the calibration image imaged by the image capturing unit with assistance from the guide.

11. The image capturing apparatus according to claim 1 , further comprising:
an image analysis unit that analyzes the imaged picture; and
an image analysis determination unit that determines whether or not the imaged picture is adequate as the calibration image on the basis of an analysis result of the imaged picture by the image analysis unit and outputs a determination result,

wherein
the display unit further displays determination information on the basis of the determination result.

12. The image capturing apparatus according to claim 11 , wherein the image analysis unit analyzes the imaged picture regarding a brightness or blur amount of the imaged picture.

13. The image capturing apparatus according to claim 12 , wherein
the image analysis unit acquires information on the f-number regarding the imaged picture, and analyzes the brightness of the imaged picture on the basis of a threshold of a exposure time set for the calibration, a threshold of an imaging sensitivity set for the calibration, and the acquired information on the f-number.

14. The image capturing apparatus according to claim 11 , wherein
the image analysis unit further includes a coincidence degree determination unit that determines a coincidence degree between the guide and the imaged picture imaged by the image capturing unit and outputs a resultant coincidence degree, and
the image analysis determination unit determines whether or not the imaged picture is adequate as the calibration image on the basis of the resultant coincidence degree.

15. The image capturing apparatus according to claim 6 , further comprising:
an optical transfer function holding unit that stores therein in advance information on an optical transfer function of the lens as the parameter for the point image restoration process; and
an optical transfer function determination unit that determines whether or not a difference is larger than a threshold, the difference being a difference between information on an optical transfer function of a lens calculated by the parameter calculation unit on the basis of the plurality of the calibration images imaged by the image capturing unit and the information on the optical transfer function of the lens stored in the optical transfer function holding unit, and outputs a determination result concerning the optical transfer function,

wherein
the display unit further displays determination information on the basis of the determination result concerning the optical transfer function.

16. The image capturing apparatus according to claim 15 , wherein the information on the optical transfer function of the lens is at least one of a modulation transfer function and phase transfer function of the lens.

17. The image capturing apparatus according to claim 11 , wherein the display unit displays an indication prompting change of the imaged picture depending on the determination result output by the image analysis determination unit.

18. The image capturing apparatus according to claim 15 , wherein the display unit displays an indication prompting retake of the calibration image depending on the determination result output by the optical transfer function determination unit.

19. A calibration method comprising:
a displaying step of displaying a captured image imaged by an image capturing unit and a guide assisting imaging of a calibration image used for calibration in a point image restoration process on a display unit, the display unit including a processor, the guide linearly shaped along a sagittal direction or a tangential direction in at least one of four corners of the captured image, a guide indication control unit included in the display unit performing display control of the guide assisting the imaging of the calibration image used for the calibration in the point image restoration process; and
a parameter calculating step of calculating a parameter for the point image restoration process on the basis of the calibration image imaged by the image capturing unit with assistance from the guide.

20. A non-transitory computer-readable medium having a program recorded therein, the program for causing a processor, when an instruction stored in the medium is read out by the processor, to execute:
a displaying step of displaying a captured image imaged by an image capturing unit and a guide assisting imaging of a calibration image used for calibration in a point image restoration process on a display uni

Assignees

• Fujifilm Corp

Inventors

• Hayashi Kenkichi
• Sugimoto Masahiko
• Naruse Yousuke

Classifications

• H04N23/663

  for controlling interchangeable camera parts based on electronic image sensor signals · CPC title

• H04N23/743

  Bracketing, i.e. taking a series of images with varying exposure conditions · CPC title

• H04N23/73

  by influencing the exposure time · CPC title

• H04N25/134

  based on three different wavelength filter elements · CPC title

• H04N23/635

  Region indicators; Field of view indicators · CPC title