Image pickup device, calibration system, calibration method, and program

Patent metadata

Field	Value
Publication number	US-9584801-B2
Application number	US-201514884246-A
Country	US
Kind code	B2
Filing date	Oct 15, 2015
Priority date	Apr 16, 2013
Publication date	Feb 28, 2017
Grant date	Feb 28, 2017

Abstract

An image capturing device 100 includes: an image pickup unit 248 ; a chart storage unit 240 ; a chart transmission control unit 242 ; a calibration necessity determination unit 244 that determines whether or not calibration of the parameters of the point image restoration processing is required based on a calibration image that is obtained by imaging a calibration chart displayed on an external display device using the image pickup unit 248 ; a calibration control unit 246 that controls the execution of the calibration according to the determination regarding whether or not the calibration is required that has been performed by the calibration necessity determination unit 244 ; and a calibration execution unit 247.

First claim

What is claimed is:

1. An image pickup device, comprising:
an image pickup unit;
a chart storage medium that stores a calibration chart relating to parameters of point image restoration processing; and
a processor configured to perform,
transmitting the calibration chart stored in the chart storage medium to an external display device,
determining whether or not calibration of the parameters of the point image restoration processing is required based on a calibration image, which is obtained by imaging the calibration chart displayed on the external display device using the image pickup unit, and outputting the determination result,
controlling execution of the calibration by outputting a calibration execution command when it is determined that the calibration is required according to the determination regarding whether or not the calibration is required,
performing the calibration of the parameters of the point image restoration processing based on the calibration image in response to the calibration execution command,
wherein the image pickup unit has a bracketing imaging mode, and
the processor performs the calibration of the parameters of the point image restoration processing based on a plurality of the calibration images captured by the image pickup unit after selection of the bracketing imaging mode,
wherein the image pickup unit is synchronized with the external display device, and
the image pickup unit images the calibration chart that is displayed in synchronization with the external display device according to imaging of the image pickup unit in the bracketing imaging mode.

2. The image pickup device according to claim 1 ,
wherein the image pickup unit acquires the calibration image under some of a plurality of imaging conditions in the bracketing imaging mode, and
the processor performs the calibration of the parameters of the point image restoration processing based on the calibration image captured under some of the plurality of imaging conditions.

3. The image pickup device according to claim 1 ,
wherein the image pickup unit is synchronized with the external display device, and
the image pickup unit images the calibration chart that is displayed in synchronization with the external display device according to imaging of the image pickup unit.

4. The image pickup device according to claim 1 , the processor further configured to perform:
determining whether or not an imaging environment is suitable for acquisition of the calibration image based on the calibration image,
wherein the processor further controls execution of the calibration according to the determination regarding whether or not the imaging environment is suitable for acquisition of the calibration image.

5. The image pickup device according to claim 4 ,
wherein the chart storage medium further has an environment determination chart,
the processor further transmits an environment determination chart to the external display device, and
the processor determines whether or not the imaging environment is suitable for acquisition of the calibration image based on an environment determination image obtained by imaging the environment determination chart displayed on the external display device using the image pickup unit or based on the environment determination image and the calibration image.

6. The image pickup device according to claim 4 ,
wherein the processor determines whether or not the imaging environment is suitable for acquisition of the calibration image based on a plurality of the calibration images.

7. The image pickup device according to claim 5 ,
wherein the processor determines whether or not the imaging environment is suitable for acquisition of the calibration image based on a plurality of the environment determination images or based on one or a plurality of the environment determination images and one or a plurality of the calibration images.

8. The image pickup device according to claim 1 ,
wherein the processor acquires information regarding display performance of the external display device, and transmits the calibration chart corresponding to the display performance to the external display device.

9. The image pickup device according to claim 5 ,
wherein the processor acquires information regarding display performance of the external display device, and transmits the calibration chart and the environment determination chart corresponding to the display performance to the external display device.

10. The image pickup device according to any claim 1 , the processor further configured to perform:
performing point image restoration processing on an image captured by the image pickup unit,
wherein the processor performs the point image restoration processing using parameters of the point image restoration processing after the calibration.

11. The image pickup device according to claim 1 ,
wherein the image pickup device performs imaging under imaging conditions corresponding to parameters of the point image restoration processing after the calibration, and has a preferential imaging mode in which the point image restoration processing is preferentially performed using parameters of the point image restoration processing after the calibration.

12. The image pickup device according to claim 1 , further comprising:
a check image display control unit and a check image display unit,
wherein the check image display control unit displays information indicating that the calibration has been completed on the check image display unit when imaging is performed using imaging conditions corresponding to parameters of the point image restoration processing after the calibration.

13. The image pickup device according to claim 4 , further comprising:
a check image display control unit and a check image display unit,
wherein the check image display control unit displays a warning sign on the check image display unit when the imaging environment determination unit determines that the imaging environment is not suitable.

14. The image pickup device according to claim 12 ,
wherein the check image display control unit displays a check image before main imaging and information indicating that the calibration has been completed on the check image display unit, according to a preliminary imaging instruction signal.

15. The image pickup device according to claim 12 ,
wherein the check image display control unit displays information indicating that the calibration has been completed on the check image display unit when displaying a captured image that has been captured by the image pickup unit under imaging conditions corresponding to the parameters of point image restoration processing after the calibration.

16. The image pickup device according to claim 1 ,
wherein the image pickup unit includes a replaceable lens.

17. The image pickup device according to claim 1 ,
wherein the image pickup unit includes a lens that extends a depth of field by modulating a phase.

18. A calibration method using a processor, comprising:
a chart transmission control step that the processor transmits a calibration chart relating to parameters of point image restoration processing to an external display device;
a calibration necessity determination step that the processor determines whether or not calibration of the parameters of the point image restoration processing is required based on a calibration image, which is obtained by imaging the calibration chart displayed on the external display device using the image pickup unit, and outputting the determ

Assignees

• Fujifilm Corp

Inventors

• Sugimoto Masahiko
• Hayashi Kenkichi
• Naruse Yousuke

Classifications

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• H04N23/633

  for displaying additional information relating to control or operation of the camera · CPC title

• H04N23/843

  Demosaicing, e.g. interpolating colour pixel values · CPC title

• H04N23/55

  Optical parts specially adapted for electronic image sensors; Mounting thereof · CPC title

• H04N23/743

  Bracketing, i.e. taking a series of images with varying exposure conditions · CPC title