Image processing device, imaging apparatus, parameter generating method, image processing method, and non-transitory computer readable recording medium storing a program

Patent metadata

Field	Value
Publication number	US-9892492-B2
Application number	US-201615135737-A
Country	US
Kind code	B2
Filing date	Apr 22, 2016
Priority date	Oct 31, 2013
Publication date	Feb 13, 2018
Grant date	Feb 13, 2018

Abstract

A restoration processing section 38 performs restoration processing using a restoration filter based on a point spread function for image data. An outline enhancement processing section 39 performs sharpening processing using a sharpening filter for image data. A sharpness restoration control section 37 acquires a total sharpness restoration rate based on the restoration rate (restoration strength magnification U) of the image data based on the restoration processing and the sharpening rate (sharpening strength magnification V) of the image data based on the sharpening processing, acquires one of the restoration rate and the sharpening rate, and calculates the other one of the restoration rate and the sharpening rate based on the total sharpness restoration rate.

First claim

What is claimed is:

1. An image processing device, comprising:
a microprocessor configured to:
control image processing of an image data,
control, by using a restoration filter based on a point spread function and by adjusting a restoration rate of the image data, a restoration processing for the image data that is acquired by imaging a subject with an imaging element and an optical system; and
control, by using a sharpening filter and by adjusting a sharpening rate of the image data, a sharpening processing for the image data; and
the microprocessor is further configured to acquire a total sharpness restoration rate based on the restoration rate and the sharpening rate, acquire one of the restoration rate and the sharpening rate, and calculate the other one of the restoration rate and the sharpening rate based on the total sharpness restoration rate.

2. The image processing device according to claim 1 ,
wherein the microprocessor acquires the restoration rate, and calculates the sharpening rate based on the total sharpness restoration rate and the restoration rate.

3. The image processing device according to claim 2 ,
wherein the microprocessor determines the restoration rate based on a designated restoration rate that is designated by a user.

4. The image processing device according to claim 2 ,
wherein the restoration rate is determined based on optical characteristics information indicating characteristics of the optical system.

5. The image processing device according to claim 4 ,
wherein the optical system includes an optical system storage unit that stores the optical characteristics information, and
the restoration rate is determined based on the optical characteristics information stored in the optical system storage unit.

6. The image processing device according to claim 4 ,
wherein the optical characteristics information includes type information of a lens provided in the optical system.

7. The image processing device according to claim 4 ,
wherein the optical characteristics information includes individual differences information of the optical system.

8. The image processing device according to claim 4 ,
wherein the optical characteristics information includes imaging setting conditions.

9. The image processing device according to claim 1 ,
wherein the microprocessor acquires the sharpening rate, and calculates the restoration rate based on the total sharpness restoration rate and the sharpening rate.

10. The image processing device according to claim 9 ,
wherein the microprocessor determines the sharpening rate based on imaging setting conditions in imaging of the image data.

11. The image processing device according to claim 9 ,
wherein the sharpening rate is determined based on optical characteristics information indicating characteristics of the optical system.

12. The image processing device according to claim 11 ,
wherein the optical system includes an optical system storage unit that stores the optical characteristics information, and
the sharpening rate is determined based on the optical characteristics information stored in the optical system storage unit.

13. The image processing device according to claim 1 ,
wherein the microprocessor acquires a diaphragm value of the optical system when acquiring the image data and compares the diaphragm value with a first threshold value, and
at least in a case where the diaphragm value indicates that a diaphragm is more opened than a diaphragm expressed by the first threshold value, the microprocessor acquires one of the restoration rate and the sharpening rate, and calculates the other one of the restoration rate and the sharpening rate based on the total sharpness restoration rate.

14. The image processing device according to claim 1 ,
wherein the microprocessor acquires imaging mode information when acquiring the image data, and maintains the total sharpness restoration rate constant in a case where the imaging mode information indicates a motion picture recording mode.

15. The image processing device according to claim 14 ,
wherein, in a case where the imaging mode information indicates the motion picture recording mode, the microprocessor sets the restoration rate to be smaller than that in a case where the imaging mode information indicates a still image recording mode.

16. The image processing device according to claim 1
wherein the restoration filter is determined based on imaging setting conditions in imaging of the image data.

17. The image processing device according to claim 16 ,
wherein the imaging setting conditions include setting conditions affecting the point spread function.

18. The image processing device according to claim 17 ,
wherein the setting conditions include at least any one of diaphragm information, zoom information, subject distance information, or lens type information of the optical system.

19. The image processing device according to claim 16 ,
wherein the imaging setting conditions include imaging conditions that do not affect the point spread function.

20. The image processing device according to claim 19 ,
wherein the imaging conditions include at least any one of imaging sensitivity information or imaging mode information.

21. The image processing device according to claim 16 , further comprising:
a restoration filter storage unit that stores a plurality of the restoration filters based on point spread functions of a plurality of the optical systems; and
a restoration filter selection unit that selects the restoration filter based on the point spread function of the optical system used in imaging of the image data, from the restoration filter storage unit, based on the imaging setting conditions,
wherein the microprocessor performs the restoration processing using the restoration filter selected by the restoration filter selection unit.

22. The image processing device according to claim 1 ,
wherein the restoration filter is used in common for a plurality of optical systems.

23. The image processing device according to claim 1 ,
wherein the restoration filter is used in common for a plurality of imaging setting conditions.

24. The image processing device according to claim 23 ,
wherein the plurality of imaging setting conditions include zoom information of the optical system.

25. The image processing device according to claim 1 ,
wherein the microprocessor adjusts the total sharpness restoration rate to a target sharpness restoration rate at a first frequency.

26. The image processing device according to claim 1 ,
wherein the microprocessor controls so that
the image data is subjected to one of the restoration processing and the sharpening processing.

27. The image processing device according to claim 1 ,
wherein the microprocessor controls so that
the image data is input to the microprocessor for performing the restoration processing and the sharpening processing in parallel and
controls so that increment or decrement data of the image data due to the restoration processing at the microprocessor and increment or decrement data of the image data due to the sharpening processing at the microprocessor are added together.

28. The image processing device according to claim 1 , further comprising:
a non-linear processing unit that performs non-linear processing of the image data.

Assignees

• Fujifilm Corp

Inventors

• Naruse Yousuke
• Hayashi Kenkichi

Classifications

• H04N23/667

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title

• H04N25/615

  involving a transfer function modelling the optical system, e.g. optical transfer function [OTF], phase transfer function [PhTF] or modulation transfer function [MTF] · CPC title

• H04N23/661

  Transmitting camera control signals through networks, e.g. control via the Internet · CPC title

• G06T2207/10004

  Still image; Photographic image · CPC title

• G06T5/003 Primary

  Physics · mapped topic