Image processing apparatus, image processing method, and storage medium for performing image restoration

Patent metadata

Field	Value
Publication number	US-2016110852-A1
Application number	US-201514882939-A
Country	US
Kind code	A1
Filing date	Oct 14, 2015
Priority date	Oct 17, 2014
Publication date	Apr 21, 2016
Grant date	—

Abstract

An image processing apparatus includes a first acquisition unit configured to acquire a captured image captured by an imaging system, a second acquisition unit configured to acquire first image information about a sharpness reduction that occurs in the captured image and is caused by the imaging system, a specifying unit configured to specify a restoration process on the captured image and, a third acquisition unit configured to acquire second image information about a sharpness reduction caused by an image forming system for forming an image on a recording medium, a setting unit configured to, based on the first image information and the second image information, set image restoration information, and a correction unit configured to correct the captured image by a restoration process using the image restoration information, wherein the setting unit sets the image restoration information according to a result of the specifying unit specifying the restoration process.

First claim

What is claimed is:

1 . An image processing apparatus comprising:
a first acquisition unit configured to acquire a captured image captured by an imaging system; a second acquisition unit configured to acquire first image information about a sharpness reduction that occurs in the captured image and is caused by the imaging system; a specifying unit configured to specify a restoration process according to the first image information on the captured image and; a third acquisition unit configured to acquire second image information about a sharpness reduction caused by an image forming system for forming an image on a recording medium based on the captured image; a setting unit configured to, based on the first image information and the second image information, set image restoration information for correcting at least one of the sharpness reduction caused by the imaging system and the sharpness reduction caused by the image forming system; and a correction unit configured to correct the captured image by a restoration process using the image restoration information, wherein the setting unit sets the image restoration information according to a result of the specifying unit specifying the restoration process.

2 . The image processing apparatus according to claim 1 , wherein the second acquisition unit acquires, as the first image information, first image restoration information about an image restoration process that is possibly performed by the imaging system, and first image deterioration information about image deterioration caused by the imaging system, and
wherein the setting unit sets the image restoration information based on the first image restoration information, the first image deterioration information, and the second image information.

3 . The image processing apparatus according to claim 2 , wherein the setting unit comprises:
a first calculation unit configured to, based on the first image deterioration information acquired by the second acquisition unit, calculate a first image restoration filter for correcting the image deterioration caused by the imaging system; a second calculation unit configured to, based on the first image restoration information acquired by the second acquisition unit, calculate a cancellation filter for canceling an image restoration process performed by the imaging system; a third calculation unit configured to, based on the second image information, calculate a second image restoration filter for correcting image deterioration caused by the image forming system; and a fourth calculation unit configured to combine the first image restoration filter calculated by the first calculation unit, the cancellation filter calculated by the second calculation unit, and the second image restoration filter calculated by the third calculation unit, and obtain a result of the combination as the image restoration information.

4 . The image processing apparatus according to claim 3 , wherein the specifying unit determines whether an image restoration process is performed by the imaging system, and
wherein in a case where the specifying unit determines that the image restoration process is not performed, the second calculation unit calculates the cancellation filter to be 0.

5 . The image processing apparatus according to claim 3 , further comprising a determination unit configured to determine whether the second acquisition unit acquires the first image deterioration information and the first image restoration information,
wherein in a case where the determination unit determines that the first image deterioration information is acquired and the first image restoration information is not acquired, the first calculation unit calculates the first image restoration filter in such a manner that a strength for correcting the image deterioration caused by the imaging system becomes smaller than the strength in a case where the first image restoration information is acquired, and the second calculation unit calculates the cancellation filter to be 0.

6 . The image processing apparatus according to claim 1 , wherein the second acquisition unit acquires as the first image information the first image restoration information and a first editing value indicating a degree of restoration of image deterioration caused by the imaging system, and
wherein the setting unit sets the image restoration information based on the first image restoration information, the first editing value, and the second image restoration information.

7 . The image processing apparatus according to claim 6 , wherein the setting unit comprises:
a first calculation unit configured to, based on the first image restoration information and the first editing value, calculate a first revision image restoration filter revised to correct the image deterioration caused by the imaging system; a second calculation unit configured to, based on the second image information, calculate a second image restoration filter for correcting image deterioration caused by the image forming system; and a third calculation unit configured to combine the first revision image restoration filter calculated by the first calculation unit and the second image restoration filter calculated by the second calculation unit, and obtain a result of the combination as the image restoration information.

8 . The image processing apparatus according to claim 6 , wherein the second acquisition unit further acquires first additional information, and
wherein the setting unit sets the image restoration information based on the first image restoration information, the first editing value, the first additional information, and the second image restoration information.

9 . The image processing apparatus according to claim 8 , wherein the first additional information is any of a focus position, a stop (an f-value), a focal length, position information of an image, a number of connected images, a surface shape, and gloss information.

10 . The image processing apparatus according to claim 3 , wherein the correction unit comprises a magnification unit configured to change a magnification of the captured image by a magnification according to an output size of an image in the image forming system, and is configured to correct, by the image restoration process, the captured image of which the magnification is changed by the magnification unit, and
wherein the first calculation unit calculates the first image restoration filter in such a manner that a strength of the first image restoration filter changes according to the magnification.

11 . The image processing apparatus according to claim 1 , further comprising a determination unit configured to determine whether the second image information is acquired by the third acquisition unit,
wherein the setting unit comprises: a fifth calculation unit configured to, based on the first image information, calculate a third image restoration filter used in an image restoration process performed by the imaging system; and a sixth calculation unit configured to, in a case where the determination unit determines that the second image information is not acquired, calculate as the image restoration information a fourth image restoration filter having an image restoration strength proportional to an image restoration strength of the third image restoration filter calculated by the fifth calculation unit.

12 . The image processing apparatus according to claim 11 , wherein in a case where the image restoration strength of the third image restoration filter is equal to or greater than a predetermined value, the sixth calculation unit sets the image restoration strength of

Assignees

• Canon Kk

Inventors

• Yanai Tomokazu

Classifications

• G06T5/003 Primary

  Physics · mapped topic

• G06T5/20

  using local operators · CPC title

• G06T5/73 Primary

  Deblurring; Sharpening · CPC title