Image processing apparatus, image processing method, and storage medium

Patent metadata

Field	Value
Publication number	US-2016148380-A1
Application number	US-201514943204-A
Country	US
Kind code	A1
Filing date	Nov 17, 2015
Priority date	Nov 20, 2014
Publication date	May 26, 2016
Grant date	—

Abstract

An image processing apparatus includes: an obtaining unit configured to obtain corresponding points group information for associating a position in an image captured in a first deformation state with a position in an image captured in a second deformation state; a calculation unit configured to calculate deformation from the image captured in the first deformation state to the image captured in the second deformation state based on the corresponding points group information; a display control unit configured to display, on a display unit, deformation progress information of an image based on the deformation calculated by the calculation unit; and a correction unit configured to correct the corresponding points group information. The calculation unit calculates the deformation based on the corresponding points group information corrected by the correction unit.

First claim

What is claimed is:

1 . An image processing apparatus comprising:
an obtaining unit configured to obtain corresponding points group information for associating a position in an image captured in a first deformation state with a position in an image captured in a second deformation state; a calculation unit configured to calculate deformation from the image captured in the first deformation state to the image captured in the second deformation state based on the corresponding points group information; a display control unit configured to display, on a display unit, deformation progress information of an image based on the deformation calculated by the calculation unit; and a correction unit configured to correct the corresponding points group information, wherein the calculation unit calculates the deformation based on the corresponding points group information corrected by the correction unit.

2 . The apparatus according to claim 1 , wherein
the deformation progress information is intermediate deformation information representing deformation in a halfway state of calculation processing by the calculation unit, when the correction unit performs the correction, the calculation unit interrupts the calculation processing of calculating the deformation in accordance with an operation input for instructing to interrupt the calculation processing, and after completion of the correction by the correction unit, the calculation unit restarts the calculation processing of calculating the deformation based on the corrected corresponding points group information in accordance with an operation input for instructing to restart the interrupted calculation processing.

3 . The apparatus according to claim 2 , further comprising:
an instruction obtaining unit configured to obtain an instruction of a processing step to be traced back in the interrupted calculation processing, wherein after the instruction obtaining unit instructs the processing step to be traced back and the correction of the corresponding points group information is completed, the calculation unit restarts the calculation processing of calculating the deformation from a processing step reached by tracing back the instructed processing step, based on the corrected corresponding points group information.

4 . The apparatus according to claim 1 , further comprising:
a generation unit configured to generate the deformation progress information by obtaining a calculation result indicating a halfway state of the deformation from the calculation unit, wherein the display control unit displays the generated deformation progress information on the display unit.

5 . The apparatus according to claim 1 , wherein
the calculation unit executes the processing of calculating the deformation by using, in combination, an algorithm of calculating the deformation and a high-speed algorithm capable of performing processing at higher speed than the algorithm, and the display control unit obtains deformation information based on processing of the high-speed algorithm as the deformation progress information, and displays the deformation progress information on the display unit.

6 . The apparatus according to claim 5 , wherein the calculation unit obtains the deformation progress information by applying the high-speed algorithm to a calculation result representing a halfway state of the algorithm of calculating the deformation.

7 . The apparatus according to claim 1 , wherein while the correction unit inputs correction information for correcting the corresponding points group information, the calculation unit performs the deformation calculation processing in a background.

8 . The apparatus according to claim 7 , wherein while the correction unit inputs the correction information for correcting the corresponding points group information, the display control unit obtains deformation information indicating a halfway state of the deformation in the background and displays the deformation information on the display unit.

9 . The apparatus according to claim 7 , wherein while the correction unit inputs the correction information for correcting the corresponding points group information, the display control unit stops update of display based on the obtained deformation information.

10 . The apparatus according to claim 7 , wherein
the display control unit stops update of display based on the obtained deformation information with respect to a partial region designated to correct the corresponding points group information, and obtains deformation information indicating a halfway state of the deformation with respect to a region other than the designated partial region, and displays the deformation information on the display unit.

11 . The apparatus according to claim 1 , wherein
the calculation unit can execute processing of calculating the deformation by using a low-speed algorithm of calculating the deformation and a high-speed algorithm in which accuracy of calculation processing is lower than that of the low-speed algorithm and which is capable of executing the calculation processing at high speed, the calculation unit calculates the deformation using the high-speed algorithm, the display control unit obtains deformation information based on processing of the high-speed algorithm as the deformation progress information, and displays the deformation progress information on the display unit, and if the correction unit does not correct the corresponding points group information based on the display, the calculation unit calculates the deformation using the low-speed algorithm.

12 . The apparatus according to claim 11 , wherein
the display control unit obtains the deformation progress information based on processing of the low-speed algorithm, and displays the deformation progress information on the display unit, and if the correction unit corrects the corresponding points group information based on the display, the calculation unit calculates the deformation using the high-speed algorithm by setting a calculation result of the low-speed algorithm as an initial value.

13 . The apparatus according to claim 1 , further comprising:
a progress prediction unit configured to obtain, as progress information, a ratio of the number of steps having undergone calculation processing to the total number of steps to be executed by the calculation unit to calculate the deformation, wherein the display control unit displays the deformation progress information and the progress information on the display unit.

14 . An image processing method, comprising the steps of:
obtaining corresponding points group information for associating a position in an image captured in a first deformation state with a position in an image captured in a second deformation state; calculating deformation from the image captured in the first deformation state to the image captured in the second deformation state based on the corresponding points group information; displaying, on a display unit, deformation progress information of an image based on the deformation calculated in the step of calculating; correcting the corresponding points group information; and calculating the deformation based on the corrected corresponding points group information.

15 . A computer-readable storage medium storing a program for causing a computer to function as each unit of an image processing apparatus, the image processing apparatus comprising:
an obtaining unit configured to obtain corresponding points group information for associating a position in an image captured in a first deformation

Assignees

• Canon Kk

Inventors

• Otomaru Itaru
• Miyasa Kazuhiro
• Ishikawa Ryo

Classifications

• G06T7/33 Primary

  using feature-based methods · CPC title

• G06V10/754

  involving a deformation of the sample pattern or of the reference pattern; Elastic matching · CPC title

• G06K9/4638

  Physics · mapped topic

• G06T7/0024 Primary

  Physics · mapped topic

• G06T7/0089

  Physics · mapped topic