Image correcting apparatus, image correcting method and storage medium

Patent metadata

Field	Value
Publication number	US-9652891-B2
Application number	US-201615002149-A
Country	US
Kind code	B2
Filing date	Jan 20, 2016
Priority date	Mar 18, 2015
Publication date	May 16, 2017
Grant date	May 16, 2017

Abstract

An image correcting apparatus includes an input unit and a processor. The input unit receives instruction inputs from a user. The processor performs processes including: displaying an image to be processed, and a mesh image superimposed on said corresponding image, on a display device; deforming a shape of the mesh image based on the instruction inputs; generating a conversion matrix representing coordinates after curvature correction of pixels constituting the image to be processed, based on the deformed shape of the mesh image; updating a recording matrix representing conversion histories of pixels constituting an original image, based on the coordinates represented by the generated conversion matrix; and performing curvature correction on the original image based on the updated recording matrix.

First claim

What is claimed is:

1. An image correcting apparatus comprising:
an input unit that receives instruction inputs from a user; and
a processor that performs processes including:
displaying an image to be processed, and a mesh image superimposed on said corresponding image, on a display device;
deforming a shape of the mesh image based on the instruction inputs;
generating a conversion matrix representing coordinates after curvature correction of pixels constituting the image to be processed, based on the deformed shape of the mesh image;
updating a recording matrix representing conversion histories of pixels constituting an original image, based on the coordinates represented by the generated conversion matrix; and
performing curvature correction on the original image based on the updated recording matrix.

2. The apparatus according to claim 1 , wherein:
in a second or subsequent curvature correction, the updating updates the recording matrix by replacing coordinates represented by a recording matrix used in a previous curvature correction with corresponding pixel coordinates representing in the conversion matrix.

3. The apparatus according to claim 1 , wherein:
in a second or subsequent curvature correction, the displaying displays a processed image obtained by the curvature correction and the mesh image superimposed on the corresponding processed image, on the display device.

4. The apparatus according to claim 1 , wherein
the performing performs the curvature correction by performing perspective conversion on the original image based on the updated recording matrix.

5. The apparatus according to claim 1 , wherein:
the displaying draws the mesh image by quartic Bezier curves; and
the deforming deforms a shape of the mesh image by moving control points of the Bezier curves based on the instruction inputs.

6. An image correcting method comprising:
displaying an image to be processed, and a mesh image superimposed on said corresponding image, on a display device;
receiving instruction inputs from a user;
deforming a shape of the mesh image based on the instruction inputs;
generating a conversion matrix representing coordinates after curvature correction of pixels constituting the image to be processed, based on the deformed shape of the mesh image;
updating a recording matrix representing conversion histories of pixels constituting an original image, based on the coordinates represented by the generated conversion matrix; and
performing curvature correction on the original image based on the updated recording matrix.

7. The method according to claim 6 , wherein: in a second or subsequent curvature correction, the updating updates the recording matrix by replacing coordinates represented by a recording matrix used in a previous curvature correction with corresponding pixel coordinates representing in the conversion matrix.

8. The method according to claim 6 , wherein:
in a second or subsequent curvature correction, the displaying displays a processed image obtained by the curvature correction and the mesh image superimposed on the corresponding processed image, on the display device.

9. The method according to claim 6 , wherein
the performing performs the curvature correction by performing perspective conversion on the original image based on the updated recording matrix.

10. The method according to claim 6 , wherein:
the displaying draws the mesh image by quartic Bezier curves; and
the deforming deforms a shape of the mesh image by moving control points of the Bezier curves based on the instruction inputs.

11. A no-transitory computer-readable storage medium having stored thereon a program executable by a computer, the program controlling the computer to perform functions comprising:
displaying an image to be processed, and a mesh image superimposed on said corresponding image, on a display device;
receiving instruction inputs from a user;
deforming a shape of the mesh image based on the instruction inputs;
generating a conversion matrix representing coordinates after curvature correction of pixels constituting the image to be processed, based on the deformed shape of the mesh image;
updating a recording matrix representing conversion histories of pixels constituting an original image, based on the coordinates represented by the generated conversion matrix; and
performing curvature correction on the original image based on the updated recording matrix.

Assignees

• Casio Computer Co Ltd

Inventors

• Nimura Ryo

Classifications

• G06T17/20 Primary

  Finite element generation, e.g. wire-frame surface description, {tesselation} · CPC title

• G06V10/247

  by affine transforms, e.g. correction due to perspective effects; Quadrilaterals, e.g. trapezoids · CPC title

• G06V30/40

  Document-oriented image-based pattern recognition · CPC title

• G06T3/0093

  Physics · mapped topic

• G06T3/06 Primary

  Topological mapping of higher dimensional structures onto lower dimensional surfaces · CPC title