Image correction method and apparatus using creation of feature points

Patent metadata

Field	Value
Publication number	US-10043094-B2
Application number	US-201414447983-A
Country	US
Kind code	B2
Filing date	Jul 31, 2014
Priority date	Aug 1, 2013
Publication date	Aug 7, 2018
Grant date	Aug 7, 2018

Abstract

An image correction method of smoothly correcting an image maps an additional feature point on an image on which a plurality of feature points is mapped and move other feature points together when a specific feature point is moved, a smoothly corrected image can be created, in a manner of: mapping a plurality of feature points on an image, where the plurality of feature points are set as a feature point of forced position or a feature point of unforced position, respectively; mapping additional feature points on the image; and changing positions of feature points of unforced position among the feature points and the additional feature points when a specific feature point is moved.

First claim

The invention claimed is:

1. An image correction method implemented by an image correction device comprising an application specific integrated circuit (ASIC) to execute the method comprising steps of:
(a) mapping a plurality of feature points on an image, by an image correction apparatus, wherein the plurality of feature points are set as feature points of forced position or feature points of unforced position, respectively;
(b) mapping additional feature points on the image, by the image correction apparatus, wherein the additional feature points are also set as feature points of forced position or feature points of unforced position; and
(c) changing positions corresponding to the feature points of unforced position among the features points of forced positions and the feature points of unforced position to thereby relocate the feature points of unforced position on the image, and not changing positions corresponding to the feature points of forced positions,
when a specific feature point among the plurality of feature points mapped on the image is determined to be moved, and the specific feature point indicates a feature point previously set to be the unforced position,
wherein the feature points are vertexes of a mesh mapped on the image, and vertexes of unforced position are relocated based on position information of vertexes connected to the vertexes of unforced position in the mesh structure.

2. The method according to claim 1 , wherein at the step (b), the image correction apparatus maps the additional feature points on the image if it is determined that, based on external input information or internal operation information, correction is needed for a specific area of the image.

3. The method according to claim 1 , wherein the feature points are vertexes of a mesh mapped on the image.

4. The method according to claim 3 , wherein the mesh is a polygonal mesh based on a polygon.

5. The method according to claim 4 , wherein the mesh is a triangular mesh based on a triangle, wherein a structure of the mesh is modified by connecting an additional vertex to each of three vertexes configuring the triangle if the additional vertex is mapped inside the triangle and by connecting an additional vertex to each of two vertexes facing the segment if the additional vertex is mapped on a segment of the mesh.

6. The method according to claim 1 , wherein the vertexes of unforced position can be relocated based on a mathematical expression shown below,

V
i

-

1
N

⁢

∑

j
=
1

N

⁢

V
i

=
0

,

wherein, in the mathematical expression, Vi denotes a position for relocating a vertex of unforced position, Vj denotes a position of a vertex connected to the vertex of unforced position, and N denotes the number of vertexes connected to the vertex of unforced position.

7. The method according to claim 1 , wherein the image is an image projected on a surface of a wall of a theater.

8. An image correction device comprising an application specific integrated circuit (ASIC) to correct an image,
the application specific integrated circuit (ASIC) to implement
a storage unit for storing the image;
an image correction unit for
mapping a plurality of feature points on the image,
mapping additional feature points and
correcting the image using the feature points, wherein the image correction unit sets the plurality of feature points as feature points of forced position or feature points of unforced position, respectively, wherein the additional feature points are also set as feature points of forced position or feature points of unforced position; and

an input unit for receiving information,
wherein the image correction unit changes positions corresponding to the feature points of unforced position among the features points of forced positions and the feature points of unforced position to thereby relocate the feature points of unforced position on the image to thereby relocate the feature points of unforced position, and maintains positions corresponding to the feature points of forced positions,
when a specific feature point among the plurality of feature points mapped on the image is determined to be moved based on information input through the input unit, and the specific feature point indicates a feature point previously set to be the unforced position,

wherein the feature points are vertexes of a mesh mapped on the image, and vertexes of unforced position are relocated based on position information of vertexes connected to the vertexes of unforced position in the mesh structure.

9. The device according to claim 8 , wherein the image correction unit maps the additional feature point if it is determined that, based on external input information or internal operation information, correction is needed for a specific area of the image.

10. The device according to claim 8 , wherein the feature points are vertexes of a mesh mapped on the image.

11. The device according to claim 10 , wherein the mesh is a polygonal mesh based on a polygon.

12. The device according to claim 11 , wherein the mesh is a triangular mesh based on a triangle, wherein the image correction unit modifies a structure of the mesh by connecting an additional vertex to each of three vertexes configuring the triangle if the additional vertex is mapped inside the triangle and by connecting an additional vertex to each of two vertexes facing the segment if the additional vertex is mapped on a segment of the mesh.

13. The device according to claim 8 , wherein the image correction unit relocates the vertexes of unforced position based on a mathematical expression shown below,

V
i

-

1
N

⁢

∑

j
=
1

N

⁢

V
i

=
0.

wherein, in the mathematical expression, Vi denotes a position for relocating a vertex of unforced position, Vj denotes a position of a vertex connected to the vertex of unforced position, and N denotes the number of vertexes connected to the vertex of unforced position.

Assignees

• Cj Cgv Co Ltd

Inventors

• Kim Hwan Chul
• Kang Su Ryeon

Classifications

• H04N9/3194

  including sensor feedback · CPC title

• H04N9/3185

  Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14) · CPC title

• G06T5/70 Primary

  Denoising; Smoothing · CPC title

• G06K9/4604 Primary

  Physics · mapped topic

• G06T3/0093

  Physics · mapped topic