Image correction apparatus for correcting distortion of an image

Patent metadata

Field	Value
Publication number	US-9589333-B2
Application number	US-201414559535-A
Country	US
Kind code	B2
Filing date	Dec 3, 2014
Priority date	Dec 24, 2013
Publication date	Mar 7, 2017
Grant date	Mar 7, 2017

Abstract

An image correction apparatus for correcting distortion of an image, the image being obtained by photographing a subject, which is provided with a specifying unit for specifying a relationship in position between points on the subject in a three-dimensional space based on both a relationship in position between the points on the subject in the image in a two-dimensional space and a photographing angle relative to a surface of the subject, an obtaining unit for obtaining information of distortion of the image that is reflected by the relationship in position between the points on the subject in the three-dimensional space, specified by the specifying unit, and a correcting unit for correcting the distortion of the image based on the information of distortion of the image obtained by the obtaining unit.

First claim

What is claimed is:

1. An image correction apparatus for correcting distortion of an image, the image being obtained by photographing a subject, the apparatus comprising:
a camera which photographs the subject to obtain the image; and
a control unit which comprises a CPU that is configured to:
specify a relationship in position between points on the subject in a three-dimensional space based on both a relationship in position between the points on the subject in the image in a two-dimensional space and a photographing angle relative to a surface of the subject;
obtain information of distortion of the image that is reflected by the specified relationship in position between the points on the subject in the three-dimensional space; and
correct the distortion of the image based on the obtained information of distortion of the image,

wherein the subject is paper on which at least one of characters and a figure are drawn and wherein when the subject has a flat surface in a normal state, the image of the subject has not been made distorted,
wherein configuration lines are set on the image respectively in a character string direction and in a character line direction in consideration of a feature of character strings in the image of the flat surface of the subject,
wherein plural small sections are set on the image based on a relationship between the configuration lines set in the character string direction and in the character line direction and based on an assumption of moving directions of the configuration lines in the three-dimensional space,
wherein information representing distortion of each of the plural small sections is specified, and
wherein the plural small sections are changed based on the specified information representing the distortion of each of the plural small sections, thereby correcting the distortion of the image.

2. The image correction apparatus according to claim 1 , wherein the CPU is further configured to specify the relationship in position between the points in the image in the three-dimensional space, based on the assumption that the points on the subject move in specific directions in the three-dimensional space when the surface of the subject is curved.

3. The image correction apparatus according to claim 2 , wherein the CPU is further configured to:
specify the relationship in position between the points in the image in the three-dimensional space by a distance between the points in the three-dimensional space; and
obtain coordinate positions of plural attention-points in the image as information of distortion, said plural attention-points having the specified relationship in position reflected by the distance between two points in the three-dimensional space.

4. The image correction apparatus according to claim 2 , wherein the CPU is further configured to specify the relationship in position between the points on the subject in the three-dimensional space, based on the assumption that the relationship in position between the points on the subject is known, and when there is a discrepancy between an estimated relationship in position estimated as a relationship in position between the points on the subject in an image in the two-dimensional space, wherein the image is obtained when the subject kept in a not curved state is photographed from diagonally at a prescribed angle, and a real relationship in position between the points on the subject in an image in the two-dimensional space, wherein the image is obtained by actually photographing the subject, and said discrepancy between the estimated relationship in position and the real relationship in position has been caused by the movement of the points in the specific directions.

5. The image correction apparatus according to claim 4 , wherein the points on the subject whose relationship in position is known are plural points on a first straight line in the character string direction on the subject, and
wherein the CPU is further configured to obtain coordinate positions of plural attention-points on a first configuration line on the image as the information of distortion, wherein the first configuration line corresponds to the first straight line.

6. The image correction apparatus according to claim 5 , wherein the CPU is further configured to:
detect directions of character strings at plural positions in the image, secure conformity in the detected directions of character strings to obtain a configuration line, and set the obtained configuration line as the first configuration line in the image, and
obtain, as the information of distortion, the first set configuration line and coordinate positions of the plural attention-points set at equal intervals on the first set configuration line in a three-dimensional space.

7. The image correction apparatus according to claim 6 , wherein the CPU is further configured to:
set plural first configuration lines in the image, wherein the plural first configuration lines correspond respectively to plural first straight lines which are parallel to each other on the subject, and specify a relationship in position between points on each of the configuration lines in the three-dimensional space, and
obtain, as the information of distortion, the set plural first configuration lines and coordinate positions of the plural attention-points respectively on the plural first configuration lines.

8. The image correction apparatus according to claim 7 , wherein the CPU is further configured to:
set plural second configuration lines in the image, which lines correspond respectively to plural second straight lines parallel to each other and crossing with the plural first straight lines at right angles on the subject, and further cross with the plural first configuration lines at the plural attention-points, and
obtain the plural second configuration lines as the information of distortion.

9. The image correction apparatus according to claim 8 , wherein the CPU is further configured to perform projective transformation to transform a shape of each of plural unit areas corresponding to the plural small sections into a square area, wherein the unit areas are defined by the plural first configuration lines and the plural second configuration lines, thereby correcting distortion of the image.

10. The image correction apparatus according to claim 9 , wherein the CPU is further configured to connect the unit areas subjected to the projective transformation and transformed into square areas to each other, thereby generating a distortion-corrected image.

11. The image correction apparatus according to claim 8 , wherein the CPU is further configured to detect plural positions in the image where directions of character lines cross with the directions of the character strings at right angles on the subject, and secure conformity in the directions of character lines at the detected plural positions to obtain a configuration line, thereby setting the obtained configuration line as a second configuration line in the image.

12. The image correction apparatus according to claim 8 , wherein the CPU is further configured to:
set the first configuration line as a reference line in the image,
set plural division points on the first configuration line set as the reference line at equal intervals in the three-dimensional space, based on a distance between two adjacent points specified on the first configuration line in the three-dimensional space,
set plural configuration lines in directions of character lines crossing with the first configuration line set as the reference line at the plural division points, as the plural second configuration lines,
set plural division points on a se

Assignees

• Casio Computer Co Ltd

Inventors

• Maeno Yasushi

Classifications

• G06T2207/30176

  Document · CPC title

• G06T5/006 Primary

  Physics · mapped topic

• G06T5/80 Primary

  Geometric correction · CPC title