Methods and systems for correcting a document image

Patent metadata

Field	Value
Publication number	US-9317893-B2
Application number	US-201313851056-A
Country	US
Kind code	B2
Filing date	Mar 26, 2013
Priority date	Mar 26, 2013
Publication date	Apr 19, 2016
Grant date	Apr 19, 2016

Abstract

Aspects of the present invention relate to methods and systems for fitting a mesh to an image of a document page and correcting a distortion in the image of the document page using the mesh. A rectangular-form mesh may be overlaid on a displayed document image. Corner points in the rectangular-form mesh may be moved to coincide with corner points of a document page in the displayed document image, and a corner-aligned mesh may be overlaid on the displayed document image. A cubic Bezier curve may be fit to the top edge of the document page, a cubic Bezier curve may be fit to the bottom edge of the document page and an edge-aligned mesh may be overlaid on the displayed image. An inverse projective transformation may be applied to the patches of the mesh to correct the distortion in the image of the document page.

First claim

What is claimed is:

1. A method for generating a corrected document image of an image of a document page, said method comprising:
displaying a document image on a touch-enabled-device display;
overlaying a rectangular-form mesh on said displayed document image;
receiving a plurality of corner points;
overlaying a corner-aligned mesh on said displayed document image;
receiving a touch displacement comprising an initial touch point and a final touch point;
determining a nearest intermediate control point, wherein said nearest intermediate control point is an intermediate control point of an associated cubic Bezier curve, to said initial touch point;
adjusting an edge curve associated with said nearest intermediate control point based on said touch displacement;
generating an edge-aligned mesh based on said adjusted edge curve;
correcting a portion of said image of said document page corresponding to said edge-aligned mesh; and
generating a corrected document image, wherein said corrected document image comprises said corrected portion.

2. A method as described in claim 1 , wherein said corner-aligned mesh comprises a top edge and a bottom edge, wherein said top edge is a first cubic Bezier curve and said bottom edge is a second cubic Bezier curve.

3. A method as described in claim 2 , wherein said edge curve is associated with one of said top edge and said bottom edge.

4. A method as described in claim 1 , wherein receiving a first corner point in said plurality of corner points comprises:
receiving a touch gesture in a gesture processor; and
determining if said touch gesture is a drag gesture associated with a corner of said rectangular-form mesh.

5. A method as described in claim 4 , wherein said determining if said touch gesture is a drag gesture associated with a corner of said rectangular-form mesh comprises comparing an initial point associated with said touch gesture with a location of a vertex of said rectangular-form mesh.

6. A method as described in claim 4 , wherein said first corner point is associated with a final point associated with said drag gesture.

7. A method as described in claim 1 , wherein said adjusting an edge curve associated with said nearest intermediate control point comprises:
determining a touch-displacement distance;
determining a touch-displacement direction; and
adjusting a cubic Bezier curve associated with said edge curve by moving said nearest intermediate control point a distance corresponding to said touch-displacement distance in a direction corresponding to said touch-displacement direction.

8. A method as described in claim 1 , wherein said correcting comprises an inverse projective transformation.

9. A method as described in claim 8 , wherein said inverse projective transformation is applied in a fashion selected from the group consisting of a strip-by-strip fashion along a ruled direction in said edge-aligned mesh and a patch -by-patch fashion within said edge-aligned mesh.

10. A method as described in claim 9 , further comprising subdividing any patch in said edge-aligned mesh wherein a surface curvature associated with said any patch exceeds a first threshold.

11. A method as described in claim 1 further comprising overlaying an intermediate corner-aligned mesh on said displayed document image in response to receiving each of said corner points in said plurality of corner points.

12. A method for correcting an image of a document page, said method comprising:
displaying a document image on a touch-enabled-device display;
overlaying a rectangular-form mesh on said displayed document image;
receiving a plurality of corner points;
overlaying a corner-aligned mesh on said displayed document image;
receiving a touch displacement comprising an initial touch point and a final touch point;
determining a nearest intermediate control point, wherein said nearest intermediate control point is an intermediate control point of an associated cubic Bezier curve, to said initial touch point;
adjusting an edge curve associated with said nearest intermediate control point based on said touch displacement;
generating an edge-aligned mesh based on said adjusted edge curve; and
correcting a portion of said document image corresponding to said edge-aligned mesh.

13. A method as described in claim 12 , wherein said corner-aligned mesh comprises a top edge and a bottom edge, wherein said top edge is a first cubic Bezier curve and said bottom edge is a second cubic Bezier curve.

14. A method as described in claim 13 , wherein said edge curve is associated with one of said top edge and said bottom edge.

15. A method as described in claim 12 , wherein receiving a first corner point in said plurality of corner points comprises:
receiving a touch gesture in a gesture processor; and
determining if said touch gesture is a drag gesture associated with a corner of said rectangular-form mesh.

16. A method as described in claim 15 , wherein said determining if said touch gesture is a drag gesture associated with a corner of said rectangular-form mesh comprises comparing an initial point associated with said touch gesture with a location of a vertex of said rectangular-form mesh.

17. A method as described in claim 15 , wherein said first corner point is associated with a final point associated with said drag gesture.

18. A method as described in claim 12 , wherein said adjusting an edge curve associated with said nearest intermediate control point comprises:
determining a touch-displacement distance;
determining a touch-displacement direction; and
adjusting a cubic Bezier curve associated with said edge curve by moving said nearest intermediate control point a distance corresponding to said touch-displacement distance in a direction corresponding to said touch-displacement direction.

19. A method as described in claim 12 , further comprising subdividing any patch in said edge-aligned mesh wherein a surface curvature associated with said any patch exceeds a first threshold.

20. A method as described in claim 12 further comprising overlaying an intermediate corner-aligned mesh on said displayed document image in response to receiving each of said corner points in said plurality of corner points.

Assignees

• Sharp Lab Of America Inc

Inventors

• Chen Lawrence Shao-Hsien

Classifications

• G06K9/34

  Physics · mapped topic

• G06T3/0031 Primary

  Physics · mapped topic

• G06K2009/363

  Physics · mapped topic

• G06T3/06 Primary

  Topological mapping of higher dimensional structures onto lower dimensional surfaces · CPC title