Local enhancement of large scanned documents

Patent metadata

Field	Value
Publication number	US-10038818-B2
Application number	US-201715614373-A
Country	US
Kind code	B2
Filing date	Jun 5, 2017
Priority date	Dec 17, 2014
Publication date	Jul 31, 2018
Grant date	Jul 31, 2018

Abstract

Enhancing image quality of an initial full image of a document includes subdividing the initial full image of the document into a number of segments, determining at least one of the segments for enhancement, directing a user to take photographs with a smartphone to provide a separate segment image for the at least one of the segments by presenting on a screen of the smartphone a view of the document having lines superimposed thereon corresponding to the segments, and merging the separate segment image to provide an enhanced full image. The number of segments may depend upon a size of text in the initial full image and a desired height of text in the enhanced full image. The view of the document having lines superimposed thereon corresponding to the segments may provide a target to the user for photographing the at least one of the segments.

First claim

What is claimed is:

1. A method of enhancing image quality of an initial full image of a document, comprising:
enabling display of the initial full image on a display of a mobile device associated with a user;
subdividing the initial full image of the document into a number of segments;
determining at least one of the segments of the document for enhancement;
in accordance with a determination of the at least one of the segments for enhancement, generating a capturing instruction for display on the display of the mobile device to direct the user to take a photograph of the at least one of the segments in the initial full image using the mobile device, wherein the photograph provides a separate segment image for the at least one of the segments, and the capturing instruction includes a visual indicator that is displayed on the initial full image and indicates the at least one of the segments to photograph; and
merging the separate segment image into the initial full image to provide an enhanced full image.

2. The method of claim 1 , wherein the capturing instruction further comprises an instruction to present on a display of the mobile device a view of the document having lines superimposed thereon according to the segments of the document, wherein the lines are configured to facilitating taking the photograph.

3. The method of claim 2 , further comprising:
in response to obtaining the separate segment image corresponding to the at least one of the segments, enabling display of a visual indicator on the at least one of the segments in the view of the document having the lines superimposed thereon corresponding to the segments.

4. The method of claim 1 , further comprising:
determining the number of segments according to at least a size of text in the initial full image and a desired height of text in the enhanced full image.

5. The method of claim 1 , wherein the document is one of: a page from a book, a page from a magazine, a printed newspaper article, a receipt, an invoice, a check, a tax form or other form, a printed report, one or more business cards, a handwritten note, a memo on a legal pad, a page from a notebook application, a sticky note application, and an easel.

6. The method of claim 1 , further comprising:
enabling display of an arrow for indicating a next one of the segments to photograph and a navigation path across a subset of non-captured segments, wherein the next one of the segments follows the at least one of the segments on the navigation path and is recommended for being captured in a second separate segment image.

7. The method of claim 6 , further comprising:
in response to a user photographing a particular segment that is distinct from the recommended next one of the segments, adjusting the navigation path to include the particular segment.

8. The method of claim 6 , further comprising:
in response to a user photographing a particular segment that is distinct from the recommended next one of the segments, enabling an option to delete a segment image corresponding to the particular segment.

9. The method of claim 6 , further comprising:
in response to a user photographing a particular segment that is distinct from the recommended next one of the segments, providing an option to indicate that a segment image corresponding to the particular segment is distinct from the next one of the segments.

10. A computer system, comprising:
one or more processors; and
memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:
enabling display of the initial full image on a display of a mobile device associated with a user;
subdividing the initial full image of the document into a number of segments;
determining at least one of the segments of the document for enhancement;
in accordance with a determination of the at least one of the segments for enhancement, generating a capturing instruction for display on the display of the mobile device to direct the user to take a photograph of the at least one of the segments in the initial full image using the mobile device, wherein the photograph provides a separate segment image for the at least one of the segments, and the capturing instruction includes a visual indicator that is displayed on the initial full image and indicates the at least one of the segments to photograph; and
merging the separate segment image into the initial full image to provide an enhanced full image.

11. The computer system of claim 10 , wherein the one or more programs further comprise instructions for:
determining the number of segments according to at least a size of text in the initial full image and a desired height of text in the enhanced full image.

12. The computer system of claim 10 , wherein the document is one of: a page from a book, a page from a magazine, a printed newspaper article, a receipt, an invoice, a check, a tax form or other form, a printed report, one or more business cards, a handwritten note, a memo on a legal pad, a page from a notebook application, a sticky note application, and an easel.

13. The computer system of claim 10 , wherein the initial full image is provided by a photograph taken by the user with the mobile device.

14. The computer system of claim 10 , wherein the one or more programs further comprise instructions for:
determining a quality of the separate segment image taken for the at least one of the segments; and
in accordance with a determination that the quality of the separate segment image is substantially low, automatically deleting the separate segment image.

15. The computer system of claim 10 , wherein the one or more programs further comprise instructions for:
providing an option to delete an image in response to detecting an obstructions in the separate segment image.

16. A non-transitory computer readable storage medium storing one or more programs configured for execution by a computer system, the one or more programs comprising instructions for:
enabling display of the initial full image on a display of a mobile device associated with a user;
subdividing the initial full image of the document into a number of segments;
determining at least one of the segments of the document for enhancement;
in accordance with a determination of the at least one of the segments for enhancement, generating a capturing instruction for display on the display of the mobile device to direct the user to take a photograph of the at least one of the segments in the initial full image using the mobile device, wherein the photograph provides a separate segment image for the at least one of the segments, and the capturing instruction includes a visual indicator that is displayed on the initial full image and indicates the at least one of the segments to photograph; and
merging the separate segment image into the initial full image to provide an enhanced full image.

17. The non-transitory computer readable storage medium of claim 16 , wherein the capturing instruction further comprises an instruction to present on a display of the mobile device a view of the document having lines superimposed thereon according to the segments of the document, wherein the lines are configured to facilitating taking the photograph.

18. The non-transitory computer readable storage medium of claim 17 , wherein the one or more programs further comprise instructions for:
in response to obtaining the separate segment image corresponding to the at least one of the segments, enabling display of a visual indicator on t

Assignees

• Evernote Corp

Inventors

• Pashintsev Alexander
• Gorbatov Boris
• Kitainik Leonid

Classifications

• H04N1/19594

  using a television camera or a still video camera · CPC title

• H04N1/3876 Primary

  Recombination of partial images to recreate the original image · CPC title

• H04N1/0443

  Varying the scanning velocity or position · CPC title

• H04N1/04

  Scanning arrangements {, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa}(H04N1/387 takes precedence) · CPC title

• H04N1/00442

  Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails · CPC title