Matrix capture of large scanned documents

Patent metadata

Field	Value
Publication number	US-9674396-B1
Application number	US-201514967462-A
Country	US
Kind code	B1
Filing date	Dec 14, 2015
Priority date	Dec 17, 2014
Publication date	Jun 6, 2017
Grant date	Jun 6, 2017

Abstract

Enhancing image quality of an initial full image of a document includes subdividing the initial full image of the document into a number of segments, directing a user to take photographs with a smartphone to provide a separate segment image for each of the segments by presenting on a screen of the smartphone a view of the document having lines superimposed thereon corresponding to the segments, and merging the separate segment images to provide an enhanced full image. The number of segments may depend upon a size of text in the initial full image and a desired height of text in the enhanced full image. The initial full image may be provided by a photograph taken by the user with the smartphone. The view of the document having lines superimposed thereon corresponding to the segments may provide a target to the user for photographing the segments.

First claim

What is claimed is:

1. A method of enhancing image quality of an initial full image of a document, comprising:
subdividing the initial full image of the document into a number of segments;
directing a user to take photographs with a smartphone to provide a separate segment image for each of the segments by presenting on a screen of the smartphone a view of the document having lines superimposed thereon corresponding to the segments; and
merging the separate segment images to provide an enhanced full image.

2. A method, according to claim 1 , wherein the number of segments depends upon a size of text in the initial full image and a desired height of text in the enhanced full image.

3. A method, according to claim 1 , wherein the document is one of: a page from a book, a page from a magazine, a printed newspaper article, a receipt, an invoice, a check, a tax form or other form, a printed report, one or more business cards, a handwritten note, a memo on a legal pad, a page from a specialized Moleskine® notebook, a specialized Moleskine® sticky note, and an easel.

4. A method, according to claim 1 , wherein the initial full image is provided by a photograph taken by the user with the smartphone.

5. A method, according to claim 1 , wherein the view of the document having lines superimposed thereon corresponding to the segments provides a target to the user for photographing the segments.

6. A method, according to claim 1 , wherein, in response to the user successfully photographing a particular segment, a visual indicator is provided on the particular segment in the view of the document having lines superimposed thereon corresponding to the segments.

7. A method, according to claim 1 , wherein instructions for photographing non-captured segments are provided to the user on the screen of the smartphone.

8. A method, according to claim 7 , wherein the instructions include an arrow indicating a recommended next one of the segments to photograph and a recommended navigation path across non-captured segments.

9. A method, according to claim 8 , wherein in response to a user photographing a particular segment that is not the recommended next one of the segments, the navigation path is adjusted.

10. A method, according to claim 8 , wherein in response to a user photographing a particular segment that is not the recommended next one of the segments, the user is provided with an option to delete the segment image corresponding to the particular segment.

11. A method, according to claim 8 , wherein in response to a user photographing a particular segment that is not the recommended next one of the segments, the user is provided with an option to indicate that the corresponding segment image is for a different segment in the view of the document having lines superimposed thereon corresponding to the segments.

12. A method, according to claim 1 , wherein the smartphone automatically detects which of the segments has been photographed by the user.

13. A method, according to claim 1 , wherein a captured image is automatically deleted in response to a quality of the image being relatively low.

14. A method, according to claim 1 , wherein a user is provided with an option to delete an image in response to obstructions being detected in the image.

15. A method, according to claim 1 , wherein the smartphone includes at least one of: software that is pre-loaded with the smartphone, software that is installed from an app store, software that is installed from a desktop, software that is installed from media, and software that is downloaded from a Web site.

16. A method, according to claim 1 , wherein the smartphone uses an operating system selected from the group consisting of: iOS, Android OS, Windows Phone OS, Blackberry OS and mobile versions of Linux OS.

17. A non-transitory computer-readable medium containing software that enhances image quality of an initial full image of a document, the software comprising:
executable code that subdivides the initial full image of the document into a number of segments;
executable code that directs a user to take photographs with a smartphone to provide a separate segment image for each of the segments by presenting on a screen of the smartphone a view of the document having lines superimposed thereon corresponding to the segments; and
executable code that merges the separate segment images to provide an enhanced full image.

18. A non-transitory computer-readable medium, according to claim 17 , wherein the number of segments depends upon a size of text in the initial full image and a desired height of text in the enhanced full image.

19. A non-transitory computer-readable medium, according to claim 17 , wherein the document is one of: a page from a book, a page from a magazine, a printed newspaper article, a receipt, an invoice, a check, a tax form or other form, a printed report, one or more business cards, a handwritten note, a memo on a legal pad, a page from a specialized Moleskine® notebook, a specialized Moleskine® sticky note, and an easel.

20. A non-transitory computer-readable medium, according to claim 17 , wherein the initial full image is provided by a photograph taken by the user with the smartphone.

21. A non-transitory computer-readable medium, according to claim 17 , wherein the view of the document having lines superimposed thereon corresponding to the segments provides a target to the user for photographing the segments.

22. A non-transitory computer-readable medium, according to claim 17 , wherein, in response to the user successfully photographing a particular segment, a visual indicator is provided on the particular segment in the view of the document having lines superimposed thereon corresponding to the segments.

23. A non-transitory computer-readable medium, according to claim 17 , wherein instructions for photographing non-captured segments are provided to the user on the screen of the smartphone.

24. A non-transitory computer-readable medium, according to claim 23 , wherein the instructions include an arrow indicating a recommended next one of the segments to photograph and a recommended navigation path across non-captured segments.

25. A non-transitory computer-readable medium, according to claim 24 , wherein in response to a user photographing a particular segment that is not the recommended next one of the segments, the navigation path is adjusted.

26. A non-transitory computer-readable medium, according to claim 24 , wherein in response to a user photographing a particular segment that is not the recommended next one of the segments, the user is provided with an option to delete the segment image corresponding to the particular segment.

27. A non-transitory computer-readable medium, according to claim 24 , wherein in response to a user photographing a particular segment that is not the recommended next one of the segments, the user is provided with an option to indicate that the corresponding segment image is for a different segment in the view of the document having lines superimposed thereon corresponding to the segments.

28. A non-transitory computer-readable medium, according to claim 17 , wherein the smartphone automatically detects which of the segments has been photographed by the user.

29. A non-transitory computer-readable medium, according to claim 17 , wherein a captured image is automatic

Assignees

• Evernote Corp

Inventors

• Pashintsev Alexander
• Gorbatov Boris
• Kitainik Leonid

Classifications

• H04N1/19594

  using a television camera or a still video camera · CPC title

• H04N1/3876 Primary

  Recombination of partial images to recreate the original image · CPC title

• H04N1/04

  Scanning arrangements {, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa}(H04N1/387 takes precedence) · CPC title

• H04N1/00442

  Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails · CPC title

• H04N1/0443

  Varying the scanning velocity or position · CPC title