Intelligent image correction with preview

Patent metadata

Field	Value
Publication number	US-9729755-B2
Application number	US-201113221969-A
Country	US
Kind code	B2
Filing date	Aug 31, 2011
Priority date	Aug 31, 2011
Publication date	Aug 8, 2017
Grant date	Aug 8, 2017

Abstract

As set forth herein, methods and systems for automated image defect detection. An input image is subjected to skew detection and contaminant detection. Upon detection of skew of and/or contaminants in the image data, correction data, including indicia of the contaminants/skew, correction angles and directions are calculated and displayed on an electronic representation of the document. Automatic correction may then be performed to correct the detected defects, allow the defects to remain, or re-scan the original document to generate new image data without the detected defects.

First claim

What is claimed is:

1. A method for automated image defect correction comprising: with a processor of a multifunction device, receiving input image data representative of a scanned document; analyzing the received input image data so as to detect at least one defect on the scanned document; generating, in response to an output of the analyzing indicating at least one defect is detected, a representation of the scanned document represented by the received image data inclusive of the at least one detected defect on an associated display of the multifunction device; generating, with the processor of the multifunction device, at least one of a graphical icon or a textual indicator in proximity to the at least one detected defect on the displayed document representation of the scanned image data on the associated display of the multifunction device designating and identifying the at least one detected defect; displaying, on the user interface of the multifunction device, a plurality of correction options in association with the representation of the scanned document corresponding to the at least one detected defect; receiving correction data representative of a selection of a correction option corresponding to correction of the at least one detected defect via the display of the multifunction device; and correcting the at least one detected defect on the scanned document of the input image data in accordance with the received correction data; wherein the analyzing input image data further comprises: for each of a plurality of groups of pixels of the received image data: calculating a density associated with the group of pixels, comparing the calculated density of the group of pixels to a predetermined threshold density value, and designating a binary representation of the group of pixels in accordance with the comparison, wherein a group having a density greater than or equal to the threshold is designated as one and a group having a density below the threshold is designated as a zero; and generating, on the display of the multifunction device, a binary representation of the input image data in accordance with the designation of each of the plurality of groups of pixels, wherein each group of the plurality of groups having a density greater than or equal to the threshold is depicted as a one and each group of the plurality of groups having a density below the threshold is depicted as a zero in the binary representation.

2. The method of claim 1 , further comprising:
calculating a first angle associated with the generated binary representation of the input image data corresponding to a correction angle; and
calculating a second angle associated with the generated binary representation of the input image data corresponding to a correction direction;
wherein the at least one detected defect corresponds to a skew of the input image data detected at least in part based on the first angle and the second angle.

3. The method of claim 2 , wherein receiving correction data further comprises calculating skew correction data in accordance with the first angle and the second angle; and
wherein correcting the input image data further comprises generating corrected image data of the input image data in accordance with application of the skew correction data thereto.

4. The method of claim 1 , wherein the analyzing input image data further comprises:
segmenting the input image data into a corresponding plurality of cells, each cell having a density content associated therewith;
designating each cell having a density content below a predetermined threshold value as contaminated; and
grouping one or more contaminated cells together based upon respective proximity thereto on the input image data,
wherein the at least one detected defect corresponds to a group designated as contaminated.

5. The method of claim 4 , further comprising:
performing optical character recognition on each contaminated cell so as to identify at least one character contained therein;
re-designating each cell having at least one identifiable character contained therein as uncontaminated based at least in part upon the output of the optical character recognition;
determining whether the at least one identifiable character in each cell is a mirrored character; and
maintaining the designation of each cell having at least one mirrored character as contaminated.

6. The method of claim 5 , further comprising re-designating each contaminated cell in a group as uncontaminated in accordance with a determination that the group corresponds to an allowed contaminant responsive to at least one of a user designation of allowance or a correspondence between the group and at least one of a previously stored watermark, embossment, design or non-native language character.

7. The method of claim 6 , wherein the correction data corresponds to an acceptance of the at least one detected defect, further comprising completing a preselected document processing operation in accordance with the received input image data.

8. The method of claim 6 , wherein the correction data corresponds to a re-generation of the input image data, further comprising completing an image generation operation so as to generate new input image data of the document.

9. A system for automated image defect detection comprising memory which stores instructions for performing the method of claim 1 and a processor in communication with the memory for executing the instructions.

10. A computer program product comprising a non-transitory recording medium storing instructions, which when executed by a computer causes the computer to perform the method of claim 1 .

11. An automated image defect correction system, comprising: a multifunction device, comprising: a processor; an associated user interface; and memory in communication with the processor, which stores instructions which are executed by the processor for: scanning a document to generate input image data representative of the scanned document, analyzing the document of the scanned input image data so as to detect at least one defect on the document, generating, in response to an output of the analysis indicating at least one defect is detected on the document, a representation on the associated user interface of the document of the scanned image data inclusive of the at least one detected defect, generating at least one of a graphical icon or a textual indicator in proximity to the at least one detected defect on the representation of the document of the scanned image data on the associated user interface identifying the at least one detected defect, generating, via the associated user interface, a plurality of correction options associated with the at least one detected defect, receiving, via the associated user interface, correction data representative of at least one selected correction option corresponding to a correction of the at least one detected defect, the at least one selected correction option selected from the group consisting of image rotation, spell check, rescanning the document, color matching, ignoring the at least one detected defect, identification of the at least one defect as an allowable defect, or removal of the at least one detected defect, correcting the at least one detected defect on the document of the scanned input image data in accordance with the selected correction option, and outputting, via the associated user interface, corrected image data representative of a corrected document; wherein the analyzing input image data further comprises: for each of a plurality of groups of pixels of the received image data: calculating a density associated with the group of pixels, comparing the calculated density of the group of p

Assignees

• Stuart Thomas William
• Raja Asad Khalid
• Bay Richard Henry
• Mills Samuel Luke
• Xerox Corp

Inventors

• Stuart Thomas William
• Raja Asad Khalid
• Bay Richard Henry
• Mills Samuel Luke

Classifications

• H04N1/0044

  for image preview or review, e.g. to help the user position a sheet · CPC title

• H04N1/00005

  relating to image data · CPC title

• H04N1/3878 Primary

  Skew detection or correction · CPC title

• H04N2201/0098

  User intervention not otherwise provided for, e.g. placing documents, responding to an alarm · CPC title

• H04N2201/0094

  Multifunctional device, i.e. a device capable of all of reading, reproducing, copying, facsimile transception, file transception · CPC title