Identifying and extracting a sub-image in a document image file

Patent metadata

Field	Value
Publication number	US-10909686-B2
Application number	US-201816203103-A
Country	US
Kind code	B2
Filing date	Nov 28, 2018
Priority date	Nov 28, 2018
Publication date	Feb 2, 2021
Grant date	Feb 2, 2021

Abstract

Provided are techniques for identifying and extracting a sub-image in a document image file. Colors in a document image file are modified to form a modified document image file, wherein the document image file contains a first color, a second color, and a third color, wherein a threshold is used to determine whether each of different levels of the third color is to be one of the first color and the second color. Solid horizontal lines and solid vertical lines having one of a pre-defined width and a pre-defined height are removed from the modified document image file. A sub-image in the modified document image file is identified based on remaining solid horizontal lines and remaining solid vertical lines. A segment that includes the sub-image is extracted. Post-processing is performed on the segment.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
modifying colors in a document image file to form a modified document image file, wherein the document image file contains a first color, a second color, and a third color, wherein a threshold is used to determine whether each of different levels of the third color is to be one of the first color and the second color;
creating a first image file with solid horizontal lines and a second image file with solid vertical lines from the modified document image file;
removing the solid horizontal lines from the first image file having a pre-defined width and the solid vertical lines from the second image file having a pre-defined height;
adding remaining solid horizontal lines in the first image file and remaining solid vertical lines in the second image file in a new image file;
identifying a sub-image in the new image file based on the remaining solid horizontal lines and the remaining solid vertical lines;
extracting a segment that includes the sub-image; and
performing post-processing on the segment.

2. The computer-implemented method of claim 1 , wherein the first color is white, wherein the second color is black, and wherein the third color is grey.

3. The computer-implemented method of claim 1 , wherein edge detection is used to extract the segment.

4. The computer-implemented method of claim 1 , wherein the post-processing includes any of storing the segment in a database, re-using the segment, modifying the segment, and re-using the modified segment.

5. The computer-implemented method of claim 1 , wherein a Software as a Service (SaaS) is configured to perform method operations.

6. A computer program product, the computer program product comprising a computer readable storage medium having program code embodied therewith, the program code executable by at least one processor to perform operations comprising:
modifying colors in a document image file to form a modified document image file, wherein the document image file contains a first color, a second color, and a third color, wherein a threshold is used to determine whether each of different levels of the third color is to be one of the first color and the second color;
creating a first image file with solid horizontal lines and a second image file with solid vertical lines from the modified document image file;
removing the solid horizontal lines from the first image file having a pre-defined width and the solid vertical lines from the second image file having a pre-defined height;
adding remaining solid horizontal lines in the first image file and remaining solid vertical lines in the second image file in a new image file;
identifying a sub-image in the new image file based on the remaining solid horizontal lines and the remaining solid vertical lines;
extracting a segment that includes the sub-image; and
performing post-processing on the segment.

7. The computer program product of claim 6 , wherein the first color is white, wherein the second color is black, and wherein the third color is grey.

8. The computer program product of claim 6 , wherein edge detection is used to extract the segment.

9. The computer program product of claim 6 , wherein the post-processing includes any of storing the segment in a database, re-using the segment, modifying the segment, and re-using the modified segment.

10. The computer program product of claim 6 , wherein a Software as a Service (SaaS) is configured to perform computer program product operations.

11. A computer system, comprising:
one or more processors, one or more computer-readable memories and one or more computer-readable, tangible storage devices; and
program instructions, stored on at least one of the one or more computer-readable, tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to perform operations comprising:
modifying colors in a document image file to form a modified document image file, wherein the document image file contains a first color, a second color, and a third color, wherein a threshold is used to determine whether each of different levels of the third color is to be one of the first color and the second color;
creating a first image file with solid horizontal lines and a second image file with solid vertical lines from the modified document image file;
removing the solid horizontal lines from the first image file having a pre-defined width and the solid vertical lines from the second image file having a pre-defined height;
adding remaining solid horizontal lines in the first image file and remaining solid vertical lines in the second image file in a new image file;
identifying a sub-image in the new image file based on the remaining solid horizontal lines and the remaining solid vertical lines;
extracting a segment that includes the sub-image; and
performing post-processing on the segment.

12. The computer system of claim 11 , wherein the first color is white, wherein the second color is black, and wherein the third color is grey.

13. The computer system of claim 11 , wherein edge detection is used to extract the segment.

14. The computer system of claim 11 , wherein the post-processing includes any of storing the segment in a database, re-using the segment, modifying the segment, and re-using the modified segment.

15. The computer system of claim 11 , wherein a Software as a Service (SaaS) is configured to perform computer system operations.

Assignees

• IBM

Inventors

• Ho Mang-Rong

Classifications

• G06V30/413

  Classification of content, e.g. text, photographs or tables · CPC title

• G06V10/44

  Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components · CPC title

• G06T7/12 Primary

  Edge-based segmentation · CPC title

• G06T7/13 Primary

  Edge detection · CPC title

• G06V30/418

  Document matching, e.g. of document images · CPC title