Non-transitory computer readable medium and information processing apparatus and method

Patent metadata

Field	Value
Publication number	US-10049107-B2
Application number	US-201615203406-A
Country	US
Kind code	B2
Filing date	Jul 6, 2016
Priority date	Feb 25, 2016
Publication date	Aug 14, 2018
Grant date	Aug 14, 2018

Abstract

A non-transitory computer readable medium storing a translation program causes a computer to execute a process. The process includes: displaying image information, text regions, and original text in association with each other, the text regions being obtained by extracting regions including an image of text from the image information, the original text being obtained by performing character recognition on the text included in the text regions; and editing the text regions in accordance with the content of a received operation.

First claim

What is claimed is:

1. A non-transitory computer readable medium storing a translation program causing a computer to execute a process, the process comprising:
displaying, on a display device of an information processing apparatus, image information, text regions, and original text in association with each other, the text regions being obtained by extracting regions including an image of text from the image information, the original text being obtained by performing character recognition on the text included in the text regions;
receiving an editing operation of the text regions displayed on the display device from a user; and
editing the text regions in accordance with the content of the editing operation received on the display device of the information processing apparatus, wherein,
in the displaying, merge boxes for selecting two or more of the text regions to be merged are displayed on the display device in association with the original text, and a merge button is further displayed, and
in the editing of the text regions,
selecting of respective merge boxes for the two or more of the text regions or selecting of a portion of the displayed original text is received as part of the content of the received operation, and
in response to the selecting of the respective merge boxes for the two or more of the text regions and in accordance with a merge instruction received on the display device by operation of the merge button, the two or more of the text regions displayed on the display device as separate text regions are merged together so as to be displayed on the display device as a single text region.

2. The non-transitory computer readable medium according to claim 1 , wherein, in the editing of the text regions,
in accordance with a divide instruction received on the display device, a single text region displayed on the display device is divided so as to be displayed on the display device as two or more separate text regions.

3. The non-transitory computer readable medium according to claim 2 , the process further comprising:
calculating a reliability degree of each of the text regions on the basis of the content of the original text extracted from a corresponding text region,
wherein a text region for which the reliability degree is calculated to be lower than a predetermined threshold is displayed as a text region candidate to be corrected.

4. The non-transitory computer readable medium according to claim 2 , the process further comprising:
calculating a reliability degree of each of the text regions on the basis of the content of the original text extracted from a corresponding text region; and
estimating a new text region candidate on the basis of an area of a new text region obtained by merging text regions for which the reliability degree is calculated to be lower than a predetermined threshold and on the basis of a total area of the text regions which have not been merged,
wherein the estimated new text region candidate is displayed.

5. The non-transitory computer readable medium according to claim 1 , the process further comprising:
calculating a reliability degree of each of the text regions on the basis of the content of the original text extracted from a corresponding text region,
wherein a text region for which the reliability degree is calculated to be lower than a predetermined threshold is displayed as a text region candidate to be corrected.

6. The non-transitory computer readable medium according to claim 1 , the process further comprising:
calculating a reliability degree of each of the text regions on the basis of the content of the original text extracted from a corresponding text region; and
estimating a new text region candidate on the basis of an area of a new text region obtained by merging text regions for which the reliability degree is calculated to be lower than a predetermined threshold and on the basis of a total area of the text regions which have not been merged,
wherein the estimated new text region candidate is displayed.

7. The non-transitory computer readable medium according to claim 1 , the process further comprising:
calculating a reliability degree of each of the text regions; and
merging text regions for which the reliability degree is calculated to be lower than a predetermined threshold.

8. The non-transitory computer readable medium according to claim 1 , the process further comprising:
calculating a reliability degree of each of the text regions; and
merging or splitting text regions for which the reliability degree is calculated to be lower than a predetermined threshold such that a resulting merged or split text region has a reliability degree higher than the predetermined threshold.

9. The non-transitory computer readable medium according to claim 1 , further comprising:
generating text region information indicating (i) the original text, (ii) a coordinate, a height and a width of each of the text regions, and (iii) the image of the text included in each of the text regions.

10. An information processing apparatus comprising:
a display controller that displays, on a display device of the information processing apparatus, image information, text regions, and original text in association with each other, the text regions being obtained by extracting regions including an image of text from the image information, the original text being obtained by performing character recognition on the text included in the text regions;
an operation receiver that receives an editing operation of the text regions displayed on the display device from a user; and
a text region editor that edits the text regions in accordance with the content of the editing operation received on the display device of the information processing apparatus, wherein
the display controller further displays on the display device
merge boxes for selecting two or more of the text regions to be merged in association with the original text, and
a merge button,

the operation receiver receives, as part of the content of the received operation, selection of respective merge boxes for the two or more of the text regions or selection of a portion of the displayed original text, and
in response to the selection of the respective merge boxes for the two or more of the text regions and in accordance with a merge instruction received by the operation receiver on the display device by operation of the merge button, the text region editor merges together the two or more of the text regions displayed on the display device as separate text regions so as to be displayed on the display device as a single text region.

11. The information processing apparatus according to claim 10 , further comprising:
a reliability degree calculator that calculates a reliability degree of each of the text regions, wherein
the text region editor merges text regions for which the reliability degree is calculated to be lower than a predetermined threshold.

12. The information processing apparatus according to claim 10 , further comprising:
a reliability degree calculator that calculates a reliability degree of each of the text regions, wherein
the text region editor merges or splits text regions for which the reliability degree is calculated to be lower than a predetermined threshold such that a resulting merged or split text region has a reliability degree higher than the predetermined threshold.

13. The information processing apparatus according to claim 10 , further comprising:
a text region extractor that generates text region information indicating (i) the original text, (ii) a coordinate, a height and a width of each of the text reg

Assignees

• Fuji Xerox Co Ltd

Inventors

• Otsuka Toru

Classifications

• G06F40/58

  Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation · CPC title

• G06F40/166 Primary

  Editing, e.g. inserting or deleting · CPC title

• G06V30/153

  using recognition of characters or words · CPC title

• G06V30/10

  Character recognition · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title