Information processing apparatus, control method of information processing apparatus, and storage medium

Patent metadata

Field	Value
Publication number	US-10452943-B2
Application number	US-201615368971-A
Country	US
Kind code	B2
Filing date	Dec 5, 2016
Priority date	Dec 28, 2015
Publication date	Oct 22, 2019
Grant date	Oct 22, 2019

Abstract

The information processing apparatus includes an extraction unit configured to extract a feature amount of an entire image and a feature amount of a local image, a decision unit configured to decide a position of the local image in the entire image based on the feature amount of the entire image and the feature amount of the local image, a reception unit configured to receive a selection of an object included in the local image, and a conversion unit configured to convert coordinate of the selected object in the local image into coordinate in the entire image based on the decided position of the local image in the entire image.

First claim

What is claimed is:

1. An information processing apparatus comprising:
a storage that stores a first feature amount of an entire image and coordinates information of an area included in the entire image; and
a processor that perform:
extracting a second feature amount of a local image;
deciding a position of the local image in the entire image based on the stored first feature amount of the entire image and the extracted second feature amount of the local image;
recognizing positions of text regions from the local image; and
displaying the local image and an area corresponding to the stored coordinates information stored in the storage, wherein the displayed area overlaps with the displayed local image, and wherein a position of the displayed area corresponding to the stored coordinates information is corrected based on the recognized positions of the text regions.

2. The information processing apparatus according to claim 1 , wherein, if the position of the area corresponding to the stored coordinate information overlaps with the recognized positions of the text regions, the processor corrects the position of the area corresponding to the stored coordinate information based on a position of a text region for which there is more area of the overlap.

3. The information processing apparatus according to claim 1 , wherein the position of the text region is recognized by OCR processing in the local image.

4. The information processing apparatus according to claim 1 , wherein the processor performs in advance:
extracting the first feature amount of the entire image;
obtaining the coordinates information of the area included in the entire image; and
controlling the storage to store the extracted first feature amount of the entire image and the obtained coordinates information of the area included in the entire image.

5. The information processing apparatus according to claim 1 , wherein the processor further performs:
receiving a user's selection of the displayed area; and
obtaining text information of an area selected based on the user's selection.

6. An information processing method comprising:
storing a first feature amount of an entire image and coordinates information of an area included in the entire image;
extracting a second feature amount of a local image;
deciding a position of the local image in the entire image based on the first feature amount of the entire image and the extracted second feature amount of the local image;
recognizing positions of text regions from the local image; and
displaying the local image and an area corresponding to the stored coordinates information, wherein the displayed area overlaps with the displayed local image, and wherein a position of the displayed area corresponding to the stored coordinates information is corrected based on the recognized positions of the text regions.

7. The information processing method according to claim 6 , wherein, if the position of the area corresponding to the stored coordinate information overlaps with the recognized positions of the text regions, the position of the area corresponding to the stored coordinate information is corrected based on a position of a text region for which there is more area of the overlap.

8. The control method according to claim 6 , wherein the position of the text region is recognized by OCR processing.

9. The information processing method according to claim 6 , further comprising:
extracting the first feature amount of the entire image;
obtaining the coordinates information of the area included in the entire image; and
wherein the extracted first feature amount of the entire image and the obtained coordinates information of the area included in the entire image are stored in a storage.

10. The information processing method according to claim 6 , further comprising:
receiving a user's selection of the displayed area; and
obtaining text information of an area selected based on the user's selection.

11. A non-transitory storage medium storing a computer program causing a computer to perform an information processing method comprising:
extracting a second feature amount of a local image;
deciding a position of the local image in an entire image based on the extracted second feature amount of the local image and a first feature amount of the entire image, wherein the first feature amount of the entire image and coordinates information of an area included in the entire image are stored in a storage;
recognizing positions of text regions from the local image;
displaying the local image and an area corresponding to the stored coordinates information stored in the storage, wherein the displayed area overlaps with the displayed local image, and wherein a position of the displayed area corresponding to the stored coordinates information is corrected based on the recognized positions of the text regions.

Assignees

• Canon Kk

Inventors

• Nanaumi Yoshihito

Classifications

• G06V30/147

  Determination of region of interest · CPC title

• G06V30/1444

  Selective acquisition, locating or processing of specific regions, e.g. highlighted text, fiducial marks or predetermined fields · CPC title

• G06V30/142

  using hand-held instruments; Constructional details of the instruments · CPC title

• G06V30/1456

  based on user interactions · CPC title

• G06V40/1335 Primary

  Combining adjacent partial images (e.g. slices) to create a composite input or reference pattern; Tracking a sweeping finger movement · CPC title