Image processing method and image processing system

Patent metadata

Field	Value
Publication number	US-9430716-B2
Application number	US-201213438249-A
Country	US
Kind code	B2
Filing date	Apr 3, 2012
Priority date	Apr 7, 2011
Publication date	Aug 30, 2016
Grant date	Aug 30, 2016

Abstract

An example is an image processing method including a step of acquiring data containing an image, an extraction step of extracting a first image region from the acquired data based on the type of software for generating the acquired data, an extraction step of extracting a second image region the same as or similar to each of images held in a storage unit from the acquired data by comparing the acquired data and each of the images, an extraction step of extracting a third image region the same as or similar to each of the images from the acquired data by comparing the image feature amount of the acquired data and the image feature amount of each of the images, and a step of identifying an image in the acquired data to be stored in the storage unit based on the image regions and reliabilities of the extraction steps.

First claim

What is claimed is:

1. An image processing method for use by an image processing system including a processor executing a program stored in a memory and a storage unit for holding a plurality of images, the image processing method comprising:
an acquisition step of acquiring, by the processor, data containing an image;
a first extraction step of extracting, by the processor, a first image region from the acquired data in accordance with a type of software used for generating the acquired data;
a second extraction step of extracting, by the processor, a second image region that is the same as or similar to each of the plurality of images held in the storage unit from the acquired data, wherein the image similarity is based upon comparing the acquired data and each of the plurality of images held in the storage unit to calculate a characteristic of compared image features which is compared to a predetermined threshold;
a third extraction step of extracting, by the processor, a third image region that is the same as or similar to each of the plurality of images held in the storage unit from the acquired data by comparing an image feature amount of the acquired data and an image feature amount of each of the plurality of images held in the storage unit in accordance with the characteristic of the compared image features relative to a predetermined threshold; and
a step of identifying, by the processor, an image in the acquired data to be stored in the storage unit based on the first image region, the second image region and the third image region, and reliabilities set to the first extraction step, the second extraction step and the third extraction step in accordance with another predetermined threshold,
wherein the step of identifying the image in the acquired data to be stored in the storage unit comprises:
calculating, by the processor, a ratio representing mutual overlaps among the first image region, the second image region and the third image region; and
identifying, by the processor, the image to be stored in the storage unit out of the first image region, the second image region, and the third image region based on the calculated ratio representing the mutual overlaps, and the reliabilities set to the first extraction step, the second extraction step and the third extraction step.

2. The image processing method according to claim 1 , wherein the first extraction step comprises:
determining, by the processor, whether the image contained in the acquired data can be extracted from the acquired data based on the type of software used for generating the acquired data; and
extracting, by the processor, the first image region from the acquired data in a case where it is determined that the image contained in the acquired data can be extracted from the acquired data.

3. The image processing method according to claim 1 , wherein the second extraction step comprises:
acquiring, by the processor, a first image showing a content of the acquired data;
generating, by the processor, a plurality of second images from the first image;
comparing, by the processor, each of the plurality of second images and each of the plurality of images held in the storage unit with each other; and
extracting, by the processor, the second image region by extracting a second image that is the same as or similar to each of the plurality of images held in the storage unit as a result of the comparing in accordance with the characteristic of the compared image features relative to the predetermined threshold.

4. The image processing method according to claim 3 , wherein the third extraction step comprises:
calculating, by the processor, an image feature amount of the first image;
comparing, by the processor, the image feature amount of the first image and the image feature amount of each of the plurality of images held in the storage unit with each other; and
extracting, by the processor, the third image region by extracting the first image in a case where it is determined that the first image and each of the plurality of images held in the storage unit are the same as or similar to each other as a result of the comparing in accordance with the characteristic of the compared image features relative to the predetermined threshold.

5. The image processing method according to claim 1 , wherein:
the image processing system further comprises:
a display unit for displaying the first image region, the second image region, and the third image region to a user; and
an input unit for enabling the user to select any image region out of the first image region, the second image region, and the third image region, which are displayed on the display unit;

the storage unit further holds a reliability allocated to each of the plurality of held images, and a plurality of pieces of data each containing each of the plurality of held images; and
the image processing method comprises:
enabling, by the processor, the user to select an image region out of the first image region, the second image region, and the third image region by means of the display unit and the input unit;
searching, by the processor, the plurality of images held in the storage unit for an image that is the same as or similar to the selected image region in accordance with the characteristic of the compared image features relative to the predetermined threshold;
extracting, by the processor, a piece of data containing an image found in the searching from the plurality of pieces of data; and
increasing, by the processor, a reliability allocated to the image found in the searching.

6. An image processing system, comprising:
a processor executing a program stored in a memory; and
a storage unit for holding a plurality of images,
the processor being configured to:
acquire data containing an image;
extract, in a first extraction step, a first image region from the acquired data in accordance with a type of software used for generating the acquired data;
extract, in a second extraction step, a second image region that is the same as or similar to each of the plurality of images held in the storage unit from the acquired data, wherein the image similarity is based upon comparing the acquired data and each of the plurality of images held in the storage unit to calculate a characteristic of compared image features which is compared to a predetermined threshold;
extract, in a third extraction step, a third image region that is the same as or similar to each of the plurality of images held in the storage unit from the acquired data by comparing an image feature amount of the acquired data and an image feature amount of each of the plurality of images held in the storage unit in accordance with the characteristic of the compared image features relative to the predetermined threshold;
identify an image in the acquired data to be stored in the storage unit based on the first image region, the second image region and the third image region, and reliabilities set to the first extraction step, the second extraction step and the third extraction step in accordance with another predetermined threshold;
calculate a ratio representing mutual overlaps among the first image region, the second image region and the third image region; and
identify the image in the acquired data to be stored in the storage unit out of the first image region, the second image region and the third image region based on the calculated ratio representing the mutual overlaps, and the reliabilities set to the first extraction step, the second extraction step and the third extraction step.

7. The image processing system according to claim 6 , wherein the processor is further configured to:
determine whether the image can be extracted from the acquired data based on t

Assignees

• Akira Naoto
• Hiroike Atsushi
• Hitachi Ltd

Inventors

• Akira Naoto
• Hiroike Atsushi

Classifications

• G06V10/421 Primary

  by analysing segments intersecting the pattern · CPC title

• G06F17/30256

  Physics · mapped topic

• G06F17/30011

  Physics · mapped topic

• G06F17/30247

  Physics · mapped topic

• G06K9/50 Primary

  Physics · mapped topic