Image processing device, information storage device, and image processing method

Patent metadata

Field	Value
Publication number	US-9652835-B2
Application number	US-201514669447-A
Country	US
Kind code	B2
Filing date	Mar 26, 2015
Priority date	Sep 27, 2012
Publication date	May 16, 2017
Grant date	May 16, 2017

Abstract

An image processing device includes an image sequence acquisition section that acquires an image sequence that includes a plurality of constituent images, and a processing section that performs an image summarization process that deletes some of the plurality of constituent images included in the image sequence to generate a summary image sequence, the processing section selecting a reference image and a determination target image from the plurality of constituent images, detecting an unnecessary area from the determination target image, calculating a loss area based on deformation information about the reference image and the determination target image, and the unnecessary area, the loss area being an area that is lost when the determination target image is deleted, and determining whether or not the determination target image can be deleted based on the calculated loss area.

First claim

What is claimed is:

1. An image processing device comprising:
an image sequence acquisition section that acquires an image sequence that includes a plurality of constituent images, the image sequence being an image sequence for observing a target object; and
a processing section that performs an image summarization process that deletes some of the plurality of constituent images included in the image sequence acquired by the image sequence acquisition section to generate a summary image sequence,
wherein the processing section selects a reference image and a determination target image from the plurality of constituent images, detects an unnecessary area from the determination target image, the unnecessary area being an area in which the target object is not sufficiently captured enough to be observed, calculates a loss area based on deformation information about the reference image and the determination target image, and the unnecessary area, the loss area being an area that is lost when the determination target image is deleted, and determines whether or not the determination target image can be deleted based on the calculated loss area.

2. The image processing device as defined in claim 1 ,
wherein the processing section calculates a coverage area based on the deformation information about the reference image and the determination target image, the coverage area being an area in which the determination target image is covered by the reference image, and calculates an area of the determination target image that is not included in the coverage area and the unnecessary area to be the loss area.

3. The image processing device as defined in claim 1 ,
wherein the processing section calculates a loss ratio based on the loss area, the loss ratio representing a ratio of an area that is lost when the determination target image is deleted, and determines whether or not the determination target image can be deleted based on the calculated loss ratio.

4. The image processing device as defined in claim 3 ,
wherein the processing section calculates a ratio of the loss area with respect to the determination target image to be the loss ratio.

5. The image processing device as defined in claim 1 ,
wherein the processing section determines a probability that an attention area included in the determination target image is missed using the loss area, and determines whether or not the determination target image can be deleted based on the probability that the attention area is missed.

6. The image processing device as defined in claim 5 ,
wherein the processing section determines the probability that the attention area included in the determination target image is missed by determining whether or not an area having a size corresponding to the attention area is included within the loss area.

7. The image processing device as defined in claim 5 ,
wherein the processing section performs an erosion process that utilizes a structural element that corresponds to the attention area on the loss area, determines that the determination target image cannot be deleted when it has been determined by the erosion process that a residual area is present, and that the attention area may be missed, and determines that the determination target image can be deleted when it has been determined by the erosion process that the residual area is not present, and that the attention area is not missed.

8. The image processing device as defined in claim 1 , wherein:
the image sequence is an in vivo image sequence obtained by performing image capturing inside of a living body, and
the processing section detects a bubble area or a residue area included in the determination target image as the unnecessary area.

9. The image processing device as defined in claim 1 ,
wherein the processing section detects a dark area or a halation area included in the determination target image as the unnecessary area.

10. An information storage device storing a program that causes a computer to function as:
an image sequence acquisition section that acquires an image sequence that includes a plurality of constituent images, the image sequence being an image sequence for observing a target object; and
a processing section that performs an image summarization process that deletes some of the plurality of constituent images included in the image sequence acquired by the image sequence acquisition section to generate a summary image sequence,
wherein the processing section selects a reference image and a determination target image from the plurality of constituent images, detects an unnecessary area from the determination target image, the unnecessary area being an area in which the target object is not sufficiently captured enough to be observed, calculates a loss area based on deformation information about the reference image and the determination target image, and the unnecessary area, the loss area being an area that is lost when the determination target image is deleted, and determines whether or not the determination target image can be deleted based on the calculated loss area.

11. An image processing method comprising:
acquiring an image sequence that includes a plurality of constituent images, the image sequence being an image sequence for observing a target object;
selecting a reference image and a determination target image from the plurality of constituent images;
detecting an unnecessary area from the determination target image, the unnecessary area being an area in which the target object is not sufficiently captured enough to be observed;
calculating a loss area based on deformation information about the reference image and the determination target image, and the unnecessary area, the loss area being an area that is lost when the determination target image is deleted;
determining whether or not the determination target image can be deleted based on the calculated loss area; and
performing an image summarization process that deletes some of the plurality of constituent images included in the image sequence based on a result of the determination as to whether or not the determination target image can be deleted to acquire a summary image sequence.

Assignees

• Olympus Corp

Inventors

• Yaguchi Yoichi

Classifications

• G06T7/0014 Primary

  using an image reference approach · CPC title

• G06T5/50 Primary

  using two or more images, e.g. averaging or subtraction · CPC title

• G06V10/7515

  Shifting the patterns to accommodate for positional errors · CPC title

• H04N5/76

  Television signal recording · CPC title

• G06T7/254

  involving subtraction of images · CPC title