Image processing apparatus, capsule endoscope system, method of operating image processing apparatus, and computer-readable storage medium

Patent metadata

Field	Value
Publication number	US-2021004961-A1
Application number	US-202017025225-A
Country	US
Kind code	A1
Filing date	Sep 18, 2020
Priority date	Mar 27, 2018
Publication date	Jan 7, 2021
Grant date	—

Abstract

An image processing apparatus includes: an identification circuit configured to calculate a characteristic of each of a plurality of image groups captured when a capsule endoscope is introduced into a subject multiple times, each image group being a group of images that are captured each time the capsule endoscope is introduced into the subject, and identify, based on the calculated characteristic, a first region or a second region in each image group, the first region being a region that does not include an image of the subject captured by the capsule endoscope, the second region being a region that is regarded as not including the captured image of the subject; and a first specifying circuit configured to specify at least one section of the subject in the image groups, the at least one section including the first region or the second region.

First claim

What is claimed is:

1 . An image processing apparatus that performs image processing on an image captured by a capsule endoscope introduced into a subject, the image processing apparatus comprising:
an identification circuit configured to
calculate a characteristic of each of a plurality of image groups captured when the capsule endoscope is introduced into the subject multiple times, each image group being a group of images that are captured each time the capsule endoscope is introduced into the subject, and
identify, based on the calculated characteristic, a first region or a second region in each image group, the first region being a region that does not include an image of the subject captured by the capsule endoscope, the second region being a region that is regarded as not including the captured image of the subject; and
a first specifying circuit configured to specify at least one section of the subject in the plurality of image groups, the at least one section including the first region or the second region.

2 . The image processing apparatus according to claim 1 , wherein the first specifying circuit is configured to specify the section of the subject in which an overlapping proportion of the first region or the second region in the image group overlapping each other between the plurality of image groups is equal to or more than a predetermined value.

3 . The image processing apparatus according to claim 1 , wherein
the identification circuit includes: a first calculation circuit configured to calculate an amount of a specific region in each image included in each of the plurality of image groups; and a first identification circuit configured to identify the second region based on the amount of the specific region.

4 . The image processing apparatus according to claim 3 , wherein
the first identification circuit is configured to
identify whether or not each image is a specific image in which the amount of the specific region is equal to or more than a predetermined threshold value, and
identify, as the second region, a region between specific images that are consecutive in time series.

5 . The image processing apparatus according to claim 1 , wherein
the identification circuit includes: a second calculation circuit configured to calculate an amount of change in a parameter based on a position of the capsule endoscope when at least two images of each of the plurality of image groups are captured; and a second identification circuit configured to identify the first region based on the amount of change.

6 . The image processing apparatus according to claim 3 , wherein the specific region is a region including a captured image of a bubble, a residue, or noise.

7 . The image processing apparatus according to claim 5 , wherein the amount of change is an amount determined based on a degree of similarity between the at least two images, or on a position, speed, or acceleration of the capsule endoscope.

8 . The image processing apparatus according to claim 1 , further comprising:
a generation circuit configured to generate information regarding a position of the at least one section; and a display controller configured to cause a display to display the information.

9 . The image processing apparatus according to claim 8 , wherein the information is a distance from a reference position in the subject to the section.

10 . The image processing apparatus according to claim 8 , wherein the at least one section is a plurality of sections, and the information is a distance between the plurality of sections.

11 . The image processing apparatus according to claim 1 , further comprising
a second specifying circuit configured to specify a group of reciprocating images captured when the capsule endoscope reciprocates in the subject, in each of the plurality of image groups, wherein the first specifying circuit configured to specify, in the group of the reciprocating images, a section of the subject that is overlappingly identified as the first region or the second region when the capsule endoscope reciprocates in the subject.

12 . The image processing apparatus according to claim 1 , wherein
the at least one section is a plurality of sections, and the image processing apparatus further comprises a display controller configured to cause a display to display the plurality of sections side by side.

13 . A capsule endoscope system comprising:
the image processing apparatus according to claim 1 ; and the capsule endoscope.

14 . A method of operating an image processing apparatus that performs image processing on an image captured by a capsule endoscope introduced into a subject, the method comprising:
calculating, by an identification circuit, a characteristic of each of a plurality of image groups captured when the capsule endoscope is introduced into the subject multiple times, each image group being a group of images that are captured each time the capsule endoscope is introduced into the subject; identifying, based on the calculated characteristic, a first region or a second region in each image group, the first region being a region that does not include an image of the subject captured by the capsule endoscope, the second region being a region that is regarded as not including the captured image of the subject; and specifying, by a first specifying circuit, at least one section of the subject in the plurality of image groups, the at least one section including the first region or the second region.

15 . A non-transitory computer-readable recording medium on which an executable program is recorded, the program instructing an image processing apparatus that performs image processing on an image captured by a capsule endoscope introduced into a subject to execute:
calculating, by an identification circuit, a characteristic of each of a plurality of image groups captured when the capsule endoscope is introduced into the subject multiple times, each image group being a group of images that are captured each time the capsule endoscope is introduced into the subject, identifying, based on the calculated characteristic, a first region or a second region in each image group, the first region being a region that does not include an image of the subject captured by the capsule endoscope, the second region being a region that is regarded as not including the captured image of the subject; and specifying, by a first specifying circuit, at least one section of the subject in the plurality of image groups, the at least one section including the first region or the second region.

Assignees

• Olympus Corp

Inventors

• Takahashi Masaki
• Kawano Hironao
• Nishiyama Takeshi

Classifications

• G06V20/30

  in albums, collections or shared content, e.g. social network photos or video · CPC title

• G06V10/16

  using multiple overlapping images; Image stitching · CPC title

• A61B1/041 Primary

  Capsule endoscopes for imaging · CPC title

• A61B1/00009

  of image signals during a use of endoscope · CPC title

• G06T7/0014 Primary

  using an image reference approach · CPC title