Image processing device, image processing method, endoscope system, and endoscope observation method

Patent metadata

Field	Value
Publication number	US-11793391-B2
Application number	US-202117178815-A
Country	US
Kind code	B2
Filing date	Feb 18, 2021
Priority date	Oct 22, 2018
Publication date	Oct 24, 2023
Grant date	Oct 24, 2023

Abstract

An image processing device includes: one or more processors including hardware. The one or more processors are configured to: calculate, on a basis of a reference image acquired by capturing an image of a reference subject which has an optical characteristic that is equivalent to at least a part of a living body, image transformation parameters through congruence transformation that transforms a coordinate corresponding to a color of target region included in the reference image defined in a color space into a coordinate corresponding to an achromatic color in the color space; and perform, in the color space on a basis of the calculated image transformation parameters, the congruence transformation of colors of a color image acquired by capturing an image of the living body, the color image being constituted by at least two monochromatic image corresponding to different illumination having different center wavelengths.

First claim

The invention claimed is:

1. An image processing device comprising:
one or more processors comprising hardware, the one or more processors being configured to:
calculate, on a basis of a reference image acquired by capturing an image of a reference subject which has an optical characteristic that is equivalent to at least a part of a living body, image transformation parameters through congruence transformation that transforms a coordinate corresponding to a color of target region included in the reference image defined in a color space into a coordinate corresponding to an achromatic color in the color space; and
perform, in the color space on a basis of the calculated image transformation parameters, the congruence transformation of colors of a color image acquired by capturing an image of the living body, the color image being constituted by at least two monochromatic image corresponding to different illumination having different center wavelengths.

2. The image processing device according to claim 1 , wherein the congruence transformation performs, on the colors of the color image, at least one transformation of translation movement and rotational movement in the color space.

3. The image processing device according to claim 1 , wherein the reference subject is a phantom mimicking the optical characteristics of the living body.

4. The image processing device according to claim 1 , wherein the target region is a site included in the living body clinically diagnosed as normal.

5. The image processing device according to claim 1 ,
wherein the reference subject is the living body, and
the reference image is an image including a site of the living body clinically diagnosed as normal.

6. The image processing device according to claim 1 , wherein the target region is a region of a normal mucosa, the region having a relatively smaller number of blood vessels.

7. The image processing device according to claim 1 , wherein the target region is a blood vessel site.

8. The image processing device according to claim 1 , wherein the target region is a normal mucosa around abnormal tissue.

9. The image processing device according to claim 1 , wherein the target region is a fatty tissue site.

10. An endoscope system comprising:
the image processing device according to claim 1 ,
an endoscope that acquires the color image by capturing the image of the living body; and
wherein the calculating of the image transformation parameters calculates the image transformation parameters on a basis of the reference image acquired by capturing the image of the reference subject by the endoscope, and
the performing of the congruence transformation transforms the colors of the color image acquired by the endoscope.

11. The endoscope system according to claim 10 , comprising:
a phantom mimicking the optical characteristic of the living body,
wherein the reference subject is the phantom.

12. An image processing method comprising:
calculating, on a basis of a reference image acquired by capturing an image of a reference subject which has an optical characteristic that is equivalent to at least a part of a living body, image transformation parameters through congruence transformation that transforms a coordinate corresponding to a color of target region included in the reference image defined in a color space into a coordinate corresponding to an achromatic color in the color space; and
performing, in the color space on a basis of the image transformation parameters obtained by calculation, the congruence transformation of colors of a color image acquired by capturing an image of the living body, the color image being constituted by at least two monochromatic image corresponding to different illumination having different center wavelengths.

13. An endoscope observation method comprising:
acquiring a reference image by capturing, by an endoscope, an image of a reference subject which has an optical characteristic that is equivalent to at least a part of a living body;
calculating, on a basis of the acquired reference image, image transformation parameters through congruence transformation that transforms a coordinate corresponding to a color of a target region included in the reference image defined in a color space into a coordinate corresponding to an achromatic color in the color space;
acquiring a color image constituted by at least two monochromatic image corresponding to different illumination having different center wavelengths by capturing an image of the living body by the endoscope;
performing the congruence transformation of all colors of the acquired color image in the color space on a basis of the image transformation parameters acquired by calculation; and
displaying an image that has been subjected to the congruence transformation.

14. The endoscope observation method according to claim 13 , wherein the reference subject is a phantom mimicking the optical characteristic of the living body.

15. The endoscope observation method according to claim 14 , wherein the phantom has a shape mimicking a shape of the living body.

16. The endoscope observation method according to claim 14 , wherein the phantom is disposed in a container that blocks ambient light, and the container has an opening through which the endoscope can be inserted into the container.

Assignees

• Olympus Corp

Inventors

• Ito Ryosuke
• Shono Yuki
• Tsukagoshi Takayuki
• Tanikawa Yohei

Classifications

• A61B1/00057 Primary

  provided with means for testing or calibration · CPC title

• A61B1/044

  for absorption imaging · CPC title

• A61B1/0638

  providing two or more wavelengths · CPC title

• A61B5/489

  Blood vessels · CPC title

• G06T7/0014

  using an image reference approach · CPC title