Image processing apparatus, image processing method, and image processing system for improving visibility of indocyanine green image

Patent metadata

Field	Value
Publication number	US-12167828-B2
Application number	US-201816761490-A
Country	US
Kind code	B2
Filing date	Aug 27, 2018
Priority date	Nov 13, 2017
Publication date	Dec 17, 2024
Grant date	Dec 17, 2024

Abstract

Provided is an image processing apparatus that includes a feature detecting unit that detects a feature of first image data, where the first image data is obtained by capturing an image of a blood vessel by IndoCyanine Green (ICG) fluorescence imaging. The image processing apparatus further includes an enhancement processing unit that controls a degree of an enhancement process performed on the first image data, on the basis of the feature.

First claim

The invention claimed is:

1. An image processing apparatus, comprising:
a processor configured to:
obtain first image data of a first image of a blood vessel, wherein the first image is captured by IndoCyanine Green (ICG) fluorescence imaging;
obtain second image data of a second image of the blood vessel, wherein the second image is captured by an application of white light;
calculate, based on a first difference value between the first image and the second image, a correlation value between the first image and the second image;
determine, based on the first image data and the second image data, a first feature that includes the calculated correlation value;
execute a first image process on the first image data at a first intensity;
execute a second image process on the first image data at a second intensity different from the first intensity;
determine a second feature that includes one of a vascular diameter or a second difference value between a result of the first image process and a result of the second image process, wherein the vascular diameter is based on the second difference value; and
control, based on at least one of the first feature or the second feature, a degree of an enhancement process on the first image data.

2. The image processing apparatus according to claim 1 , wherein the processor is further configured to determine a degree of scattering based on the correlation value.

3. The image processing apparatus according to claim 2 , wherein the processor is further configured to increase the degree of the enhancement process with one of a decrease in the correlation value or an increase in the degree of scattering.

4. The image processing apparatus according to claim 1 , wherein the processor is further configured to increase the degree of the enhancement process with a decrease in one of an absolute value of the second difference value or the vascular diameter.

5. The image processing apparatus according to claim 1 , wherein the processor is further configured to:
calculate an eigenvalue of a Hessian matrix from the first image data; and
determine the second feature that includes the vascular diameter, based on the eigenvalue of the Hessian matrix calculated from the first image data.

6. The image processing apparatus according to claim 5 , wherein the processor is further configured to increase the degree of the enhancement process with a decrease in the vascular diameter.

7. The image processing apparatus according to claim 1 , wherein the processor is further configured to determine a third feature that includes a vascular density, based on the first image data.

8. The image processing apparatus according to claim 7 , wherein the processor is further configured to increase the degree of the enhancement process with an increase in the vascular density.

9. The image processing apparatus according to claim 1 , wherein the processor is further configured to determine a third feature that includes a vascular depth, based on the correlation value and information indicating one of a presence or an absence of the blood vessel in at least one of the first image data or the second image data.

10. The image processing apparatus according to claim 9 , wherein the processor is further configured to increase the degree of the enhancement process with an increase in the vascular depth.

11. The image processing apparatus according to claim 1 , wherein in a case where a registration of a coefficient corresponding to the first feature is present, the processor is further configured to control the enhancement process based on the coefficient.

12. The image processing apparatus according to claim 1 , wherein in a case where a registration of a coefficient corresponding to the first feature is present and a registration of a coefficient corresponding to the second feature that is different from the first feature is absent, the processor is further configured to:
control the enhancement process based on the coefficient corresponding to the first feature; and
control the degree of the enhancement process based on the second feature.

13. The image processing apparatus according to claim 1 , wherein in a case where a registration of a single coefficient is present, the processor is further configured to:
control the enhancement process based on the single coefficient; and
control the degree of the enhancement process based on the first feature.

14. The image processing apparatus according to claim 11 , wherein the processor is further configured to generate the coefficient corresponding to the first feature through machine learning.

15. The image processing apparatus according to claim 1 , wherein the processor is further configured to cause a display unit to display the first image data subjected to the enhancement process.

16. The image processing apparatus according to claim 15 , wherein the processor is further configured to cause the display unit to display both of the first image data before being subjected to the enhancement process and the first image data after being subjected to the enhancement process.

17. The image processing apparatus according to claim 1 , wherein the processor is further configured to:
receive user operation information; and
control the degree of the enhancement process based on the user operation information.

18. An image processing method, comprising:
obtaining first image data of a first image of a blood vessel, wherein the first image is captured by IndoCyanine Green (ICG) fluorescence imaging;
obtaining second image data of a second image of the blood vessel, wherein the second image is captured by an application of white light;
calculating, based on a first difference value between the first image and the second image, a correlation value between the first image and the second image;
determining, based on the first image data and the second image data, a first feature that includes the calculated correlation value;
executing a first image processing on the first image data at a first intensity;
executing a second image processing on the first image data at a second intensity different from the first intensity;
determining a second feature that includes one of a vascular diameter or a second difference value between a result of the first image processing and a result of the second image processing, wherein the vascular diameter is based on the second difference value; and
controlling, by a processor, a degree of an enhancement process on the first image data, based on the at least one of first feature or the second feature.

19. An image processing system, comprising:
an image sensor configured to:
capture a first image of a blood vessel by IndoCyanine Green (ICG) fluorescence imaging; and
capture a second image of the blood vessel by an application of white light; and

a processor configured to:
obtain first image data of the first image of the blood vessel;
obtain second image data of the second image of the blood vessel;
calculate, based on a first difference value between the first image and the second image, a correlation value between the first image and the second image;
determine, based on the first image data and the second image data, a first feature that includes the calculated correlation value;
execute a first image process on the first image data at a first intensity;
execute a second image process on the first image data at a second intensity different from the first intensity;
determine a second feature that includes one of a vascular diamet

Assignees

• Sony Corp

Inventors

• Fukazawa Kentaro
• Fukazawa Takanori
• Kikuchi Daisuke
• Takahashi Minori
• Ikeshita Kazuki

Classifications

• A61B1/000095

  for image enhancement · CPC title

• G06T2207/30101

  Blood vessel; Artery; Vein; Vascular · CPC title

• G06T2207/10068

  Endoscopic image · CPC title

• G06T2207/10064

  Fluorescence image · CPC title

• G06T7/0012

  Biomedical image inspection · CPC title