Medical image processing device, system, method, and program

Patent metadata

Field	Value
Publication number	US-11244478-B2
Application number	US-201716076784-A
Country	US
Kind code	B2
Filing date	Jan 10, 2017
Priority date	Mar 3, 2016
Publication date	Feb 8, 2022
Grant date	Feb 8, 2022

Abstract

[Object] To reduce a risk that a tone of a specific color component of a subject to be observed in medical operation is defective.[Solution] There is provided a medical image processing device including: a signal acquisition unit configured to acquire a first specific component image signal with a first exposure for a specific color component, a second specific component image signal with a second exposure different from the first exposure for the specific color component, and two non-specific component image signals corresponding to two color components different from the specific color component; a combination unit configured to generate a specific component combination image signal by combining the first specific component image signal and the second specific component image signal by using a weight based on an intensity of the specific color component; and a color image generation unit configured to generate a color image signal on a basis of the specific component combination image signal generated by the combination unit and the two non-specific component image signals.

First claim

The invention claimed is:

1. A medical image processing device comprising:
circuitry configured to
acquire a first specific component image signal with a first exposure for a first color component, a second specific component image signal with a second exposure different from the first exposure for the first color component, a first non-specific component image signal for a second color component, different from the first color component, and a second non-specific component image signal for a third color component, different from the first and second color components, wherein a total number of exposures for the first color component is greater than that for the second color component and that for the third color component;
generate a specific component combination image signal by combining the first specific component image signal and the second specific component image signal by using a weight based on an intensity of the first color component;
adjust the specific component combination image signal or the first and second non-specific component image signals so as to cancel a change in a color tone caused by the combination of the first specific component image signal and the second specific component image signal; and
generate a color image signal on a basis of the adjusted specific component combination image signal and the first and second non-specific component image signals, wherein, before the specific component image signal is adjusted, the first color component affects a tone of the color image signal more than the second and third color components.

2. The medical image processing device according to claim 1 , wherein
the circuitry is further configured to adjust the first and second non-specific component image signals by applying, to the first and second non-specific component image signals, a tone curve that causes peaks of the first and second non-specific component image signals to move in a direction in which the change in the color tone is cancelled.

3. The medical image processing device according to claim 1 , wherein
the circuitry is further configured to acquire the first specific component image signal generated for the first color component through exposure for a first exposure time and the second specific component image signal generated for the first color component through exposure for a second exposure time.

4. The medical image processing device according to claim 3 , wherein
the circuitry is further configured to acquire the first specific component image signal and the second specific component image signal from an imaging device including both a pixel group exposed for the first exposure time for the first color component and a pixel group exposed for the second exposure time for the first color component.

5. The medical image processing device according to claim 3 , wherein
the circuitry is further configured to acquire the first specific component image signal and the second specific component image signal from a pixel group for the first color component, the pixel group being exposed for the first exposure time at a first timing and being exposed for the second exposure time at a second timing.

6. The medical image processing device according to claim 1 , wherein
the circuitry is further configured to acquire the first specific component image signal from a pixel group exposed for a first exposure time for the first color component and acquires the second specific component image signal by adding signal values of adjacent pixels in the first specific component image signal.

7. The medical image processing device according to claim 1 , wherein
the circuitry is further configured to acquire, at a first frame rate, the first specific component image signal from a pixel group exposed for a first exposure time for the first color component and the second specific component image signal by adding signal values of the first specific component image signals in a plurality of frames that are successive in time.

8. The medical image processing device according to claim 1 , wherein
the circuitry is further configured to acquire the first specific component image signal and the second specific component image signal from an imaging device including both a pixel group that receives light of the first color component through a filter having a first transmittance and a pixel group that receives light of the first color component through a filter having a second transmittance different from the first transmittance.

9. The medical image processing device according to claim 1 , wherein
the second exposure is higher than the first exposure, and
the circuitry is further configured to apply a relatively high combination weight to the second specific component image signal in a pixel in which the first color component is weak and applies a relatively high combination weight to the first specific component image signal in a pixel in which the first color component is strong.

10. The medical image processing device according to claim 1 , wherein
the first color component is a red component.

11. The medical image processing device according to claim 1 ,
wherein the circuitry is further configured to acquire setting information associated with a color component of an observation target and set the first color component in accordance with the acquired setting information.

12. The medical image processing device according to claim 1 , wherein
the first exposure for the first color component is longer than the second exposure for the first color component.

13. The medical image processing device according to claim 1 , wherein the circuitry is configured to:
generate the first specific component image signal by averaging a first number of pixels from a first pixel group for the first color component;
generate the second specific component image signal by averaging the first number of pixels from a second pixel group for the first color component, different than the first pixel group;
generate the first non-specific component image signal for the second color component, by averaging signal values different from a second number of pixels, different than the first number of pixels, for the second color component; and
generate the second non-specific component image signal for the third color component, by averaging signal values different from the second number of pixels, for the third color component.

14. The medical image processing device according to claim 7 , wherein
the circuitry is further configured to acquire, at a first frame rate, the first specific component image signal from a pixel group exposed for a first exposure time for the first color component and acquire, at a second frame rate, the second specific component image signal.

15. The medical image processing device according to claim 14 , wherein
the second frame rate is half the first frame rate.

16. The medical image processing device according to claim 8 , wherein
the first transmittance is greater than the second transmittance.

17. A medical image processing system comprising:
an image sensor that captures an image of a subject; and
an image processing device configured to generate a color image signal by processing one or more image signals from the image sensor, wherein
the image processing device includes circuitry configured to
acquire a first specific component image signal with a first exposure for a first color component, a second specific component image signal with a second exposure different from the first exposure for the first color component, a first no

Assignees

• Sony Corp

Inventors

• Kikuchi Daisuke
• Mizukura Takami
• Takahashi Yasuaki
• Kashima Koji

Classifications

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• A61B1/04 Primary

  combined with photographic or television appliances · CPC title

• A61B1/00009

  of image signals during a use of endoscope · CPC title

• A61B1/0638

  providing two or more wavelengths · CPC title

• A61B1/043

  for fluorescence imaging · CPC title