Hyperspectral/multispectral imaging system with simultaneous white light imaging

Patent metadata

Field	Value
Publication number	US-12402786-B2
Application number	US-202418431404-A
Country	US
Kind code	B2
Filing date	Feb 2, 2024
Priority date	Dec 29, 2023
Publication date	Sep 2, 2025
Grant date	Sep 2, 2025

Abstract

A hyperspectral imaging method and system including cameras with simultaneous white light imaging capability are presented. A video system includes a camera and a light source adapted to provide white light illumination at a first frame rate suitable for live video, and to provide intermittent narrowband illumination for individual frames interspersed among the white light illuminated frames, where the spectrum of the narrowband illumination varies amongst the interspersed frames permitting a series of at least two differently illuminated narrowband interspersed frames to be assembled into a multispectral or hyperspectral data cube at a second frame rate. The system also includes a processor adapted to receive an image signal and create a live video feed based on the white light illuminated frames by replacing the narrowband illuminated frames with generated or previously collected frames.

First claim

The invention claimed is:

1. An endoscopic video system comprising:
a light source adapted to provide white light illumination at a first frame rate suitable for live video, and to interrupt the white light illumination and provide narrowband illumination for individual frames interspersed among the white light illuminated frames at regular or irregular intervals, wherein the spectrum of the narrowband illumination varies amongst the interspersed frames sufficient for a series of at least two differently illuminated narrowband interspersed frames to be assembled into a multispectral or hyperspectral data cube at a second frame rate; and
a processor adapted to receive an image signal based on sensor data received from a focal plane array sensor and create a live video feed based on the white light illuminated frames by replacing the narrowband illuminated frames with frames generated from one or more time-adjacent white light illuminated frames, and to generate the multispectral or hyperspectral data cube at a second frame rate based on the narrowband illuminated frames.

2. The system according to claim 1 the majority of frames are illuminated by white light.

3. The system according to claim 2 wherein at least 90% of the frames are illuminated by white light.

4. The system according to claim 1 wherein at least some of the narrowband spectra overlap with portions of the white light illumination spectrum.

5. The system according to claim 1 wherein the number of different narrowband spectra used for illuminating the interspersed frames is greater than 10.

6. The system according to claim 1 wherein the number of different narrowband spectra used for illuminating the interspersed frames is greater than 50.

7. The system according to claim 1 wherein the processor is further adapted to generate an image from information contained in the hyperspectral or multispectral data cube and cause the image to be displayed in a separate display area than a display area showing the video feed.

8. The system according to claim 7 wherein the image generated from the hyperspectral data cube indicates the oxygenation, tissue water index, or perfusion of tissue in an image scene.

9. The system according to claim 1 wherein the spectral bandwidth of the narrowband illumination spectra is about 5 nm.

10. The system according to claim 1 wherein the spectral bandwidth of the narrowband illumination spectra is about 10 nm.

11. The system according to claim 1 wherein the spectral bandwidth of the narrowband illumination spectra is about 25 nm.

12. The system according to claim 1 wherein the white light illumination and the narrowband illumination have total power that is similar sufficient such that exposure characteristics of the sensor do not have to be different for the frames illuminated with narrowband illumination than it is for the frames illuminated by white light in order to acquire data for the multispectral or hyperspectral data cube.

13. The system according to claim 1 wherein data from multiple narrowband illuminated frames of identical narrowband illumination are averaged to generate a data cube and/or a slice of a data cube.

14. A method comprising:
causing a light source for a medical scope to provide white light illumination for frames at a first frame rate suitable for live video;
causing the light source to interrupt the white light illumination and provide narrowband illumination for individual frames interspersed among the white light illuminated frames at regular or irregular intervals, wherein the narrowband spectrum varies amongst the interspersed frames sufficient for a series of at least two differently illuminated narrowband interspersed frames to be assembled into a multispectral or hyperspectral data cube at a second frame rate;
imaging the white light illuminated fames and narrowband illuminated frames onto a focal plane array image sensor at the medical scope;
at a processor, receiving an image signal based on sensor data received from the focal plane array sensor and creating a live video feed based on the white light illuminated frames by replacing the narrowband illuminated frames with frames generated from one or more time-adjacent white light illuminated frames; and
at the processor, generating a multispectral or hyperspectral data cube at a second frame rate based on the narrowband illuminated frames.

15. The method according to claim 14 further comprising generating an image from information contained in the hyperspectral or multispectral data cube and displaying said image on a separate display area than the live video feed.

16. The method according to claim 15 wherein the image generated from the hyperspectral data cube indicates the oxygenation, tissue water index, or perfusion of tissue in an image scene.

17. The method according to claim 14 wherein the spectral bandwidth of the narrowband illumination spectra is about 5 nm.

18. The method according to claim 14 wherein the spectral bandwidth of the narrowband illumination spectra is about 10 nm.

19. The method according to claim 14 wherein the spectral bandwidth of the narrowband illumination spectra is about 25 nm.

20. The method according to claim 14 wherein the white light illumination and the narrowband illumination have total power that is similar sufficient such that exposure characteristics of the sensor do not have to be different for the frames illuminated with narrowband illumination than it is for the frames illuminated by white light in order to acquire data for the multispectral or hyperspectral data cube.

Assignees

• Storz Karl Imaging Inc

Inventors

• Duckett Iii George E

Classifications

• H04N7/0806

  the signals being two or more video signals (H04N7/0803, H04N7/081 take precedence) · CPC title

• A61B1/00009

  of image signals during a use of endoscope · CPC title

• H04N7/183

  for receiving images from a single remote source · CPC title

• A61B1/04

  combined with photographic or television appliances · CPC title

• H04N23/74 Primary

  by influencing the scene brightness using illuminating means · CPC title