Method and apparatus for quantitative hyperspectral fluorescence and reflectance imaging for surgical guidance

Patent metadata

Field	Value
Publication number	US-12061328-B2
Application number	US-202318144767-A
Country	US
Kind code	B2
Filing date	May 8, 2023
Priority date	Jan 20, 2012
Publication date	Aug 13, 2024
Grant date	Aug 13, 2024

Abstract

An imaging system includes an illumination device for illuminating a target. A surgical microscope receives light from the target, the surgical microscope comprising at least one optical output port at which at least a portion of the received light is provided as an output from the surgical microscope. A tunable filter receives the portion of the received light provided as the output from the surgical microscope, the tunable filter being tunable to pass a filtered portion of the received light, the filtered portion of the received light having a plurality of wavelengths selected by the tunable filter and provided as output from the tunable filter. A high-resolution, broad-bandwidth electronic camera receives the light of a plurality of wavelengths selected by the tunable filter, the electronic camera converting the light of a plurality of wavelengths selected by the tunable filter to a plurality of electrical signals. A processor processes the plurality of electrical signals to form an image of the target.

First claim

The invention claimed is:

1. A hyperspectral imaging system for determining depth and concentration of fluorophores in tissue of a patient, comprising:
a configured illuminator apparatus adapted to illuminate the tissue with light selected from the group consisting of white light and fluorescence stimulus light;
a hyperspectral camera configured to capture a white-light hyperspectral image cube of the tissue as illuminated with the white light from the configured illuminator apparatus, the hyperspectral camera configured to pass light from the tissue through a tunable filter into an electronic camera;
the hyperspectral camera also configured to capture a fluorescence-light hyperspectral image cube of the tissue as illuminated with the fluorescence stimulus light from the configured illuminator apparatus;
an image processor configured to:
analyze spectral bands of pixels of the white-light hyperspectral image cube near a wavelength of the fluorescence stimulus light and a wavelength of associated fluorescence emissions to extract scattering and absorption parameters at pixels of the tissue at the wavelengths of the fluorescence stimulus light and the associated fluorescence emissions,
normalize at least one selected pair of images of the fluorescence-light hyperspectral image cube, the at least one selected pair of images being associated with two different respective wavelengths near a peak wavelength of the fluorescence emissions,
derive, based upon the scattering and absorption parameters, depth of the fluorophores in the tissue at pixels of the selected pair of images from a ratio between the images of the at least one selected pair of images of the fluorescence-light hyperspectral image cube, as normalized; and
determine fluorophore concentration at voxels of a voxel-based model using the extracted scattering and absorption parameters derived from the white-light hyperspectral image cube, the depth of the fluorophores at the pixels, and at least one image of the fluorescence-light hyperspectral image cube.

2. The hyperspectral imaging system of claim 1 wherein the image processor is configured to, when analyzing the spectral bands of the pixels to extract the scattering and absorption parameters, perform steps comprising setting up the voxel-based model with the scattering and absorption parameters and refining the scattering and absorption parameters.

3. The hyperspectral imaging system of claim 2 , wherein the image processor is configured to fit, to the ratio between the images, a model of depth-dependent spectral properties of fluorescence emissions, to determine the depth of the fluorophores and, prior to the fitting, determine parameters of the model of the depth-dependent spectral properties from the scattering and absorption parameters.

4. The hyperspectral imaging system of claim 1 , wherein the image processor is configured to, when normalizing the at least one selected pair of images of the fluorescence-light hyperspectral image cube, to select a plurality of pairs of images of the fluorescence-light hyperspectral image cube; and when deriving, collectively evaluating a plurality of ratios, each obtained from a respective one of the plurality of pairs of images.

5. The hyperspectral imaging system of claim 1 , the image processor configured to, when normalizing, divide each intensity of pixels of images in the at least a subset of the fluorescence-light hyperspectral image cube by (a) intensity of pixels signal in an image of the white-light hyperspectral image cube corresponding to the wavelength of the fluorescence stimulus light and (b) a power of signal intensity of pixels in an image of the white-light hyperspectral image cube associated with same wavelength as the respective image in the at least a subset of the fluorescence-light hyperspectral image cube.

6. The hyperspectral imaging system of claim 5 , wherein the white-light hyperspectral image cube and the fluorescence-light hyperspectral image cube are captured at a same set of wavelengths, and wherein the image processor is configured to, when normalizing, correct at least two pairs of images of the fluorescence-light hyperspectral image cube.

7. A hyperspectral imaging system for determining depth and concentration of fluorophores in tissue of a patient, comprising:
a hyperspectral camera configured to capture a white light hyperspectral image cube of the tissue as illuminated with white light, the hyperspectral camera including a tunable filter and a broad-spectrum electronic camera;
the hyperspectral camera also configured to capture a fluorescence-light hyperspectral image cube of the tissue as illuminated with fluorescence stimulus light;
an image processor coupled to receive the white light hyperspectral image cube and the fluorescence-light hyperspectral image cube and configured to:
analyze spectral bands of the white light hyperspectral image cube near a wavelength of the fluorescence stimulus light and a wavelength of associated fluorescence emissions to extract at pixels scattering and absorption parameters of the tissue at the wavelengths of the fluorescence stimulus light and the associated fluorescence emissions;
normalize at least one selected pair of images of the fluorescence-light hyperspectral image cube, the at least one selected pair of images being associated with two different respective wavelengths near a peak wavelength of the fluorescence emissions;
derive, the depth of the fluorophores in the tissue at pixels based upon the scattering and absorption parameters and a ratio between two images of the at least one selected pair of images of the fluorescence-light hyperspectral image cube, as normalized; and
determine fluorophore concentration at voxels of a voxel-based model using the extracted scattering and absorption parameters derived from the white-light hyperspectral image cube, and the depth of the fluorophores at the pixels and at least one image of the fluorescence-light hyperspectral image cube.

8. The hyperspectral imaging system of claim 7 , the image processor configured to, while deriving the depth of the fluorophores in the tissue, compare a ratio of two images of the at least one selected pair of images to a model of depth-dependent spectral properties of the fluorescence signal of two images of the at least one selected pair of images.

9. The hyperspectral imaging system of claim 8 , wherein the image processor is configured to, prior to comparing the ratio between the two images of the at least one selected pair of images, determine parameters of the model of the depth-dependent spectral properties from the scattering and absorption parameters.

10. The hyperspectral imaging system of claim 8 , the model of the depth-dependent spectral properties specifying the depth as d=[ln(Γ)-ln(D_1/D_2)1/δ_2-1/δ_1)], wherein (a) D_1 and D_2 are diffusion constants for the two different wavelengths, respectively, (b) δ_1 and δ_2 are penetration depths for the two different wavelengths, respectively, and (c) Γ is the ratio, the processor further configured to determine each of D_1, D_2, δ_1, and δ_2 from the scattering and absorption parameters.

11. A hyperspectral imaging system for determining depth and concentration of fluorophores in tissue of a patient, comprising:
a configured illuminator apparatus adapted to illuminate the tissue with light selected from the group consisting of white light and fluorescence stimulus light;
a hyperspectral camera configured to capture a white-light hyperspectral image cube of the tissue as illuminated with the white light from the configured illuminator apparatus, the hyperspectral camera configured to pass light from the tissue through at least one filt

Assignees

• Dartmouth College

Inventors

• Valdes Pablo A
• Roberts David W
• Paulsen Keith D
• Leblond Frederic

Classifications

• A61B1/063

  for monochromatic or narrow-band illumination · CPC title

• G02B21/36

  arranged for photographic purposes or projection purposes (G02B21/18 takes precedence){or digital imaging or video purposes including associated control and data processing arrangements (image data processing per se G06T)} · CPC title

• A61B5/0075

  by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy (A61B5/0071 takes precedence) · CPC title

• A61B5/0077

  Devices for viewing the surface of the body, e.g. camera, magnifying lens · CPC title

• A61B5/0071

  by measuring fluorescence emission · CPC title