Systems and methods for recording simultaneously visible light image and infrared light image from fluorophores

Patent metadata

Field	Value
Publication number	US-2021065366-A1
Application number	US-202016996750-A
Country	US
Kind code	A1
Filing date	Aug 18, 2020
Priority date	Apr 23, 2013
Publication date	Mar 4, 2021
Grant date	—

Abstract

The invention provides systems and methods for imaging a sample. In various embodiments, the invention provides a system comprising an image sensor, a laser for emitting excitation light for an infrared or near-infrared fluorophore, a visible light source, a notch beam splitter, a notch filter, a synchronization module, an image processing unit, an image displaying unit, and light-conducting channels. In various embodiments, the present invention provides a system comprising an image sensor, a laser for emitting excitation light for an infrared or near-infrared fluorophore, a laser clean-up filter, a notch filter, a white light source, an image processing unit, an image displaying unit, and light-conducting channels. In accordance with the present invention, the image sensor can detect both visible light and infrared light.

First claim

1 - 30 . (canceled)

31 . An imaging system for imaging a sample comprising an infrared or near-infrared fluorophore, comprising:
an image sensor; a laser to emit an excitation light for the infrared or near-infrared fluorophore, wherein the excitation light excites the infrared or near-infrared fluorophore in the sample to emit an emission light; a notch filter in the emission light path from the sample to the image sensor, wherein the notch filter blocks a portion of the excitation light reflected from the sample towards the image sensor; a white light source to emit a light comprising visible light, wherein the visible light is conducted to the sample, wherein the sample reflects the visible light, and wherein the reflected visible light is conducted to the image sensor; and an image processing unit to process signals from the image sensor to generate a white light frame (WLF) when the sample receives only visible light, a stray light frame (SLF) when the sample receives neither visible light nor the excitation light, and two or more near infrared frames (NIFs) when the sample receives only the excitation light to reduce a ghosting effect.

32 . The imaging system of claim 31 , wherein the image processing unit generates the WLF from a first frame, the SLF from a second frame captured after the first frame, and the NIF from a third frame captured after the second frame.

33 . The imaging system of claim 32 , wherein the image processing unit generates the NIF from the third frame, a fourth frame captured after the third frame, and a fifth frame captured after the fourth frame.

34 . The imaging system of claim 32 , wherein the image processing unit generates the image frame by adding together two subsequent sets of the first frame, the second frame, the third frame, the fourth frame, and the fifth frame.

35 . The imaging system of claim 31 , wherein the image sensor is synchronized to an on and off status of the laser.

36 . The imaging system of claim 31 , wherein the image sensor is a CCD image sensor or a CMOS image sensor.

37 . The imaging system of claim 31 , wherein the image sensor comprises one or more image sensors.

38 . The imaging system of claim 31 , wherein the image sensor is a single image sensor.

39 . The imaging system of claim 38 , wherein the single image sensor is configured to detect both the emission light and the visible light from the sample and configured to generate sensor signals, and wherein the image sensor comprises blue, green and red pixel sensors.

40 . The imaging system of claim 31 , wherein the white light source, the laser, or both are pulsed.

41 . The imaging system of claim 31 , further comprising a laser clean-up filter in the light path from the laser to the sample.

42 . The imaging system of claim 41 , wherein the laser clean-up filter is not a spatial filter.

43 . The imaging system of claim 41 , wherein the laser clean-up filter selectively transmits light having a wavelength of about 749-789 or 775-795 nm.

44 . The imaging system of claim 41 , wherein operating the laser clean-up filter narrows the wavelength band of the excitation light to a peak absorption band of the infrared or near-infrared fluorophore, and wherein the narrowed excitation light excites the infrared or near-infrared fluorophore in the sample to emit the emission light.

45 . The imaging system of claim 41 , wherein a blocking range of the notch filter is broader than the transmitting range of the laser clean-up filter.

46 . The imaging system of claim 31 , wherein the excitation light comprises light having a wavelength of about 749-789 or 775-795 nm.

47 . The imaging system of claim 31 , wherein the notch filter selectively blocks light having a wavelength of about 749-789, 770-800, 765-805, or 760-810 nm.

48 . The imaging system of claim 31 , further comprising a notch beam splitter in the light path from the laser to the sample, whereby the excitation light is reflected by the notch beam splitter to the sample.

49 . The imaging system of claim 31 , further comprising a notch beam splitter in the light path from the white light source to the sample, whereby the visible light is transmitted to the sample.

50 . The imaging system of claim 31 , further comprising a notch beam splitter that reflects light having a wavelength of about 700, 725, or 750 nm.

51 . The imaging system of claim 31 , wherein the image processing unit subtracts the SLF from each NIF and then adds together all SLF-subtracted NIFs to generate a final NIF.

52 . The imaging system of claim 51 , wherein the image processing unit false colors the final NIF.

53 . The imaging system of claim 52 , wherein the image processing unit adds the false colored final NIF to the WLF to generate a composite image frame of visible light and infrared light.

54 . The imaging system of claim 31 , further comprising an image displaying unit to display images based on the image frames generated from the image processing unit, wherein the image displaying unit is connected to the image processing unit.

55 . The imaging system of claim 31 , wherein the excitation light from the laser is conducted to the sample through one or more channels, and/or wherein the visible light from the white light source is conducted to the sample through one or more channels, and/or wherein the emission light emitted from the sample is conducted to the image sensor through one or more channels, and/or wherein the visible light reflected from the sample is conducted to the image sensor through one or more channels.

56 . The imaging system of claim 31 , wherein the excitation light is conducted to the sample along an emission light path in a first direction within a first channel.

57 . The imaging system of claim 56 , wherein the emission light is conducted to the image single sensor along the emission light path in a second direction opposite the first direction and overlapping at least partially within the first channel.

58 . The imaging system of claim 57 , wherein the visible light from the white light source is conducted to the sample through a third channel, wherein the emission light emitted from the sample is conducted to the single image sensor through the second channel, and wherein the visible light reflected from the sample is conducted to the single image sensor through a fourth channel.

59 . The imaging system of claim 58 , wherein the first, second, third, and fourth channels are four separate channels or combined into one, two, or three channels.

60 . The imaging system of claim 31 ,
wherein the excitation light from the laser is further conducted to the sample through a third light channel housed in an endoscope; wherein the visible light from the white light source is conducted to the sample through a fourth light channel housed in the endoscope; and wherein the image sensor is housed in the endoscope at or near the patient end of the endoscope.

61 . The imaging system of claim 60 , wherein the third light channel, the fourth light channel, or both, is an optical cable.

62 . The imaging system of claim 60 , further comprising one or more lenses in the emission light path and/or the visible light path from the sample to the image sensor, wherein the one or mor

Assignees

• Cedars Sinai Medical Center

Inventors

• Butte Pramod
• Mamelak Adam

Classifications

• H04N23/51

  Housings · CPC title

• H04N23/11

  for generating image signals from visible and infrared light wavelengths · CPC title

• H04N23/74

  by influencing the scene brightness using illuminating means · CPC title

• H04N23/56

  provided with illuminating means · CPC title

• A61B1/00009 Primary

  of image signals during a use of endoscope · CPC title