Optical imaging system and methods thereof

Patent metadata

Field	Value
Publication number	US-12166953-B2
Application number	US-202117532186-A
Country	US
Kind code	B2
Filing date	Nov 22, 2021
Priority date	Feb 6, 2015
Publication date	Dec 10, 2024
Grant date	Dec 10, 2024

Abstract

An optical imaging system to image a target object includes a light source configured to emit one or more light rays to illuminate the target object and an image detector configured to capture a three-dimensional topography image of the target object when emitted light is emitted from the target object in response to being illuminated by the light rays emitted by the light source. A fluorescence image detector captures a fluorescence image of the target object when fluorescence is emitted from the target object in response illumination by light rays emitted by the light source. A controller instructs the image detector to capture the 3D topography image and the fluorescence image detector to detect the fluorescence image of the target object intraoperatively and to co-register and simultaneously display intraoperatively the co-registered topography and fluorescence information to the user via a display.

First claim

What is claimed is:

1. An optical imaging system to image a target object, comprising:
an image detection module configured to:
capture a preoperative image of the target object before the target object is positioned to be illuminated by at least one or more light rays projected onto the target object, wherein the preoperative image includes a preoperative three-dimensional (3D) topography of the target object,
track a position of the target object, and
detect intraoperative topography information of the target object when the target object is illuminated by one or more polarized light rays projected onto the target object;

a projector configured to:
emit a first set of the one or more light rays to project a corrected projection image of the preoperative image of the target object to be visualized by a user; and
emit a second set of the one or more light rays through a polarizer positioned between the projector and the target object to generate the one or more polarized light rays projected onto the target object to enable polarization imaging of the target object, thereby enabling a depth-resolved topography of the preoperative image of the target object as captured by the image detection module;

a display that includes a first display that encompasses a totality field of view associated with a first eye of the user and a second display that encompasses a totality field of view associated with a second eye of the user with at least one display that is head-mounted so that the first display is associated with the first eye of the user and the second display is associated with the second eye of the user and is configured to:
display via the first display the corrected projection image to be visualized by the user that is projected onto the first display, and
display via the second display that is partially transparent to light to enable the user to view via natural vision of the second eye of the user a surrounding environment of the user via the second display simultaneously with the corrected projection image projected onto the first display thereby enabling the user to view the surrounding environment with the natural vision simultaneously with the corrected projection image via the display; and

a controller that includes at least one graphics processing unit and is configured to:
map each relative distance determined from preoperative image data included in the preoperative 3D topography of the target object to the corrected projection image based on a position of the projector, wherein the corrected projection image incorporates each relative distance determined from the preoperative image data included in the preoperative 3D topography of the target object based on the intraoperative topography information of the target object detected from the projection of the one or more polarized light rays onto the target object to thereby display at least a portion of the preoperative 3D topography of the target object included in the preoperative image in the corrected projection image,
co-register the preoperative image data included in the corrected projection image and the intraoperative topography information to generate co-registered topography information and preoperative information, wherein the co-registered topography information and preoperative information is segmented to isolate an organ of interest and surface-based registration, and
instruct the projector to project the preoperative image data included in the corrected projection image to be visualized by the user via the display for visualization based on the co-registered topography information and preoperative information.

2. The optical imaging system of claim 1 , wherein the display is further configured to display at least the portion of the preoperative 3D topography of the target object via the corrected projection image with depth perception.

3. The optical imaging system of claim 1 , further comprising a beam splitter, arranged between the target object and the image detection module, that is configured to split light based on polarization, wherein a portion of the split light is directed into the image detection module to enable polarization imaging of the target object, thereby enabling a depth-resolved topography of the preoperative image of the target object as captured by the image detection module.

4. The optical imaging system of claim 1 , wherein the controller is further configured to:
calculate a transformation matrix between a preoperative image space that the corrected projection image is projected via the display and an intraoperative image space that an imaging system captures as a tracker tracks the position of the target object;
co-register the preoperative image data included in the corrected projection image to intraoperative image data included in the intraoperative image space that is captured by the imaging system as the position of the target object is tracked by the tracker; and
instruct the display to display the preoperative image data included in the corrected projection image that is co-registered to the intraoperative image data that is captured by the imaging system as the position of the target object is tracked by the tracker.

5. The imaging system of claim 4 , wherein the controller is further configured to instruct the display to enable the user to view the surrounding environment of the user via the display simultaneously with the display of the preoperative image data included in the corrected projection image that is co-registered to the intraoperative image data that is captured by the imaging system as the position of the target object is tracked by the tracker.

6. The optical imaging system of claim 4 , wherein the controller is further configured to:
calculate a transformation matrix between the intraoperative image space and an intraoperative object space, wherein the intraoperative space is a space occupied by the target object that a surgical procedure is being performed;
co-register the intraoperative image data as captured by the imaging system as the position of the target of interest is tracked by the tracker to the intraoperative object space that is occupied by the target object during the surgical procedure; and
instruct the display to display the intraoperative image data in the corrected projection image that is co-registered to the intraoperative object space that is occupied by the target object.

7. The imaging system of claim 6 , wherein the controller is further configured to instruct the display to enable the user to view the surrounding environment of the user via the display simultaneously with the display of the intraoperative image data included in the corrected projection image that is co-registered with the intraoperative object space as the position of the target object is tracked by the tracker.

8. The imaging system of claim 7 , wherein the controller is further configured to instruct the display to enable the user to view the surrounding environment of the user via the display simultaneously with the display of fluorescence image data included in the corrected projection image that is co-registered with the intraoperative object space.

9. The imaging system of claim 7 , wherein the controller is further configured to instruct the display to enable the user to view the surrounding environment of the user via the display simultaneously with the display of color image data included in the corrected projection image that is co-registered with the intraoperative object space.

10. A method for imaging a target object, comprising:
capturing, by an image detection module, a preoperative image of the target object before the target object before the target object is positioned

Assignees

• Liu Yang
• Univ Akron

Inventors

• Liu Yang

Classifications

• H04N5/33

  Transforming infrared radiation (cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20) · CPC title

• H04N23/21

  from near infrared [NIR] radiation · CPC title

• G06T2207/10108

  Single photon emission computed tomography [SPECT] · CPC title

• G06T2207/10104

  Positron emission tomography [PET] · CPC title

• G06T2207/10088

  Magnetic resonance imaging [MRI] · CPC title