System and method for integrated visualization camera and optical coherence tomography

Patent metadata

Field	Value
Publication number	US-2021169324-A1
Application number	US-202017108458-A
Country	US
Kind code	A1
Filing date	Dec 1, 2020
Priority date	Dec 5, 2019
Publication date	Jun 10, 2021
Grant date	—

Abstract

System and method for imaging a target site with a housing assembly having a head unit configured to be at least partially directed towards the target site. An optical coherence tomography (OCT) module and stereoscopic visualization camera are at least partially located in the head unit and configured to obtain a first set and a second of volumetric data of the target site, respectively. A controller is configured to register the first set of volumetric data with the second set of volumetric data to create a third set of registered volumetric data. The third set of registered volumetric data and second set of volumetric data are rendered, via a volumetric render module, to a first and second region. The first region and the second region are overlaid to obtain a composite shared view of the target.

First claim

What is claimed is:

1 . A system for imaging a target site, the system comprising:
a housing assembly having a head unit configured to be at least partially directed towards the target site; an optical coherence tomography (OCT) module at least partially located in the head unit and configured to obtain a first set of volumetric data of the target site; a stereoscopic visualization camera at least partially located in the head unit and configured to obtain a second set of volumetric data of the target site, the second set of volumetric data including first and second views of the target site; a controller in communication with the stereoscopic visualization camera and the OCT module; a volumetric render module selectively executable by the controller; wherein the controller has a processor and tangible, non-transitory memory on which instructions are recorded, execution of the instructions causing the controller to:
register the first set of volumetric data from the OCT module with the second set of volumetric data from the stereoscopic visualization camera to create a third set of registered volumetric data;
render the third set of registered volumetric data to a first region to obtain a two-dimensional OCT view, via the volumetric render module;
render the second set of volumetric data from the stereoscopic visualization camera to a second region to obtain a live two-dimensional stereoscopic view, via the volumetric render module; and
overlay the first region and the second region to obtain a composite shared view of the target site.

2 . The system of claim 1 , further comprising:
a robotic arm operatively connected to and configured to selectively move the head unit; and wherein the robotic arm is selectively operable to extend a viewing range of the OCT module in an axial direction, a first transverse direction and a second transverse direction.

3 . The system of claim 1 , wherein registering the first set of volumetric data from the OCT module with the second set of volumetric data from the stereoscopic visualization camera includes:
aligning the first and second views of the stereoscopic visualization camera respectively in rotation, translation and scale to the volumetric render module; and matching respective perspectives of the first and second views of the stereoscopic visualization camera to the volumetric render module.

4 . The system of claim 1 , wherein registering the first set of volumetric data with the second set of volumetric data includes:
finding a respective location and respective orientation of a center of projection of a first two-dimensional visualization module and a second two-dimensional visualization module of the stereoscopic visualization camera relative to the respective location and the respective orientation of a respective data space of the OCT module.

5 . The system of claim 1 , wherein registering the first set of volumetric data with the second set of volumetric data includes:
aligning a local area of interest in the first set of volumetric data in position, orientation and size with the second set of volumetric data; and wherein the local area of interest includes at least one of a corneal limbus and a scleral vasculature.

6 . The system of claim 1 , wherein prior to registering the first set of volumetric data with the second set of volumetric data, the controller is configured to:
calibrate the OCT module and calibrate the stereoscopic visualization camera, including placing a calibration device at the target site and fitting respective lines to respective surfaces of the calibration device in each of three orthogonal views.

7 . The system of claim 1 , further comprising:
prior to registering the first set of volumetric data with the second set of volumetric data, the controller is configured to obtain a transformation matrix connecting a respective space of the OCT module to the respective space of the volumetric render module.

8 . The system of claim 1 , further comprising:
an oblique visualization module selectively executable by the controller to produce an off-axis view of the composite shared view such that a respective representation of the first set of volumetric data and the second set of volumetric data is viewed at a predefined oblique angle; and wherein execution of the oblique visualization module causes the controller to:
form a wireframe image based in part on the first set of volumetric data;
render the wireframe image as a first pair of stereo images;
render the second set of volumetric data as a second pair of stereo images; and
fuse the first pair of stereo images and the second pair of stereo images to form the off-axis view.

9 . The system of claim 8 , wherein:
the predefined oblique angle is selectable by a user via a user interface.

10 . The system of claim 8 , wherein:
the first set of volumetric data is configured to be updated at a first frequency and the second set of volumetric data is configured to be updated at a second frequency; and the updating of the first set of volumetric data and the second set of volumetric data is not synchronized.

11 . The system of claim 1 , wherein:
the controller is configured to visualize the composite shared view with a plurality of topographic levels; and each of the plurality of topographic levels is characterized by a respective depth.

12 . The system of claim 1 , wherein:
the stereoscopic visualization camera and the OCT module define a respective latency; the controller includes a first set of image buffers configured to selectively delay a display of the two-dimensional OCT view to match the respective latency of the stereoscopic visualization camera; and the controller includes a second set of image buffers configured to selectively delay the display of the live two-dimensional stereoscopic view to match the respective latency of the OCT module.

13 . The system of claim 1 , wherein the controller is configured to:
add at least one annotation over the composite shared view on a display, the at least one annotation showing a boundary of the two-dimensional OCT view.

14 . The system of claim 1 , wherein:
the target site is an eye; the controller is configured to add at least one annotation over the composite shared view on a display, the at least one annotation indicating a landmark of the eye; and the controller is configured to maintain a relative position of the at least one annotation in the live two-dimensional stereoscopic view.

15 . The system of claim 1 , wherein the controller is configured to:
obtain three-dimensional coordinates of each respective voxel in the second set of volumetric data relative to a reference point; and convert a respective location of each pixel in an output image to a real-world position in a respective reference frame of the stereoscopic visualization camera.

16 . A method for imaging a target site with a system including a housing assembly having a head unit, the system including a controller having a processor and tangible, non-transitory memory on which instructions are recorded:
directing the head unit at least partially towards the target site; positioning at least a portion of an optical coherence tomography (OCT) module in the head unit and configuring the OCT module to obtain a first set of volumetric data of the target site; positioning at least a portion of a stereoscopic visualization camera in the head unit and configuring the stereoscopic visualization camera to obtain a second set of volumetric data of the target site, the second set of volume

Assignees

• Alcon Inc

Inventors

• Tripathi Ashok Burton
• Polchin George Charles
• Ramirez Luna Maximiliano
• Terry Patrick
• Riederer Thomas Paul

Classifications

• A61F9/007

  Methods or devices for eye surgery · CPC title

• G06T2207/10012

  Stereo images · CPC title

• A61B3/0025

  characterised by electronic signal processing, e.g. eye models · CPC title

• A61B2560/0223

  of calibration, e.g. protocols for calibrating sensors · CPC title

• A61B2090/364

  Correlation of different images or relation of image positions in respect to the body · CPC title