System and method for navigating to target and performing procedure on target utilizing fluoroscopic-based local three dimensional volume reconstruction

Patent metadata

Field	Value
Publication number	US-11547377-B2
Application number	US-202016909711-A
Country	US
Kind code	B2
Filing date	Jun 23, 2020
Priority date	Aug 6, 2015
Publication date	Jan 10, 2023
Grant date	Jan 10, 2023

Abstract

A system and method for navigating to a target using fluoroscopic-based three dimensional volumetric data generated from two dimensional fluoroscopic images, including a catheter guide assembly including a sensor, an electromagnetic field generator, a fluoroscopic imaging device to acquire a fluoroscopic video of a target area about a plurality of angles relative to the target area, and a computing device. The computing device is configured to receive previously acquired CT data, determine the location of the sensor based on the electromagnetic field generated by the electromagnetic field generator, generate a three dimensional rendering of the target area based on the acquired fluoroscopic video, receive a selection of the catheter guide assembly in the generated three dimensional rendering, and register the generated three dimensional rendering of the target area with the previously acquired CT data to correct the position of the catheter guide assembly.

First claim

What is claimed is:

1. A navigation system comprising:
an electromagnetic field generator;
a catheter including at least one sensor configured for placement within an electromagnetic field; and
a computing device including at least a processor and a memory, wherein the memory includes instructions that when executed by the processor cause the computing device to:
determine a position of the catheter within an electromagnetic field generated by the electromagnetic field generator;
display the determined position in a 3 D model derived from pre-procedure imaging;
receive a series of fluoroscopic images of a target area captured by a fluoroscopic imaging device;
generate a fluoroscopic-based three-dimensional reconstruction of the target area based on the series of fluoroscopic images of the target area captured by the fluoroscopic imaging device;
receive an identification of a location of medical device in at least one two-dimensional image from the three-dimensional reconstruction;
receive an identification of a location of a target in at least one two-dimensional image from the three-dimensional reconstruction;
determine a relative position of the medical device to the target in the target area within the fluoroscopic-based three-dimensional reconstruction; and
update the displayed position of the sensor in the 3D model relative to a target in the 3D model based on the determined relative position in the fluoroscopic-based three-dimensional reconstruction.

2. The navigation system of claim 1 , wherein the instructions, when executed by the processor cause the computing device to generate a second fluoroscopic-based three-dimensional reconstruction of the target area based on a second series of fluoroscopic images of the target area, when it is determined that the medical device is further than a predetermined threshold distance from a portion of the target.

3. A navigation system comprising:
a tracking system configured to track the position of a catheter within a luminal network;
a sensor, associated with the catheter, and configured to be detected by the tracking system; and
a computing device including at least a processor and a memory, wherein the memory includes instructions that when executed by the processor cause the computing device to:
determine a position of the sensor associated with the catheter;
display that determined position in a 3D model derived from pre-procedure imaging;
receive a series of fluoroscopic images of a target area captured by a fluoroscopic imaging device;
determine poses of the fluoroscopic imaging device corresponding to a plurality of fluoroscopic images of the series of fluoroscopic images;
generate a fluoroscopic-based three-dimensional reconstruction of the target area based on the series of fluoroscopic images of the target area captured by the fluoroscopic imaging device and the poses determined;
receive an identification of a location of a target in at least one two-dimensional image from the three-dimensional reconstruction; and
update the displayed position of the sensor in the 3D model relative to a target in the 3D model based on the identified location of the target in the fluoroscopic-based three-dimensional reconstruction.

4. The navigation system of claim 3 , wherein the instructions, when executed by the processor cause the computing device to register the 3D model with the fluoroscopic-based three-dimensional reconstruction.

5. The navigation system of claim 3 , wherein the pre-procedure imaging is magnetic resonance imaging or computed tomography imaging.

6. The navigation system of claim 3 , wherein the instructions, when executed by the processor cause the computing device to receive an identification of a location of a medical device in at least one image from the three-dimensional reconstruction automatically via image processing.

7. The navigation system of claim 3 , wherein the instructions, when executed by the processor cause the computing device to receive an identification of a location of a medical device in at least one image from the three-dimensional reconstruction by receiving user input.

8. The navigation system of claim 7 , wherein the instructions, when executed by the processor cause the computing device to determine whether the medical device is within a predetermined threshold distance from a portion of the target.

9. The navigation system of claim 8 , wherein the instructions, when executed by the processor cause the computing device to generate a second fluoroscopic-based three-dimensional reconstruction of the target area based on a second series of fluoroscopic images of the target area, when it is determined that the medical device is further than a predetermined threshold distance from a portion of the target.

10. The navigation system of claim 9 , wherein the instructions, when executed by the processor cause the computing device to:
receive an identification of a medical device in at least one image from the second three-dimensional reconstruction;
receive an identification of a target in at least one image from the second three-dimensional reconstruction; and
determining whether the medical device is within a predetermined threshold distance from a portion of the target.

11. A three-dimensional fluoroscopic imaging system method:
receiving a series of fluoroscopic images of a target area captured by a fluoroscopic imaging device;
determining poses of the fluoroscopic imaging device corresponding to a plurality of fluoroscopic images of the series of fluoroscopic images;
generating a fluoroscopic-based three-dimensional reconstruction of the target area based on the series of fluoroscopic images of the target area captured by the fluoroscopic imaging device and the poses determined;
receiving an identification of a medical device in at least one first two-dimensional image from the three-dimensional reconstruction;
receiving an identification of a target in at least one second two-dimensional image from the three-dimensional reconstruction; and
determining whether the medical device is within a predetermined threshold distance from a portion of the target.

12. The three-dimensional fluoroscopic imaging system method of claim 11 , wherein the portion of the target is selected from a group consisting of an edge and a center of the target.

13. The three-dimensional fluoroscopic imaging system method of claim 11 , wherein the identification of the medical device or the target is performed automatically via image processing.

14. The three-dimensional fluoroscopic imaging system method of claim 11 , wherein the identification of the medical device or the target comprises receiving user input.

15. The three-dimensional fluoroscopic imaging system method of claim 11 , further comprising generating a second fluoroscopic-based three-dimensional reconstruction of the target area based on a second series of fluoroscopic images of the target area.

16. The three-dimensional fluoroscopic imaging system method of claim 15 , further comprising:
receiving an identification of a medical device in at least one image from the second three-dimensional reconstruction;
receiving an identification of a target in at least one image from the three-dimensional reconstruction; and
determining whether the medical device is within a predetermined threshold distance from a portion of the target.

17. The three-dimensional fluoroscopic imaging system method of claim 16 , comprising registering the first or second fluoroscopic-based three-dimensional reconstruction of the target area bas

Assignees

• Covidien Lp

Inventors

• Weingarten Oren P
• Barak Ron
• Greenburg Benjamin
• Klein Eyal
• Kopel Evgeni

Classifications

• A61B2017/00809

  Lung operations · CPC title

• A61B6/12

  Arrangements for detecting or locating foreign bodies · CPC title

• A61B6/4405

  the apparatus being movable or portable, e.g. handheld or mounted on a trolley · CPC title

• A61B2090/367

  creating a 3D dataset from 2D images using position information · CPC title

• A61B2090/3966

  Radiopaque markers visible in an X-ray image · CPC title