Method and device for registration and tracking during a percutaneous procedure

Patent metadata

Field	Value
Publication number	US-12458397-B2
Application number	US-202218288783-A
Country	US
Kind code	B2
Filing date	May 2, 2022
Priority date	Apr 30, 2021
Publication date	Nov 4, 2025
Grant date	Nov 4, 2025

Abstract

Guided percutanous device and method for providing visual representations of organ registration and tracking during a guided percutaneous procedure using an electromagnetic tracking (EMT) system comprising an EMT field generator and tracker defining an EMT coordinate system, a catheter with a EMT sensor for placing in the organ to indicate a percutaneous procedure target, a needle with an EMT sensor, an ultrasound (US) probe with an EMT sensor, and an electronic data processor configured for carrying out the steps of: loading preoperative imaging data; receiving 3D poses of the catheter, needle and US probe from the EMT; receiving intraoperative imaging data; calculating transformation matrices and multiplying said matrices to transform said imaging data and needle pose to a catheter pose; generating a visual representation of the transformed imaging data and needle pose for displaying on a user interface; generating a visual representation of the transformed registered preoperative imaging data for displaying on a user interface.

First claim

The invention claimed is:

1 . A guided percutaneous device for providing visual representations of organ registration and tracking during a guided percutaneous procedure using an electromagnetic tracking (EMT) system comprising an EMT field generator and tracker defining an EMT coordinate system, a catheter with an EMT sensor for placing in the organ to indicate a percutaneous procedure target, a needle with an EMT sensor, an ultrasound (US) probe with an EMT sensor, and an electronic data processor configured for carrying out the preceding calibration steps of:
tracking a reference object using the EMT system, said object comprising a plurality of reference points with known positions in said object; receiving, from the US probe, US imaging data from the reference object and, simultaneously, receiving from the EMT system a set of three-dimensional (3D) poses, each pose comprising a position and orientation, of the US probe when imaging said reference object; identifying said reference points in the received US imaging data; calculating a probe calibration transformation matrix ( P T US ) by matching the identified reference points in the received US imaging data with the tracked reference points in an EMT coordinate system; and wherein the electronic data processor is configured for carrying out the steps of: loading preoperative imaging data represented in respect of predetermined coordinates of preoperative images (CT); receiving 3D poses of the catheter, needle and US probe tracked in real-time from the EMT system; receiving intraoperative imaging data from the US probe represented in respect of predetermined coordinates of intraoperative US images; calculating an EMT-catheter transformation matrix ( C T Tr ) from the received pose of the catheter; calculating a probe-EMT transformation matrix ( Tr T P ) from the received pose of the US probe; calculating a needle-EMT transformation matrix ( Tr T N ) from the received pose of the US probe; multiplying the EMT-catheter transformation matrix ( C T Tr ) by the probe-EMT transformation matrix ( Tr T P ) for obtaining a probe-catheter transformation matrix ( C T P ) which represents the pose of the probe in respect of the catheter pose; multiplying the probe-catheter transformation matrix ( C T P ) by the probe calibration transformation matrix ( P T US ) for obtaining an intraoperative-catheter transformation matrix ( C T US ) which represents said coordinates of intraoperative imaging data in respect of the catheter pose; multiplying the EMT-catheter transformation matrix ( C T Tr ) by the needle-EMT transformation matrix ( Tr T N ) for obtaining a needle-catheter transformation matrix ( C T N ) which represents the pose of the needle in respect of the catheter pose-, registering (T reg ) the loaded preoperative imaging data into the intraoperative US imaging data; transforming the intraoperative US imaging data with the obtained intraoperative-catheter transformation matrix ( C T US ); transforming the registered preoperative imaging data with the obtained intraoperative-catheter transformation matrix ( C T US ); transforming the received pose of the needle with the needle-catheter transformation matrix ( C T N ); generating a visual representation of the transformed intraoperative US imaging data for displaying on an user interface; generating a visual representation of the transformed registered preoperative imaging data for displaying on the user interface; generating a visual representation of the transformed needle pose for displaying on the user interface.

2 . The device according to claim 1 , wherein the electronic data processor is further configured for generating a visual representation of catheter position for displaying on the user interface, in particular a visual representation of catheter pose for displaying on the user interface.

3 . The device according to claim 1 , wherein the electronic data processor is further configured for, when a user indication has been received that the tracked catheter is intended to be repositioned, carrying out the additional steps:
calculating a catheter-EMT transformation matrix ( Tr T C ) from the received pose of the catheter or from inverting the EMT-catheter transformation matrix ( C T Tr ); initiate and maintain the application of a repositioning transformation to the transformed intraoperative US imaging data, transformed registered preoperative imaging data, and transformed needle pose by pre-multiplying the catheter-EMT transformation matrix ( Tr T C ), before generating visual representations.

4 . The device according to claim 1 , wherein the electronic data processor is further configured for, when a user indication has been received that the tracked catheter has been repositioned, carrying out the additional steps:
cease the application of the repositioning transformation.

5 . The device according to claim 1 , claims wherein the electronic data processor is further configured for carrying out the following steps, before the step of registering the loaded preoperative imaging data into the intraoperative US imaging data, for a coarse pre-registering of the loaded preoperative imaging data with the EMT coordinate system:
receiving from a user an input indicating a coarse pose of a patient in respect of the EMT tracker; calculating a CT-EMT transformation matrix ( Tr T CT ) from the received coarse pose; transforming the loaded preoperative imaging data with the CT-EMT transformation matrix ( Tr T CT ); using the transformed preoperative imaging data as the loaded preoperative imaging data of the registering step.

6 . The device according to claim 1 , claims for providing visual representations of organ registration and tracking during a guided percutaneous procedure using an operating table (Ta) with an EMT sensor, wherein the electronic data processor is further configured for carrying out the steps of:
receiving a 3D pose of the operating table (Ta) tracked in real-time from the EMT system; calculating a Ta-EMT transformation matrix ( Tr T Ta ) from the received pose of the operating table; multiplying the EMT-catheter transformation matrix ( C T Tr ) by the Ta-EMT transformation matrix ( Tr T Ta ) for obtaining a Ta-catheter transformation matrix ( C T Ta ) which represents the pose of the operating table in respect of the catheter pose; using Ta-catheter transformation matrix ( C T Ta ) to define an up-vector direction for aligning a 3D camera view of the visual representations.

7 . The device according to claim 1 , claims wherein the 3D poses tracked in real-time via the EMT system are tracked through point EMT sensors.

8 . The device according to claim 1 , wherein the point EMT sensors are placed on a tip of the catheter and on a tip of the needle.

9 . The device according to claim 1 , claims wherein the user interface is a 2D display, a 3D display, a virtual-reality display or an augmented-reality display.

10 . The device according to claim 1 , claims wherein the catheter is for positioning in a working channel in the organ by a flexible ureterorenoscope.

11 . The device according to claim 1 , wherein the preoperative imaging data comprises 3D organ model or models previously reconstructed from preoperative MRI or CT images.

12 . The device according to claim 1 , wherein the intraoperative imaging data comprises 3D organ model or models reconstructed from intraoperative US images.

13 . The device according to claim 1 , wherein the organ is a kidney and the guided percutaneous procedure is a percutaneous renal access.

14 . The device according to claim 1 , w

Assignees

• Univ Do Minho
• Inst Politecnico Do Cavado E Do Ave
• Storz Karl Se & Co Kg

Inventors

• Gomes Da Fonseca João Luís
• Araújo Martins Vilaça João Luís
• Monteiro Queirós Sandro Filipe
• Rodrigues De Lima Estevão Augusto
• Nunes Correia Pinto Jorge Manuel

Classifications

• A61B1/307

  for the urinary organs, e.g. urethroscopes, cystoscopes · CPC title

• A61B2090/3782

  transmitter or receiver in catheter or minimal invasive instrument · CPC title

• A61B90/37

  Surgical systems with images on a monitor during operation · CPC title

• A61B34/25

  User interfaces for surgical systems · CPC title

• A61B2034/2074

  Interface software · CPC title