Systems, methods, and computer-readable media for non-rigid registration of electromagnetic navigation space to CT volume

Patent metadata

Field	Value
Publication number	US-12004849-B2
Application number	US-201816211314-A
Country	US
Kind code	B2
Filing date	Dec 6, 2018
Priority date	Dec 11, 2017
Publication date	Jun 11, 2024
Grant date	Jun 11, 2024

Abstract

Methods, systems, and computer-readable media for registering electromagnetic navigation data of a luminal network to a 3D model of the luminal network includes accessing a 3D model of a luminal network based on computed tomographic (CT) images of the luminal network, the 3D model corresponding to a CT coordinate space, selecting a plurality of reference points within the 3D model of the luminal network, accessing a plurality of survey points within the luminal network, the plurality of survey points being based on electromagnetic navigation data and corresponding to a body coordinate space, correlating the plurality of reference points and the plurality of survey points to determine pairs of correlated reference points and survey points; and deriving a transformation that maps the body coordinate space to the CT coordinate space based on the pairs of correlated reference points and survey points.

First claim

What is claimed is:

1. A system comprising:
a location sensor capable of being navigated within a luminal network inside a patient's body;
an electromagnetic field generator configured to detect a location of the location sensor as it is navigated within the luminal network;
a computing device including a processor and a memory; and
an application, stored in the memory and executed by the processor, which when executed, causes the computing device to:
during a planning phase:
receive a 3D model of the luminal network, the 3D model being generated from computed tomographic (CT) images of the luminal network, the 3D model corresponding to a CT coordinate space;
generate a navigation plan; and
select, at predetermined distance intervals, a plurality of reference points within the 3D model of the luminal network, the reference points being along a center of the luminal network of the 3D model;

during a registration phase:
receive a plurality of survey points within the luminal network, the plurality of survey points corresponding to a body coordinate space and being based on locations of the location sensor while the location sensor is navigated within the luminal network;
correlate the plurality of survey points with the plurality of reference points to determine pairs of correlated reference points and survey points; and
derive a thin plate splines (TPS) transformation that maps the body coordinate space to the CT coordinate space based on the pairs of correlated reference points and survey points by interpolating additional points in the body coordinate space and the CT coordinate space based on an inverse multi-rigid registration, yielding a derived TPS transformation;

during a navigation phase different from the registration phase:
receive a further survey point from the location sensor, which is navigated according to the navigation plan;
determine a location of the location sensor in the CT coordinate space by determining a point in the 3D model corresponding to the further survey point by applying the derived TPS transformation to the further survey point; and
update the derived TPS transformation based on a plurality of second additional correlated points interpolated from the inverse multi-rigid registration performed on the further survey point while navigation is in progress.

2. The system of claim 1 , wherein the luminal network is an airway of a patient.

3. The system of claim 2 , wherein the 3D model is a model of the airway of the patient.

4. The system of claim 1 , wherein the application stored in the memory when executed, further causes the computing device to:
select fiducial points from the plurality of survey points and the plurality of reference points, wherein the fiducial points are at intersections in the luminal network where the luminal network branches apart.

5. The system of claim 4 , wherein in correlating the plurality of survey points with the plurality of reference points, the application stored in the memory when executed, further causes the computing device to:
match the fiducial points selected from the plurality of survey points with the fiducial points selected from the plurality of reference points, yielding matched fiducial points, wherein the pairs of correlated reference points and survey points include the matched fiducial points.

6. The system of claim 1 , wherein correlating the plurality of survey points with the plurality of reference points is based on an inverse registration of the CT coordinate space to the body coordinate space.

7. The system of claim 6 , wherein the inverse registration is at least one of: an inverse of an optimized zone registration or an inverse of a multi-rigid registration.

8. The system of claim 1 , wherein the application stored in the memory, when executed, further causes the computing device to update the derived TPS transformation during the navigation phase by:
receiving a plurality of further survey points;
determining a registration of the body coordinate space to the CT coordinate space based on the plurality of further survey points;
matching the plurality of further survey points with the plurality of reference points based on the registration; and
updating the derived TPS transformation based on the matching.

9. A system comprising:
a computing device including a processor and a memory; and
an application, stored in the memory and executed by the processor, which when executed, causes the computing device to:
during a planning phase:
receive a 3D model of a luminal network inside a patient's body, the 3D model being generated from computed tomographic (CT) images of the luminal network and corresponding to a CT coordinate space;
generate a navigation plan; and
select, at predetermined distance intervals, a plurality of reference points within the 3D model of the luminal network, the reference points being along a center of the luminal network of the 3D model;

during a registration phase:
receive a plurality of survey points within the luminal network, the plurality of survey points corresponding to a body coordinate space and being based on locations of a location sensor while the location sensor is navigated within the luminal network;
correlate the plurality of reference points and the plurality of survey points to determine a plurality of correlated points;
perform an inverse multi-rigid registration of the CT coordinate space to the body coordinate space based on the plurality of correlated points;
interpolate a plurality of additional correlated points based on the inverse multi-rigid registration; and
derive a TPS transformation that maps the body coordinate space to the CT coordinate space from the plurality of correlated points and the plurality of additional correlated points, yielding a derived TPS transformation; and

during a navigation phase different from the registration phase:
receive a further survey point from the location sensor, which is navigated according to the navigation plan;
determine a location of the location sensor in the CT coordinate space by determining a point in the 3D model corresponding to the further survey point by applying the derived TPS transformation to the further survey point; and
update the derived TPS transformation based on a plurality of second additional correlated points interpolated from the inverse multi-rigid registration performed on the further survey point while navigation is in progress.

10. A system comprising:
a computing device including a processor and a memory; and
an application, stored in the memory and executed by the processor, which when executed, causes the computing device to:
during a planning phase:
receive a 3D model of a luminal network inside a patient's body, the 3D model being generated from computed tomographic (CT) images of the luminal network and corresponding to a CT coordinate space;
generate a navigation plan; and
select, at predetermined distance intervals, a plurality of reference points within the 3D model of the luminal network, the reference points being along a center of the luminal network of the 3D model;

during a registration phase:
receive a plurality of survey points within the luminal network, the plurality of survey points being based on electromagnetic navigation data and corresponding to a body coordinate space;
perform an inverse multi-rigid registration of the CT coordinate space to the body coordinate space based on the plurality of reference points and the plurality of survey points; and
derive a thin plate splines (TPS) transformation that maps the body coordinate space to the CT coordinate space from a plurality of additional points interpolated based on the inverse

Assignees

• Covidien Lp

Inventors

• Koyrakh Lev A
• Barak Ron
• Weingarten Oren P
• Nepomniashchy Alexander

Classifications

• A61B2034/2072

  Reference field transducer attached to an instrument or patient · CPC title

• A61B2017/00809

  Lung operations · CPC title

• A61B6/504

  for diagnosis of blood vessels, e.g. by angiography · CPC title

• A61B2034/2051

  Electromagnetic tracking systems · CPC title

• A61B2090/363

  Use of fiducial points · CPC title