Real-time automatic registration feedback

Patent metadata

Field	Value
Publication number	US-11583205-B2
Application number	US-202016995966-A
Country	US
Kind code	B2
Filing date	Aug 18, 2020
Priority date	Jul 2, 2014
Publication date	Feb 21, 2023
Grant date	Feb 21, 2023

Abstract

A method of registering a luminal network to a 3D model of the luminal network with real-time feedback is disclosed, including generating the 3D model of the luminal network based on images of the luminal network, generating an electromagnetic field about the luminal network, inserting a location sensor into the electromagnetic field, tracking the location of the sensor within the luminal network, comparing the tracked locations of the sensor with sensors located outside of the luminal network and the portions of the 3D model representative of open space, and presenting on a user interface an indication of which portions of the luminal network have been sufficiently traversed by the sensor to register that portion of the luminal network to the 3D model.

First claim

What is claimed is:

1. A method of confirming accuracy of registration of a luminal network to a 3D model of the luminal network, the method comprising:
generating the 3D model of a luminal network based on a plurality of 2D slice images of the luminal network;
inserting a location sensor into the luminal network;
generating an energy field for sensing a location of the location sensor;
obtaining data points corresponding to tracked locations of the location sensor by tracking the location sensor within the luminal network;
comparing the data points with the 3D model;
registering at least one of a plurality of discrete regions of the 3D model with the luminal network based on the comparing;
presenting, on a user interface an indication of whether the at least one of the plurality of discrete regions of the 3D model is registered with the luminal network;
presenting, on the user interface:
an airway of the luminal network in a 2D slice image of the plurality of 2D slice images; and a location sensor indicator corresponding to the tracked locations of the location sensor within the luminal network on the presented 2D slice image relative to the airway of the luminal network in the 2D slice image;
processing an input declining registration of the luminal network to the 3D model when the location sensor indicator is presented outside the airway of the luminal network in the 2D slice image; and
confirming registration of the luminal network to the 3D model when the location sensor indicator is presented inside the airway of the luminal network in the 2D slice image.

2. The method of claim 1 , wherein the user interface displays a 3D model of the airway.

3. The method of claim 1 , further comprising presenting, on the user interface, live bronchoscopic images separate from the presented 2D slice image.

4. The method of claim 3 , wherein the live bronchoscopic images depict the location sensor as it traverses the luminal network.

5. The method of claim 1 , wherein the user interface enables a user to end registration.

6. The method of claim 1 , further comprising moving the location sensor, wherein movement of the location sensor results in presentation of a new 2D slice image of the plurality of 2D slice images at a location to which the location sensor has moved, wherein the new 2D slice image is different from the presented 2D slice image.

7. The method of claim 6 , wherein registration is confirmed when, upon movement of the location sensor, the location sensor remains within an identified boundary of the luminal network presented on the new 2D slice image.

8. The method of claim 1 , further comprising presenting, on the user interface, a rendering of the 3D model and location sensor indicators corresponding to the tracked locations of the location sensor as it traverses the luminal network on the presented rendering of the 3D model.

9. The method of claim 8 , wherein the user interface enables a user to return to registration if it is determined that sensed locations of the location sensor are outside of the rendering of the 3D model.

10. The method of claim 1 , wherein the luminal network includes a plurality of regions, and wherein obtaining data points includes obtaining data points to a second bifurcation of each region of the luminal network.

11. The method of claim 1 , wherein the indication is a check mark for the discrete region.

12. A method of confirming accuracy of registration of a luminal network to a 3D model of the luminal network, the method comprising:
generating the 3D model of a luminal network based on a plurality of 2D slice images of the luminal network;
generating an energy field for sensing a location of a location sensor;
obtaining data points corresponding to tracked locations of the location sensor by tracking the location sensor within the luminal network;
comparing the data points with the 3D model;
registering at least one of a plurality of discrete regions of the 3D model with the luminal network based on the comparing;
presenting, on a user interface:
an airway of the luminal network in a 2D slice image of the plurality of 2D slice images; and
a location sensor indicator corresponding to the tracked locations of the location sensor within the luminal network on the presented 2D slice image relative to the airway of the luminal network in the 2D slice image;
processing an input declining the registration of the luminal network to the 3D model when the location sensor indicator is presented outside the airway of the luminal network in the 2D slice image; and
confirming registration of the luminal network to the 3D model when the location sensor indicator is presented inside the airway of the luminal network in the 2D slice image, wherein the presented 2D slice image is fixed in position and movement of the location sensor results in movement of the location sensor indicator.

13. The method of claim 12 , wherein the location sensor indicator is fixed in position and movement of the location sensor results in presentation of a new 2D slice image of the plurality of 2D slices images at a location to which the location sensor has moved.

14. A method of confirming accuracy of registration of a luminal network to a 3D model of the luminal network, the method comprising:
generating the 3D model of a luminal network based on a plurality of 2D slice images of the luminal network;
generating an energy field for sensing a location of a location sensor;
obtaining data points corresponding to tracked locations of the location sensor by tracking the location sensor within the luminal network;
comparing the data points with the 3D model;
registering at least one of a plurality of discrete regions of the 3D model with the luminal network based on the comparing;
presenting, on the user interface:
an airway of the luminal network in a 2D slice image of the plurality of 2D slice images; and
an EM a location sensor indicator corresponding to the tracked locations of the location sensor within the luminal network on the presented 2D slice image relative to the airway of the luminal network in the 2D slice image;
processing an input declining registration of the luminal network to the 3D model when the location sensor indicator is presented outside the airway of the luminal network in the 2D slice image; and
confirming registration of the luminal network to the 3D model when the location sensor indicator is presented inside the airway of the luminal network in the 2D slice image, wherein the location sensor indicator is fixed in position and movement of the location sensor results in presentation of a new 2D slice image of the plurality of 2D slice images at a location to which the location sensor has moved.

15. The method of claim 14 , wherein the presented 2D slice image is fixed in position and movement of the location sensor results in movement of the location sensor indicator.

Assignees

• Covidien Lp

Inventors

• Brown Andrew E
• Nepomniashchy Alexander Y
• Lachmanovich Elad D
• Klein Eyal
• Weingarten Oren P

Classifications

• A61B5/066 Primary

  Superposing sensor position on an image of the patient, e.g. obtained by ultrasound or x-ray imaging · CPC title

• A61B1/04

  combined with photographic or television appliances · CPC title

• A61B2034/2051

  Electromagnetic tracking systems · CPC title

• A61B2034/105

  Modelling of the patient, e.g. for ligaments or bones · CPC title

• A61B5/7425

  Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image · CPC title