Systems and methods for localizing, tracking and/or controlling medical instruments

Patent metadata

Field	Value
Publication number	US-9629595-B2
Application number	US-201313832586-A
Country	US
Kind code	B2
Filing date	Mar 15, 2013
Priority date	Mar 15, 2013
Publication date	Apr 25, 2017
Grant date	Apr 25, 2017

Abstract

Systems and methods are described herein for tracking, localization or controlling an elongate instrument or other medical instrument in an image or patient.

First claim

We claim:

1. A method of tracking a robotically-controlled flexible elongate instrument in real time in an image, the method comprising:
initializing an active contour in the image, wherein the active contour corresponds to at least a portion of the flexible elongate instrument;
predicting a next location or shape of the flexible elongate instrument as the flexible elongate instrument is moved, wherein the next location and shape are predicted based on a robotic motion command received at a robotic controller; and
updating the active contour to track the flexible elongate instrument as the flexible elongate instrument moves, by performing a search based on pixel intensity, wherein a pixel intensity search area is focused based on the predicted next location or shape.

2. The method of claim 1 , further comprising performing an image-based search along the active contour to track one or more features of the flexible elongate instrument.

3. The method of claim 2 , wherein the image-based search along the active contour is performed with a template matching search.

4. The method of claim 1 , wherein an image-based search or a template matching search is performed to track at least one of a feature, a marker or a point of interest of the flexible elongate instrument, in order to enhance or confirm accuracy of the active contour.

5. The method of claim 1 , wherein the active contour restricts the area in which an image-based search or a template matching search must occur and provides a seed for the orientation of a template.

6. The method of claim 1 , wherein once an active contour is tracking the flexible elongate instrument, an image-based search or a template matching search is performed to track at least one of a feature, a marker or a point of interest of the flexible elongate instrument to ascertain a location of the feature, marker or point of interest on the active contour.

7. The method of claim 6 , wherein the feature or the point of interest is selected from the group consisting of an articulation section, a control ring, a marker, or a sheath of the flexible elongate instrument.

8. The method of claim 1 , wherein at least one of the tracking, an image-based search or a template matching search facilitates instinctive driving of the flexible elongate instrument.

9. The method of claim 1 , further comprising performing an image-based search or a template matching search to track a heading direction of an articulation section of the flexible elongate instrument to facilitate instinctive driving of the flexible elongate instrument.

10. The method of claim 1 , wherein the image is a fluoroscopy image.

11. The method of claim 1 , further comprising maintaining spacing between at least two points in a sequence of points along the active contour to prevent the active contour from mistracking in areas where the flexible elongate instrument curves rapidly.

12. The method of claim 1 , further comprising filtering out high frequency texture and noise in the image with a low-pass spatial filter.

13. The method of claim 1 , further comprising filtering out low frequency features comprising at least one of anatomy, imaging artifacts, or elements in the environment with a high-pass spatial filter.

14. The method of claim 1 , further comprising performing a correlation matching search along the active contour to track features of the flexible elongate instrument and to enhance or confirm accuracy of the active contour.

15. The method of claim 1 , wherein an image-based search or a template matching search is a low computation search using pixel sub-sampling.

16. The method of claim 1 , wherein the active contour is updated by using an iterative approach.

17. The method of claim 1 , wherein the active contour can grow and shrink as a projection of the flexible elongate instrument on the image grows and shrinks.

18. The method of claim 1 , wherein each point along the active contour produces a fitness value that can guide whether or not a point is on the flexible elongate instrument in the image.

19. The method of claim 1 , wherein points are added or removed at a desired distance from an end point of the active contour in the direction that the active contour is traveling, to grow or shrink the active contour to track movement of the flexible elongate instrument.

20. The method of claim 1 , wherein initializing the active contour comprises selecting two or more points along a shape or a path of the flexible elongate instrument in the image, using a pointing mechanism or a selection mechanism.

21. The method of claim 1 , wherein initializing the active contour comprises identifying points on at least one of a leader, a control ring marker or a sheath marker of the flexible elongate instrument, wherein the points initialize the active contour and provide a starting location for tracking the leader, the control ring marker or the sheath marker.

22. The method of claim 1 , further comprising performing a template matching search, wherein templates used in the template matching search vary based on a type and a size of a feature on the flexible elongate instrument.

23. The method of claim 22 , wherein a particle filter is used to guide the template matching search.

24. The method of claim 1 , further comprising maintaining a second contour for tracking other elongate objects and artificially removing the objects from the image.

25. The method of claim 1 , wherein one or more computer vision algorithms track elements in the image such as surgical tools, other elongate instruments, or anatomical features, in order to aid the active contour in overcoming the elements overlapping and obscuring the flexible elongate instrument being tracked.

26. The method of claim 1 , further comprising:
providing a tracking view overlaid on a fluoroscopy image; and
augmenting a user's view of the fluoroscopy image.

27. The method of claim 1 , wherein the image comprises multiple fluoroscopy views from different angles acquired using one or more fluoroscopy systems.

Assignees

• Hansen Medical Inc

Inventors

• Walker Sean
• Sewell Christopher
• Park June
• Ravindran Prabu
• Koolwal Aditya
• Camarillo Dave
• Barbagli Federico

Classifications

• A61B34/20 Primary

  Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis · CPC title

• A61B2090/376

  using X-rays, e.g. fluoroscopy · CPC title

• A61B2034/2051

  Electromagnetic tracking systems · CPC title

• A61B5/725

  using specific filters therefor, e.g. Kalman or adaptive filters (specific diagnostics methods using using bioelectric or biomagnetic signals A61B5/316) · CPC title

• A61B6/12

  Arrangements for detecting or locating foreign bodies · CPC title