Flexible instrument localization from both remote and elongation sensors

Patent metadata

Field	Value
Publication number	US-12016669-B2
Application number	US-202217881759-A
Country	US
Kind code	B2
Filing date	Aug 5, 2022
Priority date	Mar 15, 2013
Publication date	Jun 25, 2024
Grant date	Jun 25, 2024

Abstract

A system and method of tracking a flexible elongate instrument within a patient is disclosed herein. The system is configured to obtain remote localization measurement data of the flexible elongate instrument and obtain elongation measurement data of the flexible elongate instrument. This data is combined and transformed to a coordinate reference frame to produce a localization of the flexible elongate instrument that is more accurate than the remote localization measurements or elongation measurement data alone. The combined localization is then provided to a localization consumer.

First claim

What is claimed is:

1. A system, comprising:
a robot controller, the robot controller including a processor;
a flexible elongate instrument; and
one or more drive components, the one or more drive components being operable to drive movement of at least a portion of the flexible elongate instrument in response to activation by the robot controller;
the processor being configured to:
obtain a first data set from a first data source while the flexible elongate instrument moves, the first data set indicating one or more real-time operational characteristics of one or more drive components while the flexible elongate instrument moves, the one or more drive components driving at least part of the movement of the flexible elongate instrument;
obtain a second data set from a second data source while the flexible elongate instrument moves, at least a portion of the second data source being located external to the instrument, the second data source being operable to generate or process images, the second data set indicating a real-time position of at least a portion of the flexible elongate instrument while the flexible elongate instrument moves; and
localize the real-time position of the flexible elongate instrument in a single coordinate frame, the act of localizing the real-time position of the flexible elongate instrument in the single coordinate frame including combining data from the first data set with data from the second data set.

2. The system of claim 1 , the first data set further comprising a time history of data from the first data source, the second data set further comprising a time history of data from the second data source.

3. The system of claim 1 , the first data set comprising remote localization measurement data of the flexible elongate instrument.

4. The system of claim 1 , the second data set comprising elongation measurement data of the flexible elongate instrument.

5. The system of claim 1 , the processor being configured to localize the real-time position of the flexible elongate instrument in the single coordinate frame by at least determining localization of the real-time position of the flexible elongate instrument in the single coordinate frame in six degrees of freedom.

6. The system of claim 1 , processor being configured to output the localization of the flexible elongate instrument to a localization consumer.

7. The system of claim 1 , the one or more drive components comprising a pull-wire.

8. The system of claim 7 , the one or more drive components being operable to drive movement of at least a portion of the flexible elongate instrument in the form of lateral deflection of the flexible elongate instrument, the pull-wire being operable to drive the lateral deflection of the flexible elongate instrument.

9. The system of claim 1 , the one or more real-time operational characteristics of the one or more drive components including a displacement of the one or more drive components.

10. The system of claim 9 , the displacement of the one or more drive components including longitudinal displacement of the one or more drive components.

11. The system of claim 1 , the one or more real-time operational characteristics of the one or more drive components including a tension in the one or more drive components.

12. The system of claim 1 , the second data source including an electromagnetic tracking system, the flexible elongate instrument including one or more coils configured to cooperate with the electromagnetic tracking system to generate at least some data contained in the second data set.

13. The system of claim 1 , the second data source including a fluoroscopy system, the flexible elongate instrument including one or more markers that are visible under fluoroscopy.

14. The system of claim 1 , the second data source being operable to generate real-time images of the flexible elongate instrument.

15. The system of claim 1 , the second data source being operable to process pre-operative images.

16. The system of claim 15 , the pre-operative images including CT scans.

17. The system of claim 1 , the processor being configured to localize the real-time position of the flexible elongate instrument in the single coordinate frame by at least determining a real-time roll angle of the flexible elongate instrument.

18. The system of claim 1 , the processor being configured to localize the real-time position of the flexible elongate instrument in the single coordinate frame by at least:
generating an estimate of the real-time position of the flexible elongate instrument in the single coordinate frame, and
refining the estimate of the real-time position of the flexible elongate instrument in the single coordinate frame, the act of refining being based on the combination of data from the first data set with data from the second data set.

19. A method of tracking a moving flexible elongate instrument within a patient, the method comprising:
obtaining a first data set from a first data source while the flexible elongate instrument moves, the first data set indicating one or both of movement or tension of an actuator while the flexible elongate instrument moves, the actuator driving at least part of the movement of the flexible elongate instrument;
obtaining a second data set from a second data source while the flexible elongate instrument moves, at least a portion of the second data source being located external to the instrument, the second data source being operable to process images, the second data set being based at least in part on one or more fluoroscopy images captured while the flexible elongate instrument moves; and
localizing the real-time position of the flexible elongate instrument in a single coordinate frame, the act of localizing the real-time position of the flexible elongate instrument in the single coordinate frame including combining data from the first data set with data from the second data set.

20. A system, comprising:
a robot controller, the robot controller including a processor;
a flexible elongate instrument; and
an actuator, the actuator being operable to drive movement of at least a portion of the flexible elongate instrument;
the processor being configured to:
obtain a first data set from a first data source while the flexible elongate instrument moves, the first data set indicating one or both of movement or tension of the actuator while the flexible elongate instrument moves,
obtain a second data set, the second data set being based at least in part on one or more fluoroscopy images captured while the flexible elongate instrument moves, and
localize the real-time position of the flexible elongate instrument in a single coordinate frame by combining data from the first data set with data from the second data set.

Assignees

• Auris Health Inc

Inventors

• Walker Sean
• Camarillo Dave
• Roelle Matt
• Sewell Christopher
• Koolwal Aditya

Classifications

• A61B6/12

  Arrangements for detecting or locating foreign bodies · CPC title

• A61B6/487

  involving fluoroscopy · CPC title

• A61B5/7225

  Details of analogue processing, e.g. isolation amplifier, gain or sensitivity adjustment, filtering, baseline or drift compensation (input circuits for detecting, measuring, or recording bioelectric or biomagnetic signals A61B5/30; specific diagnostic methods using bioelectric or biomagnetic signals A61B5/316) · CPC title

• A61B5/0071

  by measuring fluorescence emission · CPC title

• A61B34/20

  Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis · CPC title