Systems and methods for tracking the orientation of surgical tools

Patent metadata

Field	Value
Publication number	US-10973585-B2
Application number	US-201615271833-A
Country	US
Kind code	B2
Filing date	Sep 21, 2016
Priority date	Sep 21, 2016
Publication date	Apr 13, 2021
Grant date	Apr 13, 2021

Abstract

Some embodiments of the present technology involve methods, devices, and systems for determining an orientation of a surgical tool during ophthalmic surgery. An example method includes performing an optical imaging scan in the surgical site, using a scan pattern that intersects the surgical tool and generating a scan image from the optical imaging scan. The example method further comprises analyzing the scan image to determine a location in the scan image corresponding to where the surgical tool intersected the optical imaging scan, and determining an orientation of the surgical tool, based on the determined location.

First claim

The invention claimed is:

1. A method of providing a tool angle feedback to an optical image scanning system to avoid shadowing from a surgical tool during ophthalmic surgery, the method comprising:
performing an optical imaging scan in a surgical site, using a scanning beam in a scan pattern that intersects the surgical tool;
generating a scan image from the optical imaging scan;
analyzing the scan image to detect a boundary of a marker on the surgical tool and to analyze a shape of the marker on the surgical tool to determine a location in the scan image corresponding to where the surgical tool intersected the optical imaging scan;
determining an orientation of the surgical tool based on the determined location;
providing information describing the orientation of the surgical tool to the optical image scanning system;
determining, by the optical image scanning system, a new angle of a subsequent scanning beam for a subsequent optical scan based on the orientation of the surgical tool, wherein the new angle of the subsequent scanning beam reduces a shadowing affect caused by the surgical tool; and
adjusting an angle of the subsequent optical imaging scan to the new angle.

2. The method of claim 1 , wherein the optical imaging scan is an optical coherence tomography (OCT) scan.

3. The method of claim 1 , wherein the optical imaging scan is a confocal laser scan.

4. The method of claim 1 , wherein the scan pattern comprises a closed pattern that surrounds an estimated position of a distal tip of the surgical tool.

5. The method of claim 4 , wherein the scan pattern consists of a series of discrete scans having separations smaller than a lateral dimension of a shaft of the surgical tool.

6. The method of claim 4 , wherein the scan pattern has a center positioned at the estimated position of the distal tip of the surgical tool, and wherein the determining the orientation of the surgical tool comprises determining a tool orientation angle directly from the location in the scan image corresponding to where the surgical tool intersected the optical imaging scan.

7. The method of claim 4 , wherein determining the orientation of the surgical tool comprises determining a first two-dimensional coordinate for the location in the scan image corresponding to where the surgical tool intersected the optical imaging scan, and calculating a tool orientation angle based on the first two-dimensional coordinate and based on a second two-dimensional coordinate, the second two-dimensional coordinate corresponding to the estimated position of the distal tip of the surgical tool.

8. The method of claim 4 , wherein the scan pattern comprises first and second closed patterns that each surround the estimated position of the distal tip of the surgical tool, wherein the method further comprises analyzing the scan image to determine first and second locations in the scan image corresponding to where the surgical tool intersected the first and second closed patterns of the optical imaging scan, respectively, and wherein determining the orientation of the surgical tool comprises determining an orientation angle of the surgical tool based on the determined first and second locations.

9. The method of claim 4 , wherein the optical imaging scan is an interferometric or confocal scan that provides a depth information along a path traced by the optical imaging scan, such that the generated scan image comprises a representation of the depth information, and wherein determining the orientation of the surgical tool comprises estimating a height of a top surface of the surgical tool based on the generated scan image and determining a three-dimensional orientation of the surgical tool based on the estimated height and based on the location in the scan image corresponding to where the surgical tool intersected the optical imaging scan.

10. The method of claim 1 , further comprising repeating said performing, analyzing, and determining to track a changing orientation of the surgical tool over a period of time.

11. The method of claim 1 , further comprising adjusting a display of an imaged surgical site based on the determined orientation of the surgical tool.

12. A system to provide a tool angle feedback to avoid shadowing from a surgical tool during ophthalmic surgery, the system comprising:
an optical imaging apparatus configured to emit imaging beams in a series of optical imaging scans in a surgical site, the optical imaging apparatus comprising:
a light source configured to introduce an imaging light into the surgical site; and
an imaging device configured to receive imaging light reflected from the surgical site and to generate a scan image from each of the series of optical imaging scans; and

a controller operatively coupled to the optical imaging apparatus and configured to:
control the optical imaging apparatus to perform the series of optical imaging scans using the imaging beams in a scan pattern configured to intersect the surgical tool and to generate the scan image from each of the series of optical imaging scans;
analyze the scan image to detect a boundary of a marker on the surgical tool and to analyze a shape of the marker on the surgical tool to determine a location in the scan image corresponding to where the surgical tool intersected the series of optical imaging scans;
determine an orientation of the surgical tool based on the determined location;
provide information describing the orientation of the surgical tool to the optical image scanning apparatus;
determine a new angle of a subsequent scanning beam for a subsequent optical scan based on the orientation of the surgical tool, wherein the new angle of the subsequent scanning beam reduces a shadowing affect caused by the surgical tool; and
adjust an angle of the subsequent scanning beam of the subsequent optical imaging scan to the new angle.

13. The system of claim 12 , wherein the series of optical imaging scans is an optical coherence tomography (OCT) scan.

14. The system of claim 12 , wherein the series of optical imaging scans is a confocal laser scan.

15. The system of claim 12 , wherein the scan pattern comprises a closed pattern that surrounds an estimated position of a distal tip of the surgical tool.

16. The system of claim 15 , wherein the scan pattern consists of a series of discrete scans having separations smaller than a lateral dimension of a shaft of the surgical tool.

17. The system of claim 15 , wherein the scan pattern has a center positioned at the estimated position of the distal tip of the surgical tool, and wherein the controller is configured to determine the orientation of the surgical tool by determining a tool orientation angle directly from the location in the scan image corresponding to where the surgical tool intersected the series of optical imaging scans.

18. The system of claim 15 , wherein the controller is configured to determine the orientation of the surgical tool by determining a first two-dimensional coordinate for the location in the scan image corresponding to where the surgical tool intersected the series of optical imaging scans, and calculating a tool orientation angle based on the first two-dimensional coordinate and based on a second two-dimensional coordinate, the second two-dimensional coordinate corresponding to the estimated position of the distal tip of the surgical tool.

19. The system of claim 15 , wherein the scan pattern comprises first and second closed patterns that each surround the estimated position of the distal tip of the surgical tool,

Assignees

• Novartis Ag
• Alcon Inc

Inventors

• Ren Hugang
• Yu Lingfeng

Classifications

• A61F2009/00876

  Iris · CPC title

• A61B2090/3979

  infrared · CPC title

• A61B90/361

  Image-producing devices, e.g. surgical cameras · CPC title

• A61F9/00736

  Instruments for removal of intra-ocular material or intra-ocular injection, e.g. cataract instruments (A61F9/008 takes precedence) · CPC title

• A61B2034/2065

  Tracking using image or pattern recognition · CPC title