Camera aided simulator for minimally invasive surgical training

Patent metadata

Field	Value
Publication number	US-12154455-B2
Application number	US-202217746100-A
Country	US
Kind code	B2
Filing date	May 17, 2022
Priority date	Jun 6, 2013
Publication date	Nov 26, 2024
Grant date	Nov 26, 2024

Abstract

The present disclosure is directed to a system and method for surgical training with low cost, reusable materials and a highly customizable virtual environment for skill-building. According to various embodiments, a surgical training tool is usable in conjunction with a support structure configured to at least partially constrain the tool movement. Meanwhile, the tool is tracked in real-time with off-tool detectors to generate a tool path driving a virtual rendering of the surgical training tool in an operative environment. The virtual rendering may be visually observable via a display device and may include a customizable and/or selectable operative environment with one or more structures that can be operated on by the virtual surgical training tool. By tracking the virtual tool interaction with the virtual structures, a task path may be established for documenting and/or objectively assessing the performance of one or more operative tasks.

First claim

What is claimed is:

1. A system for surgical training, comprising:
a surgical training tool, the surgical training tool including one or more fiducials;
at least two detectors configured to detect the position of the one or more fiducials;
at least one processor in communication with the at least two detectors;
a tool path generated by the at least one processor based on the detected position of the one or more fiducials; and
at least one task path generated and graphically presented by the at least one processor based on the tool path, the at least one task path describing a path of the surgical training tool in a virtual operative environment, the at least one task path including a plot of position coordinates of the surgical training tool relative to position coordinates of one or more structures being operated on by the surgical training tool in the virtual operative environment over time, the at least one task path further including time-indexed events based on the tool path, wherein the time-indexed events include performed operative tasks and detected errors indicated with markings at respective x, y, and z coordinates relative to time on the at least one task path in addition to a graphically represented plot of the position coordinates of the surgical training tool relative to the position coordinates of one or more structures being operated on by the surgical training tool in the virtual operative environment over time, and wherein the markings that indicate the time-indexed events are distinguishable from the plot of the position coordinates.

2. The system of claim 1 , further comprising:
a virtual rendering of the surgical training tool in the virtual operative environment, the virtual rendering of the surgical training tool being visually observable via a display device, an operative task being performed within the virtual operative environment utilizing the surgical training tool presented by the display device, the surgical training tool being manipulated based on the tool path.

3. The system of claim 1 , wherein the time-indexed events include at least a first event and a second event, and wherein a first time interval for the first event requires a first set of spatial boundaries for the at least one task path and a second time interval for the second event requires a second set of spatial boundaries for the at least one task path that is different from the first set of spatial boundaries.

4. The system of claim 3 , wherein a first error threshold is established for the first time interval and a second error threshold is established for the second time interval.

5. The system of claim 1 , wherein the detected errors include one or more of: a dropped object, a misaligned cut, or a deviation beyond a spatial threshold.

6. The system of claim 1 , wherein the at least one processor is further configured to:
assess the performance of an operative task based upon the at least one task path by evaluating time-indexed events within a time interval for the operative task to determine performance or non-performance of events required by the operative task and based on an error threshold for the operative task.

7. The system of claim 1 , further comprising:
a storage medium configured to store the at least one task path or a recording of the surgical training tool being manipulated within the virtual operative environment; and
a communication link configured to transfer the at least one task path or a recording of the surgical training tool being manipulated within the virtual operative environment to a remote server for assessing the performance of an operative task based upon the at least one task path or the recording of the surgical training tool being manipulated within the virtual operative environment.

8. The system of claim 1 , wherein the at least two detectors include two or more cameras configured for stereoscopic imaging, and wherein the one or more fiducials include one or more traceable markers or recognizable features included in or coupled to the surgical training tool.

9. The system of claim 1 , wherein the markings intersect the plot of the position coordinates.

10. The system of claim 1 , wherein the markings comprise vertical lines disposed at respective x, y, and z coordinates relative to time on the at least one task path.

11. A system for surgical training, comprising:
at least two detectors configured to detect the position of a surgical training tool;
at least one processor in communication with the at least two detectors;
a tool path generated by the at least one processor based on the detected position of the surgical training tool; and
at least one task path generated and graphically presented by the at least one processor based on the tool path, the at least one task path describing a path of the surgical training tool in a virtual operative environment, the at least one task path including a plot of position coordinates of the surgical training tool relative to position coordinates of one or more structures being operated on by the surgical training tool in the virtual operative environment over time, the at least one task path further including time-indexed events based on the tool path, wherein the time-indexed events include performed operative tasks and detected errors indicated with markings at respective x, y, and z coordinates relative to time on the at least one task path in addition to a graphically represented plot of the position coordinates of the surgical training tool relative to the position coordinates of one or more structures being operated on by the surgical training tool in the virtual operative environment over time, and wherein the markings that indicate the time-indexed events are distinguishable from the plot of the position coordinates.

12. The system of claim 11 , further comprising:
a virtual rendering of the surgical training tool in the virtual operative environment, the virtual rendering of the surgical training tool being visually observable via a display device, an operative task being performed within the virtual operative environment utilizing the surgical training tool presented by the display device, the surgical training tool being manipulated based on the tool path.

13. The system of claim 11 , wherein the time-indexed events include at least a first event and a second event, and wherein a first time interval for the first event requires a first set of spatial boundaries for the at least one task path and a second time interval for the second event requires a second set of spatial boundaries for the at least one task path that is different from the first set of spatial boundaries.

14. The system of claim 13 , wherein a first error threshold is established for the first time interval and a second error threshold is established for the second time interval.

15. The system of claim 11 , wherein the detected errors include one or more of: a dropped object, a misaligned cut, or a deviation beyond a spatial threshold.

16. The system of claim 11 , wherein the at least one processor is further configured to:
assess the performance of an operative task based upon the at least one task path by evaluating time-indexed events within a time interval for the operative task to determine performance or non-performance of events required by the operative task and based on an error threshold for the operative task.

17. The system of claim 11 , further comprising:
a storage medium configured to store the at least one task path or a recording of the surgical training tool being manipulated within the virtual operati

Assignees

• Univ Nebraska

Inventors

• Siu Ka-Chun
• Nelson Carl
• Zahiri Mohsen
• Oleynikov Dmitry

Classifications

• G09B9/00

  Simulators for teaching or training purposes (for the use of weapons F41; computing aspects G06; {protocols for games, networked simulations or virtual reality H04L67/131}) · CPC title

• G09B19/24

  Use of tools · CPC title

• G09B23/283

  for dentistry or oral hygiene (G09B23/286 takes precedence) · CPC title

• G09B23/281

  for pregnancy, birth or obstetrics (G09B23/286 takes precedence) · CPC title

• G09B23/28

  for medicine · CPC title