Methods of user interfaces for electrosurgical tools in robotic surgical systems

Patent metadata

Field	Value
Publication number	US-11166758-B2
Application number	US-201816153721-A
Country	US
Kind code	B2
Filing date	Oct 6, 2018
Priority date	Mar 9, 2009
Publication date	Nov 9, 2021
Grant date	Nov 9, 2021

Abstract

A method for a minimally invasive surgical system is disclosed including capturing camera images of a surgical site; generating a graphical user interface (GUI) including a first colored border portion in a first side and a second colored border in a second side opposite the first side; and overlaying the GUI onto the captured camera images of the surgical site for display on a display device of a surgeon console. The GUI provides information to a user regarding the first electrosurgical tool and the second tool in the surgical site that is concurrently displayed by the captured camera images. The first colored border portion in the GUI indicates that the first electrosurgical tool is controlled by a first master grip of the surgeon console and the second colored border portion indicates the tool type of the second tool controlled by a second master grip of the surgeon console.

First claim

What is claimed is:

1. A minimally invasive surgical method comprising:
swapping control from a first side having a first robotic surgical tool mounted to a first robotic arm controlled by a first master grip of a surgeon console to a second side having a second robotic surgical tool mounted to a second robotic arm controlled by a second master grip of the surgeon console;
swapping a control icon from a first side of a graphical user interface (GUI) to a second side of the GUI; and
displaying an active control border and an active control icon in the second side of the GUI and an inactive control border in the first side of the GUI to provide information to a user, based on the second robotic surgical tool being a supply controllable tool.

2. The method of claim 1 , wherein
a remote controlled supply equipment is not under control of a user input device, and the method further comprises
displaying an inactive control border and an inactive control icon in the second side of the GUI and the inactive control border in the first side of the GUI to provide information to a user.

3. The method of claim 1 , wherein
the second robotic surgical tool is an electrosurgical tool,
an electrosurgical energy generator is under control of a user input device to supply energy to the second robotic surgical tool,
the active control border is an active energy border and the active control icon is an active energy icon and the inactive control border is an inactive energy border;
energy control is swapped from the first side to the second side; and
the control icon is an energy icon.

4. The method of claim 1 , wherein
the second robotic surgical tool is an electrosurgical tool,
an electrosurgical energy generator is not under control of a user input device, and the method further comprises
displaying an inactive energy border and an inactive energy icon in the second side of the GUI and an inactive energy border in the first side of the GUI to provide information to a user.

5. The method of claim 1 , wherein
the second robotic surgical tool is not an electrosurgical tool, and the method further comprises
displaying an inactive energy border and an inactive energy icon in the second side of the GUI to provide information to a user.

6. The method of claim 1 , wherein:
the active control border presents the user with enhanced feedback signaling.

7. The method of claim 6 , further wherein:
the enhanced feedback signaling includes one or more of a vibration in the second master grip, a sound played on a speaker on the second side, and a flashing of the active control border.

8. The method of claim 1 , wherein:
a remote controlled supply equipment is under control of a user input device to supply the second robotic surgical tool.

9. The method of claim 8 , wherein
the user input device is a control pedal.

10. A minimally invasive surgical method comprising:
swapping control from a first side having a first robotic surgical tool mounted to a first robotic arm controlled by a first master grip of a surgeon console to a second side having a second robotic surgical tool mounted to a second robotic arm controlled by a second master grip of the surgeon console;
swapping a control icon from a first side of a graphical user interface (GUI) to a second side of the GUI; and
displaying an inactive control border and an inactive control icon in the second side of the GUI to provide information to a user, based on the second robotic surgical tool not being a supply controllable tool.

11. The method of claim 10 , further comprising:
receiving a tool swap input at a tool swap input device.

12. The method of claim 11 , wherein
the tool swap input device is a tool swap pedal.

13. A method for minimally invasive surgery, the method comprising:
receiving a tool swap input at a tool swap input device;
swapping tool control from a first robotic surgical tool, mounted to a first left side robotic arm controlled by a left master grip of a surgeon console to a second robotic surgical tool mounted to a second left side robotic arm, in response to receiving the tool swap input at the tool swap pedal;
swapping an indicator of the first robotic tool to a tool swap icon and an indicator of the second robotic tool to a left tool type icon, the indicators and icons displayed on a graphical user interface (GUI); and
displaying an active control border and an active control icon on a left side of the GUI to provide information to a user, based on the second robotic surgical tool being a supply controllable tool.

14. The method of claim 13 , further comprising:
displaying an inactive control border and an inactive control icon in the left side of the GUI, based on the second robotic surgical tool not being a supply controllable tool.

15. The method of claim 13 , wherein
a remote controlled supply equipment is not under control of a user input device, and the method further comprises
displaying an inactive control border and an inactive control icon on the left side of the GUI.

16. The method of claim 15 , wherein
the tool swap input device is a tool swap pedal and
the user input device is a control pedal.

17. The method of claim 13 , wherein
the tool swap input device is a tool swap pedal.

18. The method of claim 13 , wherein
the second robotic surgical tool is an electrosurgical tool,
the remote controlled supply equipment is an electrosurgical energy generator under control of the user input device to supply energy to the second robotic tool,
the active control border is an active energy border and the active control icon is an active energy icon and the inactive control border is an inactive energy border;
energy control is swapped from the first robotic tool to the second robotic tool; and
the control icon is an energy icon.

19. The method of claim 18 , further comprising:
if an electrosurgical energy generator is not under control of the user input device, then displaying an inactive energy border and an inactive energy icon in the left side of the GUI to provide information to a user.

20. The method of claim 13 , further comprising:
if the second robotic tool is not an electrosurgical tool, then displaying an inactive energy border and an inactive energy icon in the left side of the GUI to provide information to a user.

21. The method of claim 13 , wherein:
the active control border presents the user with enhanced feedback signaling.

22. The method of claim 21 , further wherein:
the enhanced feedback signaling includes one or more of a vibration in the left master grip, a sound played on a speaker on the left side, and a flashing of the active control border.

23. A method for minimally invasive surgery, the method comprising:
receiving a tool swap input at a tool swap input device;
swapping tool control from a first robotic surgical tool, mounted to a first right side robotic arm controlled by a right master grip of a surgeon console to a second robotic surgical tool mounted to a second right side robotic arm, in response to receiving the tool swap input at the tool swap pedal;
swapping an indicator of the first robotic tool to a tool swap icon and an indicator of the second robotic tool to a right tool type icon, the indicators and icons displayed on a graphical user interface (GUI); and
displaying an active control border and an active control icon on a right side of the GUI to provide information to a user, based on the

Assignees

• Intuitive Surgical Operations

Inventors

• Mohr Paul W
• Robinson David W
• Nixon Thomas R
• Hanuschik Michael
• Goldberg Randal P
• Brogna Salvatore J

Classifications

• A61B1/000096

  using artificial intelligence · CPC title

• A61B34/30 Primary

  Surgical robots · CPC title

• A61B18/12 Primary

  by passing a current through the tissue to be heated, e.g. high-frequency current · CPC title

• A61B18/1482

  having a long rigid shaft for accessing the inner body transcutaneously in minimal invasive surgery, e.g. laparoscopy · CPC title

• A61B34/37

  Leader-follower robots (A61B34/35 takes precedence) · CPC title