Graphical user interface for planning a procedure

Patent metadata

Field	Value
Publication number	US-12527635-B2
Application number	US-202318150105-A
Country	US
Kind code	B2
Filing date	Jan 4, 2023
Priority date	Apr 18, 2017
Publication date	Jan 20, 2026
Grant date	Jan 20, 2026

Abstract

A planning workstation includes a display system and a user input device and is configured to display a plurality of interactive windows for a user to view a plan for a medical procedure. Each of the plurality of interactive windows displays a different rendering of a model of anatomical passageways. The planning workstation is further configured to display a path through the anatomical passageways to a target of the medical procedure, display a virtual image of an instrument within the anatomical passageways, display a control point corresponding to a distal end of the instrument, receive a user input via the user input device, identify a position of the control point based at least on the user input, and, in response to receiving the user input, dynamically update a position of the instrument in at least one of the interactive windows to match the position of the control point.

First claim

What is claimed is:

1 . A planning workstation comprising:
a display system; and a user input device; wherein the planning workstation is configured to, during pre-operative planning of a procedure:
display a plurality of interactive windows for a user to view a plan for a medical procedure, wherein each of the plurality of interactive windows displays a different rendering of a model of anatomical passageways;
display a path through the anatomical passageways to a target of the medical procedure in a global anatomical model view displaying a rendering of the model of the anatomical passageways from an external perspective;
display a virtual image corresponding to a position of an instrument within the anatomical passageways;
display a control point corresponding to a distal end of the instrument in at least one of the plurality of interactive windows;
receive, via the user input device, a user input adjusting a position of the control point;
and
in response to receiving the user input, dynamically update the position of the instrument in at least one of the plurality of interactive windows to match the adjusted position of the control point.

2 . The planning workstation of claim 1 , wherein the user input device includes a touchscreen of the display system.

3 . The planning workstation of claim 1 , wherein the control point is displayed in a first interactive window of the plurality of interactive windows, the first interactive window including a reduced anatomical model view, the user input being received in relation to the reduced anatomical model view.

4 . The planning workstation of claim 3 , wherein the reduced anatomical model view comprises a simplified overview of a planned route of the instrument through the anatomical passageways including key anatomical features.

5 . The planning workstation of claim 3 , wherein the position of the instrument is dynamically updated in a second interactive window of the plurality of interactive windows, the second interactive window including a simulated live endoscopic view.

6 . The planning workstation of claim 3 , wherein the position of the instrument is dynamically updated in a second interactive window of the plurality of interactive windows, the second interactive window including a virtual endoscopic view.

7 . The planning workstation of claim 6 , wherein the virtual endoscopic view comprises at least one directional cue guiding the user toward the target.

8 . The planning workstation of claim 3 , wherein the position of the instrument is dynamically updated in a second interactive window of the plurality of interactive windows, the second interactive window including the global anatomical model view.

9 . The planning workstation of claim 8 , wherein dynamically updating the position of the instrument in the second interactive window includes updating a shape of the instrument displayed in the second interactive window.

10 . A method of planning a medical procedure, the method performed during pre-operative planning of a procedure and comprising:
displaying a plurality of interactive windows on a display system for a user to view a plan for a medical procedure, wherein each of the plurality of interactive windows displays a different rendering of a model of anatomical passageways; displaying a path through the anatomical passageways to a target of the medical procedure in a global anatomical model view displaying a rendering of the model of the anatomical passageways from an external perspective; displaying a virtual image corresponding to a position of an instrument within the anatomical passageways; displaying a control point corresponding to a distal end of the instrument in at least one of the plurality of interactive windows; receiving, via a user input device, a user input adjusting a position of the control point; and in response to receiving the user input, dynamically updating the position of the instrument in at least one of the plurality of interactive windows to match the adjusted position of the control point.

11 . The method of claim 10 , wherein the user input device includes a touchscreen of the display system.

12 . The method of claim 10 , wherein the control point is displayed in a first interactive window of the plurality of interactive windows, the first interactive window including a reduced anatomical model view, the user input being received in relation to the reduced anatomical model view.

13 . The method of claim 12 , wherein the reduced anatomical model view comprises a simplified overview of a planned route of the instrument through the anatomical passageways including key anatomical features.

14 . The method of claim 12 , wherein the position of the instrument is dynamically updated in a second interactive window of the plurality of interactive windows, the second interactive window including a simulated live endoscopic view.

15 . The method of claim 12 , wherein the position of the instrument is dynamically updated in a second interactive window of the plurality of interactive windows, the second interactive window including a virtual endoscopic view.

16 . The method of claim 15 , wherein the virtual endoscopic view comprises at least one directional cue guiding the user toward the target.

17 . The method of claim 12 , wherein the position of the instrument is dynamically updated in a second interactive window of the plurality of interactive windows, the second interactive window including the global anatomical model view.

18 . The method of claim 17 , wherein dynamically updating the position of the instrument in the second interactive window includes updating a shape of the instrument displayed in the second interactive window.

19 . A non-transitory machine readable medium comprising a plurality of machine readable instructions which when executed by one or more processors associated with a planning workstation are adapted to cause the one or more processors to perform a method of pre-operative planning of a procedure comprising:
providing a plurality of interactive windows for a user to view a plan for a medical procedure, wherein each of the plurality of interactive windows displays a different rendering of a model of anatomical passageways; displaying a path through the anatomical passageways to a target of the medical procedure in a global anatomical model view displaying a rendering of the model of the anatomical passageways from an external perspective; displaying a virtual image corresponding to a position of an instrument within the anatomical passageways; displaying a control point corresponding to a distal end of the instrument in at least one of the plurality of interactive windows; receiving a user input adjusting a position of the control point; and in response to receiving the user input, dynamically updating the position of the instrument in at least one of the plurality of interactive windows to match the adjusted position of the control point.

20 . The non-transitory machine readable medium of claim 19 , wherein the control point is displayed in a first interactive window of the plurality of interactive windows, the first interactive window including a reduced anatomical model view, the user input being received in relation to the reduced anatomical model view.

Assignees

• Intuitive Surgical Operations

Inventors

• Wang Bai
• Barbagli Federico
• Cruse Ii Energy
• Ichikawa Scott S
• Lo Pechin Chien Pau
• Salazar Oscar G
• Tinling Aaron B
• Wagner Oliver J
• Zhao Tao

Classifications

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• A61B2034/107

  Visualisation of planned trajectories or target regions · CPC title

• A61B2034/105

  Modelling of the patient, e.g. for ligaments or bones · CPC title