Device and method for controlling a system comprising an imaging modality

Patent metadata

Field	Value
Publication number	US-10973595-B2
Application number	US-201615749795-A
Country	US
Kind code	B2
Filing date	Aug 5, 2016
Priority date	Aug 13, 2015
Publication date	Apr 13, 2021
Grant date	Apr 13, 2021

Abstract

A method is for controlling a system including an imaging modality. The method includes receiving an image and/or a series of images of a portion of a patient from the imaging modality, the field of view of the image and/or of the series of images covering at least a part of an instrument; determining whether the part of the instrument is located within a defined portion of the field of view and/or in a given state selected from a plurality of first states and/or the part of the instrument executes a given movement selected from a plurality of movements; and generating a control command for performing an action depending on whether the part of the instrument is located within the defined portion of the field of view and/or the part of the instrument is in the given state and/or the part of the instrument executes the given movement.

First claim

The invention claimed is:

1. A method for controlling a system including an imaging modality, the method comprising:
receiving an image of a portion of a patient from the imaging modality, a field of view of the image covering a part of an instrument;
determining whether
the part of the instrument is located within a defined portion of the field of view on the image, and
the part of the instrument is in a given state selected from a plurality of first states ; and

generating a control command for performing a defined action, stored in a memory of the system, of at least a component of the imaging modality of the system depending on the determining of whether
the part of the instrument is located within the defined portion of the field of view, and
the part of the instrument is in the given state selected from the plurality of first states, wherein the defined portion of the field of view is selected from a plurality of defined portions of the field of view, and wherein each portion of the plurality of defined portions of the field of view is assigned to one of a plurality of different defined actions including the defined action,
highlighting at least one of the defined portion of the field of view on a display device, and each portion of the plurality of defined portions of the filed of view on a display device,
superimposing a graphical user interface of the at least a component of the imaging modality on the image, the highlighted portion of the field of view representing a control element of the graphical user interface regarding the defined action, the part of the instrument representing a pointer element of the graphical user interface configured to generate the control command for performing the defined action.

2. The method of claim 1 , further comprising:
displaying the image on the display device.

3. The method of claim 1 , further comprising:
displaying a first information in the image, the first information indicating the defined action, of the plurality of different defined actions, to which the highlighted defined portion of the field of view is assigned.

4. The method of claim 3 , further comprising:
displaying a second information in the image, the second information regarding at least one of
a location of the at least a part of the instrument and
a given state selected from the plurality of first states.

5. The method of claim 1 , wherein the part of the instrument includes a plurality of components, wherein
each state of the plurality of first states is assigned to one of a plurality of different positions or
orientations of the plurality of components relative to each other.

6. The method of claim 1 , wherein the instrument includes at least one of a grasper and a scissor, and wherein
the plurality of first states includes an open state of at least one of the grasper and the scissor and a closed state of at least one of the grasper and the scissor.

7. The method of claim 1 , wherein the defined action includes changing a condition related to an acquisition of the image.

8. The method of claim 1 , wherein the defined action includes changing a condition that is selected from a group consisting of the field of view of the image, an angle of view of the image, a zoom of the image, a resolution of the image, a focus of the image, a position of an imaging data acquisition component of the imaging modality relative to at least one of the portion of the patient and the part of the instrument, an orientation of the imaging data acquisition component of the imaging modality relative to at least one of the portion of the patient and the part of the instrument.

9. The method of claim 1 , wherein the at least a component of the imaging modality includes a positioning device for at least one of positioning and orienting an imaging data acquisition component of the imaging modality relative to at least one of
the portion of the patient and
the part of the instrument.

10. The method of claim 9 , wherein the positioning device is at least one of a robot and a robotic laparoscopic holder.

11. The method of claim 1 , wherein
the imaging modality is selected from a group consisting of an optical imaging modality, a laparoscopic imaging modality, an endoscopic imaging modality and an x-ray imaging modality and
an imaging data acquisition component is selected from a group consisting of a camera, a laparoscope, an endoscope and an x-ray detector.

12. The method of claim 1 , further comprising
determining whether a safety switch of the system is in a given state selected from a plurality of second states.

13. The method of claim 1 , further comprising:
highlighting the defined portion of the field of view on the display device.

14. A non-transitory memory of a controller, storing a computer program including program code sections which enable the controller to execute the method of claim 1 .

15. A non-transitory machine-readable medium, on which code sections of a computer program are stored, the program code sections being executable by a processor of a controller to execute the method of claim 1 .

Assignees

• Siemens Healthcare Gmbh

Inventors

• Mewes Philip
• Mountney Peter
• Sahu Manish

Classifications

• A61B34/30 Primary

  Surgical robots · CPC title

• A61B6/463

  characterised by displaying multiple images or images and diagnostic data on one display · CPC title

• A61B1/0005

  combining images e.g. side-by-side, superimposed or tiled · CPC title

• A61B34/25

  User interfaces for surgical systems · CPC title