Method for controlling a microscope, and microscope

Patent metadata

Field	Value
Publication number	US-2022157306-A1
Application number	US-202117529036-A
Country	US
Kind code	A1
Filing date	Nov 17, 2021
Priority date	Nov 19, 2020
Publication date	May 19, 2022
Grant date	—

Abstract

The invention relates to a method for controlling a microscope, wherein a voice information item is captured by means of at least one microphone, wherein, based on the captured voice information item, a command assigned to the voice information item is recognized from a plurality of commands, wherein an operational context, in which the microscope is when the voice information item is captured, is determined based on at least one context information item, wherein at least one microscope action is determined in consideration of the recognized command, and wherein at least one control command is generated to control the microscope to carry out the at least one determined microscope action, and wherein the at least one microscope action is carried out by controlling the microscope by means of the generated at least one control command, wherein the associated command is recognized in consideration of the determined operational context, and/or wherein the at least one microscope action is determined in consideration of the determined operational context. Further, the invention relates to a microscope.

First claim

1 . A method for controlling a microscope,
wherein a voice information item is captured by means of at least one microphone, wherein, based on the captured voice information item, a command assigned to the voice information item is recognized from a plurality of commands, wherein an operational context, in which the microscope is when the voice information item is captured, is determined based on at least one context information item, wherein at least one microscope action is determined in consideration of the recognized command, and wherein at least one control command is generated to control the microscope to carry out the at least one determined microscope action, and wherein the at least one microscope action is carried out by controlling the microscope by means of the generated at least one control command, wherein the associated command is recognized in consideration of the determined operational context, and/or wherein the at least one microscope action is determined in consideration of the determined operational context; and wherein the at least one context information item is generated based on at least one captured microscope image and/or at least one captured microscope video and/or wherein the at least one control command is generated in consideration of at least one captured microscope image and/or at least one captured microscope video.

2 . The method as claimed in claim 1 , wherein the at least one context information item is generated based on at least one ambient noise captured by means of the at least one microphone, or comprises such an ambient noise.

3 . The method as claimed in claim 1 , wherein the at least one context information item is generated based on an operational plan of the microscope and/or a surgery plan, and/or comprises an operational plan and/or a surgery plan.

4 . The method as claimed in claim 1 , wherein the at least one context information item is generated based on at least one microscope parameter and/or an operational state of the microscope and/or at least one parameter and/or an operational state of at least one external controller and/or at least one tool, and/or comprises these.

5 . The method as claimed in claim 1 , wherein the at least one context information item and/or the operational context is determined by means of at least one machine learning method and/or wherein the at least one microscope action is determined by means of at least one machine learning method.

6 . The method as claimed in claim 1 , wherein the determined at least one microscope action must be confirmed before being carried out.

7 . A microscope, comprising:
at least one microphone which is configured to capture a voice information item, and a control device, wherein the control device is configured, based on the captured voice information item, to recognize a command assigned to the voice information item from a plurality of commands, to determine an operational context, in which the microscope is when the voice information item is captured, based on at least one context information item, to determine at least one microscope action in consideration of the recognized command, to generate at least one control command for controlling the microscope to carry out the at least one determined microscope action, and to carry out the at least one microscope action by controlling the microscope by means of the generated control command, wherein the control device is further configured to recognize the associated command in consideration of the determined operational context, and/or to determine the at least one microscope action in consideration of the determined operational context; and wherein the control device is further configured to generate the at least one context information item based on at least one captured microscope image and/or at least one captured microscope video and/or to generate the at least one control command in consideration of at least one captured microscope image and/or at least one captured microscope video.

Assignees

• Zeiss Carl Meditec Ag

Inventors

• Albrecht Christian
• Saur Stefan

Classifications

• G06N20/00

  Machine learning · CPC title

• G02B21/365

  Control or image processing arrangements for digital or video microscopes (G02B21/361, G02B21/362 take precedence) · CPC title

• G10L2015/228

  of application context · CPC title

• G10L2015/223

  Execution procedure of a spoken command · CPC title

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title