Control method for a robotic device with an ultrasound apparatus and robotic device

Patent metadata

Field	Value
Publication number	US-10893909-B2
Application number	US-201816145520-A
Country	US
Kind code	B2
Filing date	Sep 28, 2018
Priority date	Sep 29, 2017
Publication date	Jan 19, 2021
Grant date	Jan 19, 2021

Abstract

A method is provided for controlling a robotic device, of which the end effector arranged on a kinematic chain interacts with an object, and including an ultrasound apparatus registered to the robotic device for movement capture of the object. Ultrasound image data of the object is captured. The relative movement of the object is determined on the basis of the ultrasound image data using a mathematical method. The absolute movement is determined through registration to a planning data set. Movements of the object are compensated for in the context of the interaction of the end effector of the robotic device with the object. Future movements of the object and a positioning of the end effector of the robotic device adapted thereto are predicted and the robotic device is controlled accordingly. In the calculation of the adapted positioning of the end effector of the robotic device, a temporal delay relative to the movement of the object is included.

First claim

The invention claimed is:

1. A method for controlling a robotic device with an end effector arranged on a kinematic chain that interacts with an object, and including an ultrasound apparatus registered to the robotic device for movement capture of the object, the method comprising:
capturing ultrasound image data of the object,
determining a relative movement of the object based on the captured ultrasound image data using a mathematical method,
registering the captured ultrasound data to a planning data set;
determining an absolute movement of the object from the registration;
compensating for movements of the object in a context of an interaction of the end effector of the robotic device with the object;
predicting future movements of the object and a positioning of the end effector of the robotic device based on the determined relative movement and determined absolute movement; wherein in predicting the positioning of the end effector of the robotic device, a temporal delay relative to the movement of the object is included; and
controlling the robotic device based on the predicted future movements of the object and the positioning of the end effector.

2. The method of claim 1 , wherein the temporal delay takes into account at least the duration of the acquisition of the ultrasound image data, the determination of the absolute movement and the reaction time of the robotic device.

3. The method of claim 2 , wherein in the mathematical method for determining the relative movement of the object, features of the object are extracted.

4. The method of claim 2 , wherein up to a stop criterion, continuous movement capture and movement compensation is carried out.

5. The method of claim 2 , wherein the ultrasound apparatus is further registered to a patient coordinate system.

6. The method of claim 2 , wherein the predicted positions of the kinematic chain of the robotic device are filtered.

7. The method of claim 2 , wherein the predicted positions of the end effector of the robotic device are synchronized.

8. The method of claim 1 , wherein in the mathematical method for determining the relative movement of the object, features of the object are extracted.

9. The method of claim 1 , wherein up to a stop criterion, continuous movement capture and movement compensation is carried out.

10. The method of claim 1 , wherein the ultrasound apparatus is further registered to a patient coordinate system.

11. The method of claim 1 , wherein the predicted positions of the kinematic chain of the robotic device are filtered.

12. The method of claim 1 , wherein the predicted positions of the end effector of the robotic device are synchronized.

Assignees

• Siemens Healthcare Gmbh

Inventors

• Fischer Peter
• Mewes Philip
• Mönnich Holger
• Müller Gunter

Classifications

• A61B34/30 Primary

  Surgical robots · CPC title

• A61B2090/378

  using ultrasound · CPC title

• B25J9/1697

  Vision controlled systems · CPC title

• A61B34/20 Primary

  Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis · CPC title

• A61B2034/2063

  Acoustic tracking systems, e.g. using ultrasound · CPC title