Technique for providing reliable control in a cloud robotics system

Patent metadata

Field	Value
Publication number	US-11613015-B2
Application number	US-201716641278-A
Country	US
Kind code	B2
Filing date	Sep 18, 2017
Priority date	Sep 18, 2017
Publication date	Mar 28, 2023
Grant date	Mar 28, 2023

Abstract

A technique for providing reliable control of a robot ( 304 ) in a cloud robotics system ( 300 ) is disclosed. A computing unit configured to execute a concealment component ( 100 ) for concealing delayed or lost commands sent to the robot ( 304 ) by a robot controller ( 302 ) in the cloud robotics system ( 300 ) comprises at least one processor and at least one memory, wherein the at least one memory contains instructions executable by the at least one processor such that the concealment component ( 100 ) is operable to detect a missing command expected to be received by the robot ( 304 ) from the robot controller ( 302 ), the missing command detected based on a delay or loss of the command in a communication path between the robot ( 304 ) and the robot controller ( 302 ), generate a substitutional command corresponding to an expected instruction of the missing command, and send the substitutional command to the robot ( 304 ).

First claim

The invention claimed is:

1. A computing circuit for providing reliable control of a robot in a cloud robotics system, the computing circuit configured to conceal delayed or lost commands sent to the robot by a robot controller in the cloud robotics system, the computing circuit comprising:
processing circuitry;
memory containing instructions executable by the processing circuitry whereby the instructions are configured to cause the computing circuit to:
detect a missing command expected to be received by the robot from the robot controller, the missing command detected based on a delay or loss of the command in a communication path between the robot and the robot controller;
generate a substitutional command corresponding to an expected instruction of the missing command by
generating the substitutional command based on one or more sensor values sent from the robot to the robot controller,
wherein the one or more sensor values are used to determine a predicted continuous control command value, and
wherein the substitutional command is generated based on the predicted continuous control command value;

send the substitutional command to the robot; and
initiate a safety stop of the robot when a duration of the delay or loss of the missing command exceeds a predetermined time limit.

2. The computing circuit of claim 1 , wherein the substitutional command is generated using a machine learning based model.

3. The computing circuit of claim 1 :
wherein the predicted control command value is a delta value corresponding to a difference to a control command value of a previous command received by the robot from the robot controller; and
wherein the substitutional command is generated based on the previous command and the delta value.

4. The computing circuit of claim 1 :
wherein at least one operation range limit of the robot is determined from messages exchanged between the robot and the robot controller during an operation of the robot; and
wherein the generating the substitutional command comprises applying the at least one operation range limit to the substitutional command.

5. The computing circuit of claim 1 , wherein the time limit is determined based on a passive measurement which includes observing commands sent to the robot and determining a difference between the observed commands and corresponding substitutional commands for different prediction periods.

6. The computing circuit of claim 1 , wherein the time limit is determined based on an active measurement which includes actively discarding commands for different prediction periods and observing a behavior of the robot after discarding the commands.

7. A method for providing reliable control of a robot in a cloud robotics system, the method being performed by a computing circuit configured to conceal delayed or lost commands sent to the robot by a robot controller in the cloud robotics system, the method comprising the computing circuit:
detecting a missing command expected to be received by the robot from the robot controller, the missing command detected based on a delay or loss of the command in a communication path between the robot and the robot controller;
generating a substitutional command corresponding to an expected instruction of the missing command by
generating the substitutional command based on one or more sensor values sent from the robot to the robot controller,
wherein the one or more sensor values are used to determine a predicted continuous control command value, and
wherein the substitutional command is generated based on the predicted continuous control command value;

sending the substitutional command to the robot; and
initiating a safety stop of the robot when a duration of the delay or loss of the missing command exceeds a predetermined time limit.

8. The method of claim 7 , wherein the substitutional command is generated using a machine learning based model.

9. The method of claim 7 :
wherein the predicted control command value is a delta value corresponding to a difference to a control command value of a previous command received by the robot from the robot controller; and
wherein the substitutional command is generated based on the previous command and the delta value.

10. The method of claim 7 , wherein at least one operation range limit of the robot is determined from messages exchanged between the robot and the robot controller during an operation of the robot.

11. The method of claim 10 , wherein the generating the substitutional command comprises applying the at least one operation range limit to the substitutional command.

12. The method of claim 7 , wherein the time limit is determined based on a passive measurement which includes observing commands sent to the robot and determining a difference between the observed commands and corresponding substitutional commands for different prediction periods.

13. The method of claim 7 , wherein the time limit is determined based on an active measurement which includes actively discarding commands for different prediction periods and observing a behavior of the robot after discarding the commands.

14. A non-transitory computer readable recording medium storing a computer program product for controlling a computing circuit for providing reliable control of a robot in a cloud robotics system, the computing circuit configured to conceal delayed or lost commands sent to the robot by a robot controller in the cloud robotics system, the computer program product comprising program instructions which, when run on processing circuitry of the computing circuit, causes the computing circuit to:
detect a missing command expected to be received by the robot from the robot controller, the missing command detected based on a delay or loss of the command in a communication path between the robot and the robot controller;
generate a substitutional command corresponding to an expected instruction of the missing command by
generating the substitutional command based on one or more sensor values sent from the robot to the robot controller,
wherein the one or more sensor values are used to determine a predicted continuous control command value, and
wherein the substitutional command is generated based on the predicted continuous control command value;

send the substitutional command to the robot; and
initiate a safety stop of the robot when a duration of the delay or loss of the missing command exceeds a predetermined time limit.

Assignees

• Ericsson Telefon Ab L M

Inventors

• Rácz Sándor
• Rácz András
• Reider Norbert
• Szabo Geza

Classifications

• G05B2219/31258

  Compensate control in case of missing message · CPC title

• B25J9/1643 Primary

  redundant control · CPC title

• G05B2219/31457

  Factory remote control, monitoring through internet · CPC title

• B25J9/161

  Hardware, e.g. neural networks, fuzzy logic, interfaces, processor · CPC title

• B25J9/1674

  characterised by safety, monitoring, diagnostic · CPC title