Automatic activation and configuration of robotic process automation workflows using machine learning

Patent metadata

Field	Value
Publication number	US-12423609-B2
Application number	US-201916707814-A
Country	US
Kind code	B2
Filing date	Dec 9, 2019
Priority date	Oct 15, 2019
Publication date	Sep 23, 2025
Grant date	Sep 23, 2025

Abstract

Automatic activation and configuration of robotic process automation (RPA) workflows using machine learning (ML) is disclosed. One or more parts of an RPA workflow may be turned on or off based on one or more probabilistic ML models. RPA robots may be configured to modify parameters, determine how much of a certain resource to provide, determine more optimal thresholds, etc. Such RPA workflows implementing ML may thus be hybrids of both deterministic and probabilistic logic, and may learn and improve over time by retraining the ML models, adjusting the confidence thresholds, using local/global confidence thresholds, providing or adjusting modifiers for the local confidence thresholds, implement a supervisor system that monitors ML model performance, etc.

First claim

The invention claimed is:

1. A computer-implemented method, comprising:
calling at least one machine learning (ML) model, by a robotic process automation (RPA) robot, when executing a probabilistic activity of an RPA workflow;
receiving, by the RPA robot, at least one confidence value from the at least one ML model;
responsive to the at least one confidence value not exceeding a confidence threshold:
turning off a workflow section after the probabilistic activity, by the RPA robot, via the probabilistic activity; and

responsive to the at least one confidence value exceeding the confidence threshold:
turning on the workflow section after the probabilistic activity, by the RPA robot, via the probabilistic activity, and
executing the workflow section following the probabilistic activity, by the RPA robot, wherein

the RPA robot, in the probabilistic activity, determines whether the at least one confidence value exceeds the confidence threshold, and
the turning on or off of the workflow section after the probabilistic activity comprises modifying activity parameters within the RPA workflow.

2. The computer-implemented method of claim 1 , further comprising:
generating the RPA workflow comprising a plurality of deterministic activities and the at least one probabilistic activity configured to call the at least one ML model; and
generating the RPA robot that implements the generated RPA workflow.

3. The computer-implemented method of claim 1 , further comprising:
raising or lowering the confidence threshold, by the RPA robot, after the process of the workflow has been run a predetermined number of times.

4. The computer-implemented method of claim 3 , wherein the raising or lowering of the confidence threshold by the RPA robot is repeated until a winning state is achieved.

5. The computer-implemented method of claim 3 , further comprising:
determining, by the RPA robot, that the at least one ML models are not achieving an outcome after a predetermined number of modifications to the confidence threshold; and
retraining the at least one ML models.

6. The computer-implemented method of claim 1 , wherein the RPA robot is configured to determine how much of a certain resource to provide, determine a more optimal confidence threshold, or both.

7. The computer-implemented method of claim 1 , wherein the RPA robot calls multiple ML models and the confidence values from each ML model are combined to determine a global confidence value that is compared against the confidence threshold for the probabilistic activity.

8. The computer-implemented method of claim 7 , wherein the global confidence value is determined by applying a respective weight to the confidence values and combining the weighted confidence values.

9. A non-transitory computer-readable medium storing a computer program, the computer program configured to cause at least one processor to:
call a machine learning (ML) model while executing a probabilistic activity of an RPA workflow;
receive a confidence value from the ML model;
responsive to the confidence value not exceeding a confidence threshold, turn off a workflow section after the probabilistic activity, via the probabilistic activity; and
responsive to the confidence value exceeding the confidence threshold:
turn on a workflow section after the probabilistic activity, via the probabilistic activity, and
execute the workflow section following the probabilistic activity, wherein

the RPA robot, in the probabilistic activity, determines whether the at least one confidence value exceeds the confidence threshold, and
the turning on or off of the workflow section after the probabilistic activity comprises modifying activity parameters within the RPA workflow.

10. The non-transitory computer-readable medium of claim 9 , wherein the computer program is further configured to cause the at least one processor to:
raise or lower the confidence threshold after the process of the workflow has been run a predetermined number of times.

11. The non-transitory computer-readable medium of claim 10 , wherein the raising or lowering of the confidence threshold is repeated until a winning state is achieved.

12. The non-transitory computer-readable medium of claim 10 , wherein the computer program is further configured to cause the at least one processor to:
determine that the ML model is not achieving an outcome after a predetermined number of modifications to the confidence threshold; and
provide an indication to a server to retrain the ML model.

13. The non-transitory computer-readable medium of claim 9 , wherein the computer program is further configured to cause the at least one processor to:
determine how much of a certain resource to provide, determine a more optimal confidence threshold, or both.

14. A computer-implemented method, comprising:
calling at least one machine learning (ML) model, by a robotic process automation (RPA) robot, while executing a probabilistic activity of an RPA workflow;
receiving, by the RPA robot, at least one confidence value from the at least one ML model;
comparing the at least one confidence value to a plurality of confidence threshold ranges, by the RPA robot;
modifying the confidence threshold ranges based on an applied scenario; and
responsive to the at least one confidence value falling within a confidence threshold range:
turning on a workflow section after the probabilistic activity for that confidence threshold range, by the RPA robot, via the probabilistic activity, and
executing the workflow section following the probabilistic activity for that confidence threshold range, by the RPA robot, wherein

the RPA robot, in the probabilistic activity, determines whether the at least one confidence value exceeds the confidence threshold, and
the turning on or off of the workflow section after the probabilistic activity comprises modifying activity parameters within the RPA workflow.

15. The computer-implemented method of claim 14 , further comprising:
generating the RPA workflow comprising a plurality of deterministic activities and the at least one probabilistic activity configured to call the at least one ML model; and
generating the RPA robot that implements the generated RPA workflow.

16. The computer-implemented method of claim 14 , further comprising:
modifying one or more of the confidence threshold ranges, by the RPA robot, after the process of the workflow is run a predetermined number of times.

17. The computer-implemented method of claim 16 , wherein the modification of the one or more confidence threshold ranges by the RPA robot is repeated until a winning state is achieved.

18. The computer-implemented method of claim 16 , further comprising:
determining, by the RPA robot, that the at least one ML models are not achieving an outcome after a predetermined number of modifications to the confidence threshold range; and
retraining the at least one ML models.

19. The computer-implemented method of claim 14 , wherein the RPA robot is configured to determine how much of a certain resource to provide, determine a more optimal confidence threshold range, or both.

20. The computer-implemented method of claim 14 , wherein
the RPA robot calls multiple ML models and the confidence values from each ML model are combined to determine a global confidence value that is compared against the confidence threshold ranges for the probabilistic activity, and
the global confidence value is determined by applying a respective weight to the con

Assignees

• Uipath Inc

Inventors

• Singh Prabhdeep
• Mcgonnell Anton

Classifications

• G06V10/7784

  based on feedback from supervisors · CPC title

• G06N7/01

  Probabilistic graphical models, e.g. probabilistic networks · CPC title

• G06F18/2178 Primary

  based on feedback of a supervisor · CPC title

• G06F18/2148

  characterised by the process organisation or structure, e.g. boosting cascade · CPC title

• G06N20/20

  Ensemble learning · CPC title