Using artificial intelligence to select and chain models for robotic process automation

Patent metadata

Field	Value
Publication number	US-11893371-B2
Application number	US-202117200315-A
Country	US
Kind code	B2
Filing date	Mar 12, 2021
Priority date	Oct 15, 2019
Publication date	Feb 6, 2024
Grant date	Feb 6, 2024

Abstract

Using artificial intelligence (AI) to select and/or chain robotic process automation (RPA) models a given problem is disclosed. A model of models (e.g., an RPA robot or an ML model) may serve as an additional layer on an existing system that makes the existing models more effective. This model of models may incorporate AI that learns an improved or best set of rules or an order from existing models, potentially taking certain activities from a model, feeding input from one model into another, and/or chaining models in some embodiments.

First claim

The invention claimed is:

1. A computer-implemented method for using artificial intelligence (AI) to select and/or chain machine learning (ML) models for robotic process automation (RPA), comprising:
executing, by a computing system, a model of models that analyzes performance of individual ML models and chains of ML models in an ML model pool to be called in a workflow of an RPA robot; and
responsive to a superior performance outcome to an existing ML model or an existing chain of ML models being discovered by the model of models:
deploying the discovered ML model or the discovered chain of ML models, by the computing system, and replacing the existing ML model or the existing chain of ML models, wherein

the analysis of the performance of the individual ML models and the chains of ML models comprises performing AI-based experimentation on permutations of chained ML models in series, in parallel, or a combination thereof, and analyzing results output by the individual ML models and the chains of ML models.

2. The computer-implemented method of claim 1 , further comprising:
modifying the workflow of the RPA robot, by the computing system or another computing system, to call the discovered ML model or the discovered chain of ML models.

3. The computer-implemented method of claim 2 , further comprising:
generating a new version of the RPA robot, by the computing system, that implements the modified workflow of the RPA robot; and
deploying the generated new version of the RPA robot, by the computing system.

4. The computer-implemented method of claim 3 , further comprising:
calling the discovered ML model or the discovered chain of ML models, by the generated new version of the RPA robot, when executing the modified workflow of the RPA robot.

5. The computer-implemented method of claim 1 , wherein the permutations of the chained ML models comprise multiple instances of a same ML model in at least one permutation of the chained ML models.

6. The computer-implemented method of claim 1 , wherein at least one combination of ML models in series and in parallel comprises alternating between ML models in series and in parallel.

7. The computer-implemented method of claim 1 , wherein the superior performance outcome is governed by a reward function that explores intermediate transitions and steps with rewards to guide a search of a state space and an attempt to achieve a goal.

8. The computer-implemented method of claim 1 , wherein the model of models is an ML model or an RPA robot.

9. A computer-implemented method for using artificial intelligence (AI) to select and/or chain machine learning (ML) models for robotic process automation (RPA), comprising:
executing, by a computing system, a model of models that analyzes performance of individual ML models and chains of ML models in an ML model pool to be called in a workflow of an RPA robot; and
responsive to a superior performance outcome to an existing ML model or an existing chain of ML models being discovered by the model of models:
deploying the discovered ML model or the discovered chain of ML models, by the computing system, and replacing the existing ML model or the existing chain of ML models, and
modifying the workflow of the RPA robot, by the computing system or another computing system, to call the discovered ML model or the discovered chain of ML models, wherein

the analysis of the performance of the individual ML models and the chains of ML models comprises performing AI-based experimentation on permutations of chained ML models in series, in parallel, or a combination thereof, and analyzing results output by the individual ML models and the chains of ML models.

10. The computer-implemented method of claim 9 , further comprising:
generating a new version of the RPA robot, by the computing system, that implements the modified workflow of the RPA robot; and
deploying the generated new version of the RPA robot, by the computing system.

11. The computer-implemented method of claim 10 , further comprising:
calling the discovered ML model or the discovered chain of ML models, by the generated new version of the RPA robot, when executing the modified workflow of the RPA robot.

12. The computer-implemented method of claim 9 , wherein the permutations of the chained ML models comprise multiple instances of a same ML model in at least one permutation of the chained ML models.

13. The computer-implemented method of claim 9 , wherein the superior performance outcome is governed by a reward function that explores intermediate transitions and steps with rewards to guide a search of a state space and an attempt to achieve a goal.

14. The computer-implemented method of claim 9 , wherein the model of models is an ML model or an RPA robot.

15. A computer-implemented method for using artificial intelligence (AI) to select and/or chain machine learning (ML) models for robotic process automation (RPA), comprising:
executing, by a computing system, a model of models that analyzes performance of individual ML models and chains of ML models in an ML model pool to be called in a workflow of an RPA robot; and
responsive to a superior performance outcome to an existing ML model or an existing chain of ML models being discovered by the model of models:
deploying the discovered ML model or the discovered chain of ML models, by the computing system, and replacing the existing ML model or the existing chain of ML models, wherein

the model of models is an ML model or an RPA robot, and
the analysis of the performance of the individual ML models and the chains of ML models comprises performing AI-based experimentation on permutations of chained ML models in series, in parallel, or a combination thereof, and analyzing results output by the individual ML models and the chains of ML models.

16. The computer-implemented method of claim 15 , further comprising:
modifying the workflow of the RPA robot, by the computing system or another computing system, to call the discovered ML model or the discovered chain of ML models; and
generating a new version of the RPA robot, by the computing system, that implements the modified workflow of the RPA robot.

17. The computer-implemented method of claim 15 , wherein the permutations of the chained ML models comprise multiple instances of a same ML model in at least one permutation of the chained ML models.

18. The computer-implemented method of claim 15 , wherein at least one combination of ML models in series and in parallel comprises alternating between ML models in series and in parallel.

19. The computer-implemented method of claim 15 , wherein the superior performance outcome is governed by a reward function that explores intermediate transitions and steps with rewards to guide a search of a state space and an attempt to achieve a goal.

Assignees

• Uipath Inc

Inventors

• Singh Prabhdeep

Classifications

• G06N3/006

  based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO] · CPC title

• G06F8/60 Primary

  Software deployment · CPC title

• G06F11/3466

  Performance evaluation by tracing or monitoring · CPC title

• G06N20/00 Primary

  Machine learning · CPC title

• G06Q10/103 Primary

  Workflow collaboration or project management · CPC title