System and methods for dynamically assigning control to one or more BOTs

Patent metadata

Field	Value
Publication number	US-9928106-B2
Application number	US-201615085208-A
Country	US
Kind code	B2
Filing date	Mar 30, 2016
Priority date	Mar 29, 2016
Publication date	Mar 27, 2018
Grant date	Mar 27, 2018

Abstract

Method and system for dynamically assigning control to one or more BOTs to execute at least one task are disclosed. The method comprises tracking user actions on at least one graphical user interface to obtain tracking data, and analyzing the at least one graphical user interface using one or more computerized image processing techniques to obtain screen data, and comparing the tracking data and the screen data with one or more confirmatory predictors. Upon comparing a list of tasks are identified, and the list of tasks comprise the at least one task being performed by the user. Upon determining number of tasks less than a predefined threshold value, the list of tasks is provided to a user. Further, one or more BOTs configured to perform the at least one task are assigned control to execute the at least one task.

First claim

We claim:

1. A method for dynamically assigning control to one or more bots to execute at least one task, the method comprising:
tracking, via a hardware processor, user actions on at least one graphical user interface to obtain tracking data;
analyzing, via the hardware processor, the at least one graphical user interface using one or more computerized image processing techniques to obtain screen data;
comparing, via the hardware processor, the tracking data and the screen data with one or more confirmatory predictors obtained from a database;
identifying, via the hardware processor, a list of tasks based on the comparing wherein the list of tasks comprises the at least one task being performed by the user;
determining, via the hardware processor, whether number of tasks in the list of tasks is less than a predefined threshold value;
providing, via the hardware processor, the list of tasks to the user, based on the determining, to identify the at least one task;
ascertaining, via the hardware processor, the one or more bots configured to perform the at least one task; and
assigning, via the hardware processor, control to the one or more bots to execute the at least one task, wherein assigning the control to the one or more bots comprises:
seeking, via the hardware processor, a user permission to identify whether to provide the control to the one or more bots;
providing, via the hardware processor, the control to the one or more bots to perform the at least one task upon receiving the user permission from the user; and
providing, via the hardware processor, one or more optimum paths to the user to perform the at least one task in absence of the user permission.

2. The method of claim 1 , wherein the tracking data comprise data related to actions performed, by the user, on the objects present in the at least one graphical user interface and sequence of the actions performed.

3. The method of claim 1 , wherein the screen data comprise objects in the at least one graphical user interface, and wherein the objects is at least one of images, buttons, icons, shortcut keys, controls, textboxes, labels, dropdowns, or hyperlinks.

4. The method of claim 1 , wherein each of the one or more confirmatory predictors comprise unique combinations of at least one of an event, a position, an order, objects, a relative timeline in the at least one graphical user interface of a display unit, or inputs from peripheral devices.

5. The method of claim 1 , wherein providing the list of tasks to the user further comprises:
displaying, by the hardware processor, the list of tasks on the at least one graphical user interface of a display unit; and
receiving, by the hardware processor, a user selection indicating the at least one task being performed by the user.

6. The method of claim 1 , wherein ascertaining the one or more bots further comprises identifying, by the hardware processor, at least one active bot based on availability and the at least one task to be performed, and wherein each of the at least one active bot has a predefined maturity level.

7. A system for adaptive process automation, comprising:
a hardware processor; and a memory storing instructions executable by the hardware processor for:
tracking user actions on at least one graphical user interface to obtain tracking data;
analyzing the at least one graphical user interface using one or more computerized image processing techniques to obtain screen data;
comparing the tracking data and the screen data with one or more confirmatory predictors obtained from a database;
identifying a list of tasks based on the comparing, wherein the list of tasks comprises the at least one task being performed by the user;
determining whether number of tasks in the list of tasks is less than a predefined threshold value;
providing the list of tasks to the user, based on the determining, to identify the at least one task;
ascertaining the one or more bots configured to perform the at least one task; and
assigning control to the one or more bots to execute the at least one task, wherein the assigning control to one or more bots comprises:
seeking a user permission to identify whether to provide the control to the one or more bots;
providing the control to the one or more bots to perform the at least one task upon receiving the user permission from the user; and
providing one or more optimum paths to the user to perform the at least one task in absence of the user permission.

8. The method of claim 7 , wherein the tracking data comprise data related to actions performed, by the user, on the objects present in the at least one graphical user interface and sequence of the actions performed.

9. The method of claim 7 , wherein the screen data comprise objects in the at least one graphical user interface, and wherein the objects is at least one of images, buttons, icons, shortcut keys, controls, textboxes, labels, dropdowns, or hyperlinks.

10. The method of claim 7 , wherein each of the one or more confirmatory predictors comprise unique combinations of at least one of an event, a position, an order, objects, a relative timeline in the at least one graphical user interface of a display unit, or inputs from peripheral devices.

11. The method of claim 7 , wherein providing the list of tasks to the user further comprises:
displaying, by the hardware processor, the list of tasks on the at least one graphical user interface of a display unit; and
receiving, by the hardware processor, a user selection indicating the at least one task being performed by the user.

12. The method of claim 7 , wherein ascertaining the one or more bots further comprises identifying, by the hardware processor, at least one active bot based on availability and the at least one task to be performed, and wherein each of the at least one active bot has a predefined maturity level.

13. A non-transitory computer-readable medium storing instructions for dynamically assigning control to one or more bots to execute at least one task, wherein upon execution of the instructions by one or more processors, the processors perform operations comprising:
tracking user actions on at least one graphical user interface to obtain tracking data;
analyzing the at least one graphical user interface using one or more computerized image processing techniques to obtain screen data;
comparing the tracking data and the screen data with one or more confirmatory predictors obtained from a database;
identifying a list of tasks based on the comparing, wherein the list of tasks comprises the at least one task being performed by the user;
determining whether number of tasks in the list of tasks is less than a predefined threshold value;
providing the list of tasks to the user, based on the determining, to identify the at least one task;
ascertaining the one or more bots configured to perform the at least one task; and
assigning control to the one or more bots to execute the at least one task, wherein assigning the control to the one or more bots comprises:
seeking a user permission to identify whether to provide the control to the one or more bots;
providing the control to the one or more bots to perform the at least one task upon receiving the user permission from the user; and
providing one or more optimum paths to the user to perform the at least one task in absence of the user permission.

14. The medium of claim 13 , wherein the tracking data comprise data related to actions performed, by the user, on the objects present in the at least one graphical user interface and sequence of the actions performed and the screen data comprise

Assignees

• Wipro Ltd

Inventors

• Hosabettu Raghavendra
• Ramanna Ramprasad Kanakatte
• Mannopantar Raghottam

Classifications

• G06F9/4843 Primary

  by program, e.g. task dispatcher, supervisor, operating system · CPC title

• G06F17/30268

  Physics · mapped topic

• G06Q10/063114 Primary

  Status monitoring or status determination for a person or group · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06Q10/06398

  Performance of employee with respect to a job function · CPC title