System and method of completing an activity via an agent

Patent metadata

Field	Value
Publication number	US-10726461-B2
Application number	US-201414208956-A
Country	US
Kind code	B2
Filing date	Mar 13, 2014
Priority date	Mar 15, 2013
Publication date	Jul 28, 2020
Grant date	Jul 28, 2020

Abstract

A system and method of completing an activity via an agent. The agent is embodied as agent software, which facilitates and/or performs activities on behalf of a user. The agent software may have a characteristic persona that it presents to the user in the form of an avatar on a display. The agent software may be part of a computer program stored in a memory and executed by a processor of a smartphone or other computer.

First claim

What is claimed is:

1. A method of completing an activity using a mobile communication device comprising:
providing, by executable instructions that execute on a processor of a mobile communication device from a non-transitory computer-readable medium as agent software, a user interface;
providing, by the agent software, interface elements within the user interface as an avatar presented on a display of the mobile communication device within screens, the avatar interacts with a user that operates the mobile communication device and guides the user in performance of an activity;
displaying, by the agent software through the interface elements on the screens, the avatar within the screens with the avatar having a body with a head and arms in different poses, including poses with symbols, during steps of the activity on the display within the screens;
processing the agent software on the mobile device by displaying the avatar in the poses that pictographically communicate information to assist the user in completing the steps without communicating any spoken language to the user by:
displaying the avatar on the display with the symbols in the poses as a pictographic sequence comprising at most four steps representing an introduction appearance, an option clarifier appearance, a clarifier appearance, and a conclusion appearance;
displaying the pictographic sequence of the avatar with at least three of the four steps;
displaying a first step in the pictographic sequence with the avatar in a first pose representing introductory appearance to the user for selection of the activity;
displaying a second step in the pictographic sequence with the avatar in a second pose representing the option clarifier appearance for the activity when the activity selected in the first step includes multiple selectable options available to the user;
displaying a third step in the pictographic sequence with the avatar in a third pose representing the clarifier appearance for the activity when the option clarifier appearance associated with the second step was not displayed for the activity in the first step;
displaying a fourth step in the pictographic sequence with the avatar in a fourth pose representing the conclusion appearance for the activity indicating the activity was processed on behalf of the user;
recording, by the agent software through the interface, required user inputs during the steps in response to the information;
performing, by the agent software, other steps of the activity as an intermediary between the user and a provider without user intervention, wherein performing further includes accessing a digital wallet associated with the user during performance of a portion of the activity and providing the digital wallet as a payment for the portion;
wherein the avatar of the user interface is controlled by the agent software;
determining cues from the user by the agent software;
wherein determining comprises capturing camera images of the user and analyzing the camera images to determine user body language;
wherein determining comprises capturing microphone recordings of the user and analyzing the microphone recording to determine user voice inflection;
wherein determining comprises capturing touch inputs of the user and analyzing the touch inputs to determine user touch input method;
and
altering appearances of the avatar presented by the user interface based upon the cues by the agent software.

2. The method of claim 1 , wherein one pose includes the introductory appearance corresponding to a first step of the activity.

3. The method of claim 1 , wherein one pose includes the option clarifier appearance accompanied by choice buttons when a corresponding step requires the user to make a choice.

4. The method of claim 1 , wherein one pose includes the clarifier appearance accompanied by information to explain a corresponding step.

5. The method of claim 1 , wherein the activity comprises a travel activity and wherein the method further comprises monitoring, by the agent software, a travel provider and detecting events that affect an itinerary of the user.

6. A mobile communication device, comprising:
a display; and
a processor configured to execute executable instructions from a non-transitory computer-readable storage medium as agent software, the agent software configured to:
provide a user interface to a user through user interface elements provided within activity screens of a display to the user to assist the user in performing an activity;
display the activity screens on the display through the user interface using the user interface elements during the activity selected by the user;
present through the user elements an avatar having a body with a head and arms in different poses, including poses with symbols communicating information to assist the user in completing steps of the activity without communicating any spoken language to the user through the mobile communication device;
receive required user inputs during the steps in response to the information, and to perform other steps of the activity as an intermediary between the user and a provider without user intervention;
present the avatar on the display with the symbols in the poses displayed as a pictographic sequence that comprises at most four steps representing an introduction appearance, an option clarifier appearance, a clarifier appearance, and a conclusion appearance;
present the pictographic sequence of the avatar as at least three steps for the activity;
present a first step of the pictographic sequence with the avatar in a first pose on the display representing the introductory appearance for user selection of the activity;
present a second step of the pictographic sequence with the avatar in a second pose on the display representing the option clarifier appearance for the activity when the activity selected in the first step includes multiple selectable options available to the user;
present a third step of the pictographic sequence with the avatar in a third pose on the display representing the clarifier appearance for the activity when the option clarifier appearance associated with the second step was not displayed for the activity selected in the first step;
present a fourth step of the pictographic sequence with the avatar in a fourth pose on the display representing the conclusion appearance for the activity indicating the activity was processed on behalf of the user; and
perform the activity based on the required user inputs received through the user interface from the user during the steps, wherein in performance of a portion of the activity, a digital wallet of the user is obtained and provided as payment for a portion of the activity;
wherein the avatar of the user interface is controlled by the agent software and the agent software when executed by the processor causes the processor to:
determine cues from the user by the agent software comprising capturing camera images of the user and analyzing the camera images to determine user body language, capturing microphone recordings of the user and analyzing the microphone recordings to determine user voice inflection, and capturing touch inputs of the user and analyzing the touch inputs to determine user touch input method; and
alter appearances of the avatar presented by the user interface based upon the cues by the agent software.

7. The mobile communication device of claim 6 , wherein the agent software is further configured to connect to a server including a travel provider server and wherein the processor is configured to detect events that affect an itinerary of the user.

8. The mobile communication device of claim 6 , wherein the avatar comprises a head, arms, and a body, and wherein the ar

Assignees

• Ncr Corp

Inventors

• Borucki Robert Thomas
• Bruno John

Classifications

• H04L67/131

  Protocols for games, networked simulations or virtual reality · CPC title

• G06F9/451

  Execution arrangements for user interfaces · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• G06Q10/021

  Re-booking existing reservations · CPC title

• G06Q10/02

  Reservations, e.g. for tickets, services or events · CPC title