Augmented reality virtual banker

Patent metadata

Field	Value
Publication number	US-10078867-B1
Application number	US-201414151960-A
Country	US
Kind code	B1
Filing date	Jan 10, 2014
Priority date	Jan 10, 2014
Publication date	Sep 18, 2018
Grant date	Sep 18, 2018

Abstract

A method implemented on an augmented reality electronic device includes viewing at least a portion of a financial document with the augmented reality electronic device. One or more words or phrases in a section of the financial document are identified using the augmented reality electronic device. A customer associated with the financial document is identified. An indication of the one or more words or phrases and an identification of the customer are sent to a server computer. Customized content is received from the server computer based on the one or more words or phrases and the identification of the customer. The customized content is displayed on the augmented reality electronic device.

First claim

What is claimed is:

1. A method implemented on an augmented reality electronic device, the method comprising:
viewing at least a portion of a financial document with the augmented reality electronic device;
identifying one or more words or phrases in a section of the financial document using the augmented reality electronic device;
identifying an account identification number associated with the financial document using the augmented reality electronic device;
authenticating a user of the augmented reality device;
after authenticating the user, logging on to a financial account of the user identified by the account identification number;
sending the one or more words or phrases and the account identification number to a server computer;
as a result of sending the one or more words or phrases and the account identification number to the server computer, receiving a textual message from a virtual agent of a financial institution, the textual message identifying customized financial content related to the one or more words and phrases and related to the financial account of the user, the textual message inquiring as to whether the user wishes to the view the customized financial content;
projecting an overlay of an image of the virtual agent on the augmented reality electronic device, the image including the textual message and one or more virtual buttons that permit a selection of the customized financial content;
receiving a selection of one of the virtual buttons;
as a result of receiving the selection of the one of the virtual buttons, displaying an information area on a display screen of the augmented reality electronic device, the information area including: (i) a first area with a control that, when activated, displays on the display screen details regarding a bank credit card rewards program; (ii) a second area with a control that, when activated, provides details for making an appointment with a personal banker; and (iii) a third area with a control that, when activated, initiates a telephone call to the personal banker, the information area being displayed below the image of the virtual agent on the display screen;
receiving a selection of one control from one of the first area, the second area or the third area of the information area;
receiving the customized financial content corresponding to the selection;
projecting the customized financial content on the augmented reality electronic device;
detecting that the user has looked away from the financial document for greater than a predetermined period of time; and
as a result of detecting that the user has looked away from the financial document for greater than the predetermined period of time, logging off from the financial account for the user.

2. The method of claim 1 , wherein the augmented reality electronic device is a headset.

3. The method of claim 2 , wherein the headset comprises a wearable computer with a camera and an optical head-mounted display.

4. The method of claim 1 , wherein the augmented reality electronic device is a mobile electronic computing device, the mobile electronic computing device including an augmented reality software application.

5. The method of claim 1 , wherein the financial document is a portfolio management account statement for the customer.

6. The method of claim 1 , wherein the financial document is a banking statement.

7. The method of claim 1 , wherein projecting the customized content comprises displaying an account balance trend for the customer.

8. The method of claim 1 , wherein displaying the customized content comprises displaying marketing information related to the financial document.

9. The method of claim 1 , wherein the display of the customized content overlays a display of the financial document on the augmented reality electronic device.

10. The method of claim 1 , further comprising enabling the customer to take an action on the augmented reality electronic device based on the displayed customized content.

11. The method of claim 10 , wherein the action comprises paying a bill.

12. The method of claim 10 , wherein the action comprises enrolling for a financial service.

13. A method implemented on an augmented reality electronic device, the method comprising:
viewing at least a portion of a financial document with the augmented reality electronic device;
identifying one or more words or phrases in a section of the financial document using the augmented reality electronic device;
obtaining an identification for a customer from a section of the financial document;
sending the one or more words or phrases and the identification of the customer to a server computer;
as a result of sending the one or more words or phrases and the identification of the customer to the server computer, receiving a textual message from a virtual banker of a financial institution, the textual message identifying a balance trend of a financial account of the customer, the balance trend being identified based on an analysis of the one or more words and phrases, the textual message inquiring as to whether the user wishes to the view the balance trend;
projecting an overlay of an image of the virtual banker on the augmented reality electronic device, the image including the textual message and one or more virtual buttons that permit a display of the balance trend;
receiving a selection of one of the virtual buttons;
as a result of receiving the selection of the one of the virtual buttons, receiving data relating to the balance trend;
projecting a graph showing the balance trend on the augmented reality electronic device, the graph showing a trend of assets and liabilities for the customer, the graph including a plurality of additional virtual buttons, a first additional virtual button permitting a display of the balance trend over one time period, a second additional virtual button permitting a display of the balance trend over a different time period, and a third additional virtual button permitting initiation of a telephone call with a personal banker;
detecting that the user has looked away from the financial document for greater than a predetermined period of time; and
as a result of detecting that the user has looked away from the financial document for greater than the predetermined period of time, logging off from a financial account for the user.

14. The method of claim 13 , wherein the augmented reality electronic device is a headset comprising a wearable computer with a camera and an optical head-mounted display.

15. The method of claim 13 , wherein the augmented reality electronic device is a mobile electronic computing device, the mobile electronic computing device including an augmented reality software application.

16. An augmented reality electronic computing device comprising:
a processing unit; and
system memory, the system memory including instructions which, when executed by the processing unit, cause the augmented reality electronic computing device to:
view at least a portion of a financial document;
identify one or more words or phrases in a section of the financial document
identify an account identification number associated with the financial document;
authenticate a user of the augmented reality device;
after authenticating the user, log on to a financial account of the user identified by the account identification number;
send the one or more words or phrases and the account identification number to a server computer;
as a result of sending the one or more words or phrases and the identification of the customer to the server computer, receive a t

Assignees

• Wells Fargo Bank Na

Inventors

• Chan Christin
• Tengelitsch Ii Erick Von

Classifications

• G06K9/00469

  Physics · mapped topic

• G06Q40/02 Primary

  Banking, e.g. interest calculation or account maintenance (credit or loans G06Q40/03) · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06V40/165

  using facial parts and geometric relationships · CPC title