Populating budgets and/or wish lists using real-time video image analysis

Patent metadata

Field	Value
Publication number	US-9317835-B2
Application number	US-201213365996-A
Country	US
Kind code	B2
Filing date	Feb 3, 2012
Priority date	Mar 8, 2011
Publication date	Apr 19, 2016
Grant date	Apr 19, 2016

Abstract

System, method, and computer program product are provided for using real-time video analysis, such as augmented reality to provide the user of a mobile device with real-time budgeting and wish lists. Through the use of real-time vision object recognition objects, logos, artwork, products, locations, and other features that can be recognized in the real-time video stream can be matched to data associated with such to provide the user with real-time budget impact and wish list updates based on the products and budget data determined as being the object. In this way, the objects, which may be products and/or budget data in the real-time video stream, may be included into a user's budget and/or wish list, such that the user receives real-time budget and/or wish list updates incorporating product and/or budget data located in a real-time video stream.

First claim

What is claimed is:

1. A method for populating a user directory, the method comprising:
receiving financial information for a user, wherein the financial information provides an indication of financial history of the user;
analyzing, via a processing device, a real-time video stream representing a surrounding environment captured on a mobile device;
identifying one or more products within the real-time video stream;
determining a location in the user directory to populate with the one or more products identified within the real-time video stream, wherein the user directory comprises a user budget and a user wish list;
determining information about the one or more products within the real-time video stream, wherein the information about the one or more products comprises a price associated with the one or more products within the real-time video stream;
presenting, via superimposing over the real-time video stream on the mobile device, a selectable indicator associated with the one or more products within the real-time video stream, wherein the selectable indicator provides real-time impact on the user budget and the user wish list for the one or more products identified within the real-time video stream if the one or more products in the real-time video stream were purchased by the user associated with the user mobile device displaying the real-time video stream, wherein presenting the selectable indicator comprises superimposing the selectable indicator with the real-time impact of the one or more products on the user budget and the user wish list over the real-time video stream of the one or more products; and
providing, via selection of the selectable indicator, a communicable link between the user and a financial advisor, via the mobile device, and transmitting the real-time video stream with the selectable indicator superimposed over the real-time video stream to the financial advisor via the communicable link, such that the financial advisor can advise the user based on the real-time impact that purchasing one or more products would have on the user budget and the user wish list.

2. The method of claim 1 further comprises providing the user with real-time loan procurement for purchasing the one or more products, wherein the real-time loan procurement is based at least in part on the received financial information for the user.

3. The method of claim 1 , wherein identifying one or more products comprises implementing, via a computer device processor, object recognition processing to identify one or more images within the real-time video stream that correspond to one or more products.

4. The method of claim 1 , wherein identifying one or more products further comprises capturing a tag located on one of the one or more products and reading the tag to identify the one of the one or more products.

5. The method of claim 1 , further comprising developing a budget strategy, wherein the budget strategy is based at least in part on the received financial information for the user, wherein the received financial information comprises at least one of user transaction history, user income, user financial plans, or user personal plans.

6. A system for populating a user directory, the system comprising:
a memory device with computer-readable program code stored thereon;
a communication device;
a processing device operatively coupled to the memory device and the communication device, wherein the processing device is configured to execute the computer-readable program code to:
receive financial information for a user, wherein the financial information provides an indication of financial history of the user;
analyze a real-time video stream representing a surrounding environment captured on a mobile device;
identify one or more products within the real-time video stream;
determine a location in the user directory to populate with the one or more products identified within the real-time video stream, wherein the user directory comprises a user budget and a user wish list;
determine information about the one or more products within the real-time video stream, wherein the information about the one or more products comprises a price associated with the one or more products within the real-time video stream;
present, via superimposing over the real-time video stream on the mobile device, a selectable indicator associated with the one or more products within the real-time video stream, wherein the selectable indicator provides real-time impact on the user budget and the user wish list for the one or more products identified within the real-time video stream if the one or more products in the real-time video stream were purchased by the user associated with the user mobile device displaying the real-time video stream, wherein presenting the selectable indicator comprises superimposing the selectable indicator with the real-time impact of the one or more products on the user budget and the user wish list over the real-time video stream of the one or more products; and
provide, via selection of the selectable indicator, a communicable link between the user and a financial advisor, via the mobile device, and transmitting the real-time video stream with the selectable indicator superimposed over the real-time video stream to the financial advisor via the communicable link, such that the financial advisor can advise the user based on the real-time impact that purchasing one or more products would have on the user budget and the user wish list.

7. The system of claim 6 further comprises providing the user with real-time loan procurement for purchasing the one or more products, wherein the real-time loan procurement is based at least in part on the received financial information for the user.

8. The system of claim 6 , wherein identifying one or more products comprises implementing, via a computer device processor, object recognition processing to identify one or more images within the real-time video stream that correspond to one or more products.

9. The system of claim 6 , wherein identifying one or more products further comprises capturing a tag located on one of the one or more products and reading the tag to identify the one of the one or more products.

10. The system of claim 6 , further comprising developing a budget strategy, wherein the budget strategy is based at least in part on the received financial information for the user, wherein the received financial information comprises at least one of user transaction history, user income, user financial plans, or user personal plans.

11. A computer program product for populating a user directory, the computer program product comprising at least one non-transitory computer-readable medium having computer-readable program code portions embodied therein, the computer-readable program code portions comprising:
an executable portion configured for receiving financial information for a user, wherein the financial information provides an indication of financial history of the user;
an executable portion configured for analyzing a real-time video stream representing a surrounding environment captured on a mobile device;
an executable portion configured for identifying one or more products within the real-time video stream;
an executable portion configured for determining a location in the user directory to populate with the one or more products identified within the real-time video stream, wherein the user directory comprises a user budget and a user wish list;
an executable portion configured for determining information about the one or more products within the real-time video stream, wherein the information about the one or more products comprises a price asso

Assignees

• Calman Matthew A
• Ross Erik Stephen
• Bank Of America

Inventors

• Calman Matthew A
• Ross Erik Stephen

Classifications

• G06Q30/06

  Buying, selling or leasing transactions · CPC title

• G06Q30/02

  Marketing; Price estimation or determination; Fundraising · CPC title

• G06Q30/0633

  Managing shopping lists, e.g. compiling or processing purchase lists (shipping orders G06Q10/083; order filling G06Q10/087) · CPC title

• G06Q40/02

  Banking, e.g. interest calculation or account maintenance (credit or loans G06Q40/03) · CPC title

• G06Q10/10 Primary

  Office automation; Time management · CPC title