Populating budgets and/or wish lists using real-time video image analysis

Patent metadata

Field	Value
Publication number	US-2016163000-A1
Application number	US-201615045189-A
Country	US
Kind code	A1
Filing date	Feb 16, 2016
Priority date	Mar 8, 2011
Publication date	Jun 9, 2016
Grant date	—

Abstract

System, method, and computer program product are provided for using real-time video analysis, such as augmented reality to provide the user of a mobile device with real-time budgeting and wish lists. Through the use of real-time vision object recognition objects, logos, artwork, products, locations, and other features that can be recognized in the real-time video stream can be matched to data associated with such to provide the user with real-time budget impact and wish list updates based on the products and budget data determined as being the object. In this way, the objects, which may be products and/or budget data in the real-time video stream, may be included into a user's budget and/or wish list, such that the user receives real-time budget and/or wish list updates incorporating product and/or budget data located in a real-time video stream.

First claim

What is claimed is:

1 . A method for populating a user directory with product information, the method comprising:
receiving financial information for a user, wherein the financial information provides an indication of financial history of the user; analyzing, via a processing device, a real-time video stream representing the surrounding environment captured on a mobile device; identifying one or more products within the real-time video stream; determining a location in the user directory to populate with the one or more products identified within the real-time video stream, wherein the user directory comprises a user budget and a user wish list; determining information about the one or more products within the real-time video stream, wherein the information about the one or more products comprises a price associated with the one or more products within the real-time video stream; presenting, via superimposing over the real-time video stream on the mobile device, a selectable indicator associated with the one or more products within the real-time video stream, wherein the selectable indicator provides real-time impact on the user budget and the user wish list for the one or more products identified within the real-time video stream if the one or more products in the real-time video stream were purchased by the user associated with the user mobile device displaying the real-time video stream, wherein presenting the selectable indicator comprises superimposing the selectable indicator with the real-time impact of the one or more products on the user budget and the user wish list over the real-time video stream depicting the one or more products; and providing, via selection of the selectable indicator, a communicable link between the user and a third party, via the mobile device, and transmitting the real-time video stream with the selectable indicator superimposed over the real-time video stream to the third party via the communicable link, such that the third party can advise the user based on the real-time impact that purchasing one or more products would have on the user budget and the user wish list.

2 . The method of claim 1 further comprises providing the user with real-time loan procurement for purchasing the one or more products, wherein the real-time loan procurement is based at least in part on the receiving of financial information for the user.

3 . The method of claim 1 , wherein identifying one or more products comprises implementing, via a computer device processor, object recognition processing to identify one or more images within the real-time video stream that correspond to one or more products.

4 . The method of claim 1 , wherein identifying one or more products further comprises capturing a tag located on one or more of the products and reading the tag to identify the product.

5 . The method of claim 1 , further comprising developing a budget strategy, wherein the budget strategy is based at least in part on said receiving financial information for the user, wherein the receiving financial information comprises at least one of user transaction history, user income, user financial plans, or user personal plans.

6 . The method of claim 1 further comprising providing access to the user directory by selection of the indicator on the display of the real-time video stream, such that the user budget and the user wish list is accessible.

7 . The method of claim 1 , wherein presenting a selectable indicator comprising presenting a selectable indicator that is one of an electronic tag, a highlighted area or a hot-spot.

8 . The method of claim 1 , wherein providing a communicable link between the user and a third party comprises providing a direct video or audio conference link with the third party.

9 . The method of claim 1 further comprising providing the user with the ability to purchase a product located within the real-time video stream.

10 . A computer program product for populating a user directory with product information, the computer program product comprising at least one non-transitory computer-readable medium having computer-readable program code portions embodied therein, the computer-readable program code portions comprising:
an executable portion configured for receiving financial information for a user, wherein the financial information provides an indication of financial history of the user; an executable portion configured for analyzing a real-time video stream representing the surrounding environment captured on a mobile device; an executable portion configured for identifying one or more products within the real-time video stream; an executable portion configured for determining a location in the user directory to populate with the one or more products identified within the real-time video stream, wherein the user directory comprises a user budget and a user wish list; an executable portion configured for determining information about the one or more products within the real-time video stream, wherein the information about one or more products comprises a price associated with the one or more products within the real-time video stream; an executable portion configured for presenting, via superimposing over the real-time video stream on the mobile device, a selectable indicator associated with the one or more products within the real-time video stream, wherein the indicator provides real-time impact on the user budget and the user wish list for the one or more products identified within the real-time video stream if the one or more products in the real-time video stream were purchased by the user associated with the user mobile device displaying the real-time video stream, wherein presenting the selectable indicator comprises superimposing the selectable indicator and the real-time impact of the one or more products on the user budget and the user wish list over the real-time video stream depicting the one or more products; and an executable portion configured for providing, via selection of the selectable indicator, a communicable link between the user and a third party, via the mobile device, and transmitting the real-time video stream and the selectable indicator to the third party via the communicable link, such that the third party can advise the user based on the real-time impact that purchasing one or more products would have on the user budget and the user wish list.

11 . The computer program product of claim 10 further comprises an executable portion configured for providing the user with real-time loan procurement for purchasing the one or more products, wherein the real-time loan procurement is based at least in part on the receiving of financial information for the user.

12 . The computer program product of claim 10 , wherein identifying one or more products comprises implementing, via a computer device processor, object recognition processing to identify one or more images within the real-time video stream that correspond to one or more products.

13 . The computer program product of claim 10 , wherein identifying one or more products further comprises capturing a tag located on one or more of the products and reading the tag to identify the product.

14 . The computer program product of claim 10 , further comprising an executable portion configured for developing a budget strategy, wherein the budget strategy is based at least in part on said receiving financial information for the user, wherein the receiving financial information comprises at least one of user transaction history, user income, user financial plans, or user personal plans.

15 . Th

Assignees

• Bank Of America

Inventors

• Calman Matthew A
• Ross Erik Stephen

Classifications

• G06K9/00671

  Physics · mapped topic

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• G06K9/00744

  Physics · mapped topic

• G06Q30/0643

  graphically representing goods, e.g. 3D product representation · CPC title

• G06Q30/0633

  Managing shopping lists, e.g. compiling or processing purchase lists (shipping orders G06Q10/083; order filling G06Q10/087) · CPC title