Systems and methods for facilitating a transaction using augmented reality

Patent metadata

Field	Value
Publication number	US-11954658-B2
Application number	US-202318188378-A
Country	US
Kind code	B2
Filing date	Mar 22, 2023
Priority date	Dec 22, 2016
Publication date	Apr 9, 2024
Grant date	Apr 9, 2024

Abstract

A system includes one or more memory devices storing instructions, and one or more processors configured to execute the instructions to perform steps of a method. The system may provide an augmented environment that facilitates a transaction. The system may store profile data including user payment or user profile information. The system may then receive environmental data, and identify one or more action items in the environmental data. In response to this identification, the system may augment the environmental data by adding virtual environmental data, and then provide this virtual environmental data to a device to create an augmented environment. The system can then receive user input data, and provide purchase request data to a merchant terminal in response to those inputs.

First claim

What is claimed is:

1. A system comprising:
one or more processors; and
a memory in communication with the one or more processors and storing instructions that, when executed by the one or more processors, are configured to cause the system to:
receive, from a data sensor, environmental data associated with a physical environment, the environmental data comprising a gesture made in a visual field of the data sensor;
detect, based on the environmental data, one or more purchased products by identifying one or more objects present in the physical environment;
determine that a number of the one or more purchased products is below a predetermined threshold;
augment the environmental data by adding virtual environmental data comprising a prompt to buy more of the one or more purchased products;
display the augmented environmental data via a display;
receive user input data comprising a visual command to select a merchant based on the gesture made in the visual field of the data sensor; and
provide, based on the user input data, purchase request data to a merchant terminal associated with the merchant to enable a transaction related to the one or more purchased products.

2. The system of claim 1 , wherein the prompt to buy more of the one or more purchased products contains a list of merchants, wherein the user input data includes a selection of the merchant from the list of merchants.

3. The system of claim 1 , wherein the one or more purchased products are one or more canned items.

4. The system of claim 1 , wherein one or more weight sensors, one or more volume sensors, 3D image recognition techniques, or a combination thereof are used to detect the number of the one or more purchased products.

5. The system of claim 1 , wherein the system is a mobile phone, a virtual reality headset, or a personal computer.

6. The system of claim 1 , wherein the virtual environmental data comprises product price information, product stock information, related products, available merchants, transaction options, user credential options, aesthetic visual effects, or a combination thereof.

7. The system of claim 1 , wherein the one or more processors are further configured to execute the instructions to select the merchant terminal based on the one or more objects present in the physical environment.

8. A system comprising:
one or more processors; and
a memory in communication with the one or more processors and storing instructions that, when executed by the one or more processors, are configured to cause the system to:
receive, from a computing device, environmental data comprising visual information representing a physical environment;
detect, based on the environmental data, one or more purchased products by identifying one or more objects present in the physical environment;
determine that a number of the one or more purchased products is below a predetermined threshold;
augment the environmental data by adding virtual environmental data comprising a prompt to buy more of the one or more purchased products;
cause the computing device to display the augmented environmental data;
receive user input data associated with one or more of the purchased products from the computing device, wherein receiving the user input data comprises:
detecting a visual command in the environmental data, the visual command comprising a gesture made in a visual field of the computing device; and
selecting a merchant based on the detection of the visual command; and

provide, based on the user input data, purchase request data to a merchant terminal associated with a merchant to enable a transaction related to the one or more purchased products.

9. The system of claim 8 , wherein the virtual environmental data comprises product price information, product stock information, related products, available merchants, transaction options, user credential options, aesthetic visual effects, or a combination thereof.

10. The system of claim 8 , wherein the computing device comprises a mobile phone, a virtual reality headset, or a personal computer.

11. The system of claim 8 , wherein the one or more processors are further configured to execute the instructions to select the merchant terminal based on the one or more objects present in the physical environment.

12. The system of claim 8 , wherein a set of user credentials is selected based on the one or more objects present in the physical environment.

13. The system of claim 12 , wherein one of the one or more purchased products is a representative object that is related to the set of user credentials.

14. The system of claim 8 , wherein detecting the one or more purchased products further comprises identifying visual indicia in the visual information, and
wherein the visual indicia comprises one or more of a text string, a symbol, a group of symbols, a UPC code, a QR code, or combinations thereof.

15. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause a computer system to:
receive, from a computing device, environmental data comprising visual information representing a physical environment;
detect one or more purchased products by identifying one or more objects present in the physical environment;
determine that a number of the one or more purchased products is below a predetermined threshold;
augment the environmental data by adding virtual environmental data comprising a prompt to buy more of the one or more purchased products;
cause the computing device to display the augmented environmental data;
receive user input data associated with one or more of the purchased products from the computing device, wherein receiving the user input data comprises:
detecting a visual command in the environmental data, the visual command comprising a gesture made in a visual field of the computing device; and
selecting a merchant based on the detection of the visual command; and

provide, based on the user input data, purchase request data to a merchant terminal associated with a merchant to enable a transaction related to the one or more purchased products.

16. The non-transitory computer-readable medium of claim 15 , wherein the virtual environmental data comprises product price information, product stock information, related products, available merchants, transaction options, user credential options, aesthetic visual effects, or a combination thereof.

17. The non-transitory computer-readable medium of claim 15 , wherein detecting the one or more purchased products further comprises identifying visual indicia in the visual information, and
wherein the visual indicia comprises one or more of a text string, a symbol, a group of symbols, a UPC code, a QR code, or combinations thereof.

18. The non-transitory computer-readable medium of claim 15 , wherein the one or more purchased products are one or more canned items.

19. The non-transitory computer-readable medium of claim 15 , wherein the instructions are further configured to cause the computer system to select the merchant terminal based on the one or more objects present in the physical environment.

20. The non-transitory computer-readable medium of claim 15 , wherein the computing device comprises a mobile phone, a virtual reality headset, or a personal computer.

Assignees

• Capital One Services Llc

Inventors

• Jacobs Drew
• Wishne Justin
• Nickerson Karen
• Smith Justin
• Giampaolo Marco S
• Jouhikainen Hannes

Classifications

• G06Q20/10 Primary

  specially adapted for electronic funds transfer [EFT] systems; specially adapted for home banking systems · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06Q10/087

  Inventory or stock management, e.g. order filling, procurement or balancing against orders · CPC title

• G06Q20/20

  Point-of-sale [POS] network systems · CPC title

• G06Q20/208

  Input by product or record sensing, e.g. weighing or scanner processing · CPC title