Systems and methods of sharing an augmented environment with a companion

Patent metadata

Field	Value
Publication number	US-12288250-B2
Application number	US-202318538376-A
Country	US
Kind code	B2
Filing date	Dec 13, 2023
Priority date	Dec 22, 2016
Publication date	Apr 29, 2025
Grant date	Apr 29, 2025

Abstract

A system includes one or more memory devices storing instructions, and one or more processors configured to execute the instructions to perform steps of a method for providing an interactive virtual environment. The system may receive environmental data, and augment the environmental data by adding virtual environmental data. The system may then provide this virtual environment to two or more devices. The system can then receive user input, and modify the virtual environment in response to those inputs.

First claim

What is claimed is:

1. A first user device comprising:
one or more processors;
a screen to display a first graphical user interface (GUI); and
memory in communication with the one or more processors, and the screen, the memory including instructions that, when executed, cause the one or more processors to:
transmit, to a computing device, first environmental data comprising first visual information representing a physical environment;
receive, from the computing device, virtual environmental data comprising indicator display data unrepresented in the physical environment;
display, via the first GUI, the virtual environmental data overlaying the physical environment to provide an augmented environment;
receive, from the computing device and based on a first input from a second user device, modified virtual environmental data, wherein the first input is associated with one or more predefined user inputs comprising a modification of a product displayed in the augmented environment; and
display, via the first GUI, the modified virtual environmental data overlaying the physical environment to provide a modified augmented environment.

2. The first user device of claim 1 , wherein the instructions further cause the one or more processors to:
transmit, to the computing device, a request to place a virtual marker at a virtual location corresponding to a physical location in the physical environment.

3. The first user device of claim 1 , wherein the physical environment is a merchant location associated with a merchant.

4. The first user device of claim 3 , wherein the instructions, when executed, further cause the one or more processors to:
transmit, to the computing device, a purchase request to purchase a product associated with the modified augmented environment;
transmit, to a financial service provider, a purchase authorization request corresponding to the purchase request to purchase the product associated with the modified augmented environment; and
responsive to receiving authorization from the financial service provider, transmit the purchase request to the merchant.

5. The first user device of claim 1 , wherein the virtual environmental data includes one or more of product price information, product inventory information, product manufacturing information, product marketing information or description, product ratings or reviews, social information, related products, available discounts, and aesthetic visual effects.

6. The first user device of claim 1 , comprising a mobile phone, a virtual reality headset, an augmented reality headset, a wearable device, an internet of things (IoT) device, a tablet computer, a personal computer, or combinations thereof.

7. The first user device of claim 1 , wherein the first input comprises one or more of a touch, a gesture, a vocal command, or combinations thereof.

8. The first user device of claim 1 , wherein the one or more predefined user inputs comprise a selection of a product displayed in the augmented environment.

9. The first user device of claim 1 , wherein the modification of the product displayed in the augmented environment comprises one or more of a color change, a size change, and a style change.

10. A first user device comprising:
one or more processors;
a screen to display a first graphical user interface (GUI); and
memory in communication with the one or more processors, and the screen, the memory including instructions that, when executed, cause the one or more processors to:
receive, from a computing device and based on a first request from a second user device, first environmental data comprising first visual information representing a physical environment;
receive, from the computing device and based on the first request, virtual environmental data comprising indicator display data unrepresented in the physical environment;
display, via the first GUI, the virtual environmental data overlaying the first environmental data to provide a virtual environment;
receive, via the first GUI, a first input corresponding to an instruction to modify the indicator display data, wherein the first input is associated with one or more predefined user inputs comprising a modification of a product displayed in the virtual environment;
transmit, to the computing device, the first input;
receive, from the computing device and based on the first input, modified virtual environmental data; and
display, via the first GUI, the modified virtual environmental data overlaying the first environmental data to provide a modified virtual environment.

11. The first user device of claim 10 , wherein the instructions further cause the one or more processors to:
display, via the first GUI and based on a second request from the second user device, a virtual marker at a virtual location corresponding to a physical location in the physical environment.

12. The first user device of claim 10 , wherein the physical environment is a merchant location associated with a merchant.

13. The first user device of claim 12 , wherein the instructions, when executed, further cause the one or more processors to:
transmit, to the computing device, a purchase request to purchase a product associated with the modified virtual environment;
transmit, to a financial service provider, a purchase authorization request corresponding to the purchase request to purchase the product associated with the modified virtual environment; and
responsive to receiving authorization from the financial service provider, transmit the purchase request to the merchant.

14. The first user device of claim 10 , comprising a mobile phone, a virtual reality headset, an augmented reality headset, a wearable device, an internet of things (IoT) device, a tablet computer, a personal computer, or combinations thereof.

15. The first user device of claim 10 , wherein the first input comprises one or more of a touch, a gesture, a vocal command, or combinations thereof.

16. The first user device of claim 10 , wherein the modification of the product displayed in the virtual environment comprises one or more of a color change, a size change, and a style change.

17. A first user device comprising:
one or more processors;
a screen to display a first graphical user interface (GUI); and
memory in communication with the one or more processors, and the screen, the memory including instructions that, when executed, cause the one or more processors to:
receive, from a computing device and based on a first request from a second user device, first environmental data comprising first visual information representing a physical environment;
receive, from the computing device and based on the first request, virtual environmental data comprising indicator display data unrepresented in the physical environment;
display, via the first GUI, the virtual environmental data overlaying the first environmental data to provide a virtual environment;
receive, via the first GUI, a first input corresponding to an instruction to modify the indicator display data, wherein the first input is associated with one or more predefined user inputs comprising a modification of a product displayed in the virtual environment, and wherein the first input comprises a touch, a gesture, a vocal command, or combinations thereof;
transmit, to the computing device, the first input;
receive, from the computing device and based on the first input, modified virtual environmental data; and
display, via the first GUI, the modified virtual environmental data overlaying the first environmental data to provide a modified

Assignees

• Capital One Services Llc

Inventors

• Nickerson Karen
• Wishne Justin
• Jacobs Drew
• Smith Justin
• Giampaolo Marco S
• Jouhikainen Hannes

Classifications

• G06Q30/0601

  Electronic shopping [e-shopping] · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G09G2370/02

  Networking aspects · CPC title

• G06F3/147

  using display panels · CPC title

• G06T11/00

  Two-dimensional [2D] image generation · CPC title