Augmented reality enabled dynamic product presentation

Patent metadata

Field	Value
Publication number	US-12347046-B2
Application number	US-202418444437-A
Country	US
Kind code	B2
Filing date	Feb 16, 2024
Priority date	May 25, 2022
Publication date	Jul 1, 2025
Grant date	Jul 1, 2025

Abstract

Systems and methods described herein allow a customer to employ AR/VR software to generate virtual representations of physical spaces (e.g., house) and sub-spaces (e.g., living room) to preview virtual objects situated in AR/VR virtual environments. A commerce system (or mobile app associated with the commerce system) may generate virtualized environments representing a physical space (e.g., house, apartment) and regions (e.g., living room, kitchen) based on source images uploaded to or otherwise captured by the commerce system. The end-user may operate the software on a client device and interacts with VR or AR presentations of the virtual environment using a voice-based interface recognized by the software. For example, the end-user may say the name of room (region) or an object and the system retrieves data of the identified room or an appropriate room, such as virtual representations of furniture or objects situated in the room.

First claim

What is claimed is:

1. A computer-implemented method comprising:
obtaining, by a computer, a first utterance indicating an object;
providing for display, by the computer, a three-dimensional environment representing a physical space, the three-dimensional environment including a virtual object representing the object indicated by the first utterance; and
obtaining, by the computer, a second utterance providing a checkout instruction, the checkout instruction of the second utterance indicating the virtual object situated in the three-dimensional environment for a purchase transaction.

2. The method according to claim 1 , wherein the three-dimensional environment includes an augmented reality representation comprising the virtual object situated in an image of the physical space obtained via a camera feed,
wherein the method further comprises:
obtaining, by the computer, an instruction to change the three-dimensional environment from the augmented reality representation to a virtual reality representation of the physical space of the three-dimensional environment; and
providing for display, by the computer, the virtual reality representation including the virtual object representing the object situated in the virtual reality representation.

3. The method according to claim 1 , further comprising:
obtaining, by the computer, source image data via a camera feed for a region of the physical space;
determining, by the computer, one or more attributes of the three-dimensional environment based upon the source image data for the region of the physical space; and
generating, by the computer, the three-dimensional environment comprising an augmented reality representation of the region of the physical space in the camera feed based upon the one or more attributes of the three-dimensional environment and the virtual object positioned in the augmented reality representation.

4. The method according to claim 1 , further comprising:
obtaining, by the computer, a source image data for a region of the physical space;
determining, by the computer, one or more attributes of the three-dimensional environment based upon the source image data for the region of the physical space; and
generating, by the computer, the three-dimensional environment comprising a virtual reality representation of the region of the physical space based upon the one or more attributes of the three-dimensional environment and the virtual object positioned in the virtual reality representation.

5. The method according to claim 1 , further comprising updating, by the computer, one or more attributes of the three-dimensional environment representing a region of the physical space based upon source image data for the region of the physical space.

6. The method according to claim 1 , further comprising:
obtaining, by the computer, a location of a client device, wherein the three-dimensional environment is provided for display at the client device; and
generating, by the computer, a type of representation of the three-dimensional environment based upon the location of the client device relative to the physical space, wherein the type of representation includes at least one of an augmented reality representation or a virtual reality representation.

7. The method according to claim 1 , further comprising determining, by the computer, the position of the virtual object according to one or more attributes of the virtual object and a plurality of spatial parameters of the three-dimensional environment.

8. The method according to claim 7 , further comprising identifying, by the computer, a positioning collision in the three-dimensional environment based upon the position determined for the virtual object and a second position of a second virtual object representing a second object in the three-dimensional environment.

9. The method according to claim 1 , further comprising updating, by the computer, one or more attributes of the virtual object in the three-dimensional environment based upon updated media data including the object represented by the virtual object.

10. The method according to claim 1 , further comprising selecting, by the computer, a region of the physical space to be represented in the three-dimensional virtual environment based upon a user input associated with the first utterance.

11. A system comprising:
a computer comprising at least one processor configured to:
obtain a first utterance indicating an object;
provide for display a three-dimensional environment representing a physical space, the three-dimensional environment including a virtual object representing the object indicated by the first utterance; and
obtain a second utterance providing a checkout instruction, the checkout instruction of the second utterance indicating the virtual object situated in the three-dimensional environment for a purchase transaction.

12. The system according to claim 11 , wherein the three-dimensional environment includes an augmented reality representation comprising the virtual object situated in an image of the physical space obtained via a camera feed,
wherein the at least one processor of the computer is further configured to:
obtain an instruction to change the three-dimensional environment from the augmented reality representation to a virtual reality representation of the physical space of the three-dimensional environment; and
provide the virtual reality representation including the virtual object representing the object situated in the virtual reality representation.

13. The system according to claim 11 , wherein the at least one processor of the computer is further configured to:
obtain source image data via a camera feed for a region of the physical space;
determine one or more attributes of the three-dimensional environment based upon the source image data for the region of the physical space; and
generate the three-dimensional environment comprising an augmented reality representation of the region of the physical space in the camera feed based upon the one or more attributes of the three-dimensional environment and the virtual object positioned in the augmented reality representation.

14. The system according to claim 11 , wherein the at least one processor of the computer is further configured to:
obtain a source image data for a region of the physical space;
determine one or more attributes of the three-dimensional environment based upon the source image data for the region of the physical space; and
generate the three-dimensional environment comprising a virtual reality representation of the region of the physical space based upon the one or more attributes of the three-dimensional environment and the virtual object positioned in the virtual reality representation.

15. The system according to claim 11 , wherein the at least one processor of the computer is further configured to update one or more attributes of the three-dimensional environment representing a region of the physical space based upon source image data for the region of the physical space.

16. The system according to claim 11 , wherein the at least one processor of the computer is further configured to:
obtain a location of a client device, wherein the three-dimensional environment is provided for display at the client device; and
generate a type of representation of the three-dimensional environment based upon the location of the client device relative to the physical space, wherein the type of representation includes at least one of an augmented reality representation or a virtual reality representation.

17

Assignees

• Shopify Inc

Inventors

• Beauchamp Daniel
• Delgado Byron Leonel
• Wade Jonathan

Classifications

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06Q30/0643 Primary

  graphically representing goods, e.g. 3D product representation · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title