Methods and systems for displaying virtual objects from an augmented reality environment on a multimedia device

Patent metadata

Field	Value
Publication number	US-12039689-B2
Application number	US-202318152909-A
Country	US
Kind code	B2
Filing date	Jan 11, 2023
Priority date	Apr 14, 2020
Publication date	Jul 16, 2024
Grant date	Jul 16, 2024

Abstract

Methods and systems are disclosed for displaying an augmented reality virtual object on a multimedia device. One method comprises detecting, in an augmented reality environment displayed using a first device, a virtual object; detecting, within the augmented reality environment, a second device, the second device comprising a physical multimedia device; and generating, at the second device, a display comprising a representation of the virtual object.

First claim

What is claimed is:

1. A computer-implemented method for displaying at least one virtual object from an augmented reality environment in a multimedia device, comprising:
generating, by an augmented reality application in a user device, a presentation of one or more virtual objects within the augmented reality environment;
receiving a selection of the at least one virtual object from the one or more virtual objects within the augmented reality environment for a shared display on the multimedia device, wherein the user device is connected to the multimedia device via a virtual network;
pairing a user interface of the user device with a user interface of the multimedia device, wherein a command for a specific action in the user interface of the user device activates a reciprocal action in the user interface of the multimedia device; and
generating a display of the at least one virtual object in the multimedia device, wherein the at least one virtual object is presented simultaneously in the user device and the multimedia device.

2. The computer-implemented method of claim 1 , wherein the presentation of the one or more virtual objects within the augmented reality environment, further comprises:
receiving, by the augmented reality application of the user device, a visual input that represents a physical environment including one or more physical objects from one or more sensors of the user device;
receiving, by the augmented reality application of the user device, contextual data associated with the physical environment from the one or more sensors of the user device; and
generating, by the augmented reality application in the user device, the augmented reality environment that represents the physical environment based, at least in part, on the visual input, wherein size, orientation, and placement of the one or more virtual objects within the augmented reality environment is based, at least in part, on the contextual data.

3. The computer-implemented method of claim 2 , wherein the contextual data includes location data, distance information, angle information, and/or motion data associated with the one or more physical objects relative to the one or more sensors of the user device.

4. The computer-implemented method of claim 1 , wherein the selection of the at least one virtual object is based upon voice-based commands and/or gesture-based commands, and wherein the gesture-based commands include dragging the at least one virtual object within the augmented reality environment from its original position to the multimedia device detected within the augmented reality environment.

5. The computer-implemented method of claim 1 , further comprising:
generating a payment interface to initiate a transaction of the at least one virtual object, wherein the payment interface is superimposed over the augmented reality environment generated by the augmented reality application and the presentation generated by the multimedia device;
generating a search request for transaction information associated with the at least one virtual object, wherein the search request includes an identifier associated with the at least one virtual object;
receiving the transaction information associated with the identifier from a database; and
generating a presentation of the transaction information with a transaction authorization request in the payment interface, wherein the transaction authorization request queries for payment authentication information and/or user credentials.

6. The computer-implemented method of claim 5 , further comprising:
transmitting the transaction authorization request to an acquirer processor server;
transmitting the transaction information to a merchant system to confirm inventory of the at least one virtual object or to perform a security verification;
receiving a transaction authorization response from the acquirer processor server and/or the merchant system, wherein the transaction authorization response indicates an authorization of payment transfer from a user's account to the merchant system; and
transmitting the transaction authorization response to the user device.

7. The computer-implemented method of claim 6 , wherein the merchant system includes a point of service (POS) terminal and/or a payment application that collects payment vehicle information, payment credentials, and/or the payment authentication information.

8. The computer-implemented method of claim 5 , further comprising:
presenting at least one feature of the augmented reality environment in the multimedia device, wherein the at least one feature of the augmented reality environment includes background scenic features of the augmented reality environment, additional information related to the at least one virtual object, or user prompts for transaction authentication.

9. The computer-implemented method of claim 5 , further comprising:
determining transaction specifications associated with the at least one virtual object, wherein the transaction specifications include weight, price, delivery information, color, geometric dimensions, promotional code(s), user review(s), image(s), size information, use information, material composition, nutritional information, dosage, serving size, ingredient information, warnings, and/or warranty information of the at least one virtual object; and
prompting the display of the payment interface to include the transaction specifications.

10. The computer-implemented method of claim 1 , further comprising:
modifying the one or more virtual objects presented within the augmented reality environment, wherein the modifications include inserting features, truncating, cropping, and/or replicating portions of the one or more virtual objects.

11. A system for displaying at least one virtual object from an augmented reality environment in a multimedia device, comprising:
one or more processors; and
at least one non-transitory computer readable medium storing instructions which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
generating, by an augmented reality application in a user device, a presentation of one or more virtual objects within the augmented reality environment;
receiving a selection of the at least one virtual object from the one or more virtual objects within the augmented reality environment for a shared display on the multimedia device, wherein the user device is connected to the multimedia device via a virtual network;
pairing a user interface of the user device with a user interface of the multimedia device, wherein a command for a specific action in the user interface of the user device activates a reciprocal action in the user interface of the multimedia device; and
generating a display of the at least one virtual object in the multimedia device, wherein the at least one virtual object is presented simultaneously in the user device and the multimedia device.

12. The system of claim 11 , wherein the presentation of the one or more virtual objects within the augmented reality environment, further comprises:
receiving, by the augmented reality application of the user device, a visual input that represents a physical environment including one or more physical objects from one or more sensors of the user device;
receiving, by the augmented reality application of the user device, contextual data associated with the physical environment from the one or more sensors of the user device; and
generating, by the augmented reality application in the user device, the augmented reality environment that represents the physical environment based, at least in part, on the visual input, wherei

Assignees

• Worldpay Ltd

Inventors

• Gordon Kevin
• Spender Charlotte

Classifications

• G06Q30/0643 Primary

  graphically representing goods, e.g. 3D product representation · CPC title

• G06T2219/2021

  Shape modification · CPC title

• G06T2219/2012

  Colour editing, changing, or manipulating; Use of colour codes · CPC title

• G06T2219/2016

  Rotation, translation, scaling · CPC title

• G06Q20/123

  Shopping for digital content · CPC title