Methods and systems for displaying virtual objects from an augmented reality environment on a multimedia device

Patent metadata

Field	Value
Publication number	US-11580714-B2
Application number	US-202117557896-A
Country	US
Kind code	B2
Filing date	Dec 21, 2021
Priority date	Apr 14, 2020
Publication date	Feb 14, 2023
Grant date	Feb 14, 2023

Abstract

Methods and systems are disclosed for displaying an augmented reality virtual object on a multimedia device. One method comprises detecting, in an augmented reality environment displayed using a first device, a virtual object; detecting, within the augmented reality environment, a second device, the second device comprising a physical multimedia device; and generating, at the second device, a display comprising a representation of the virtual object.

First claim

What is claimed is:

1. A computer-implemented method for displaying a virtual object in an augmented reality environment and a real environment, comprising:
generating, by an augmented reality application in a first device, a presentation of the virtual object and a second device within the augmented reality environment;
establishing a network connection between the first device and the second device;
generating a presentation of the virtual object in the second device, wherein the second device is a multimedia device in the real environment, and wherein the presentation includes a shared display inside and outside of the augmented reality environment; and
generating a transaction interface in the first device, the second device, or a combination thereof to initiate a transaction of the virtual object, wherein the transaction interface is superimposed over the augmented reality environment in the first device and the presentation in the second device.

2. The computer-implemented method of claim 1 , further comprising:
receiving a selection of the virtual object from one or more user interface elements of the transaction interface; and
generating a search request for a transaction information of the selected virtual object based, at least in part, on the selection, wherein the search request includes an identifier associated with the selected virtual object.

3. The computer-implemented method of claim 2 , further comprising:
receiving the transaction information associated with the identifier from a user library, wherein a data stored in the user library is in sync with the first device, the second device, or a combination thereof;
generating a presentation of the transaction information in the transaction interface of the first device, the second device, or a combination thereof; and
transmitting a transaction authorization request based, at least in part, on the transaction information, wherein the transaction authorization request includes payment authentication information, user credentials, or a combination thereof.

4. The computer-implemented method of claim 1 , wherein the virtual object is displayed simultaneously in the first device and the second device or sequentially in the first device and the second device.

5. The computer-implemented method of claim 1 , further comprising:
differentiating the virtual object from one or more background displays in the augmented reality environment;
determining an identifier for the virtual object;
retrieving a stored representation of the virtual object from a user library based, at least in part, on the identifier; and
casting the stored representation of the virtual object to the first device, the second device, or a combination thereof, wherein the casting is based on establishing a connection via a near field communication.

6. The computer-implemented method of claim 1 , further comprising:
pairing a user interface of the first device with a user interface of the second device, wherein a screen command for a specific action in the user interface of the first device prompts a reciprocal action in the user interface of the second device.

7. The computer-implemented method of claim 1 , further comprising:
presenting at least one feature of the augmented reality environment in the first device and at least one other feature of the augmented reality environment in the second device, wherein a user interface element for selecting the virtual object is presented in the first device, and wherein a background scenic features of the augmented reality environment is presented in the second device.

8. The computer-implemented method of claim 1 , further comprising:
generating a presentation of a user history menu within the augmented reality environment of the first device, the interface of the second device, or a combination thereof, wherein the user history menu indicates previously purchased items by a user; and
receiving a request to search the user history menu to determine whether the selected virtual object has been previously purchased by the user.

9. The computer-implemented of claim 1 , further comprising:
selecting the virtual object for display at the second device by framing the second device within a frame of the first device; and
tapping the virtual object.

10. The computer-implemented of claim 1 , wherein the presentation include modifications to the virtual object, and wherein the modifications include truncating, cropping, replicating portions, inserting features, or a combination thereof.

11. A system for displaying a virtual object in an augmented reality environment and a real environment, comprising:
generating, by an augmented reality application in a first device, a presentation of the virtual object and a second device within the augmented reality environment;
establishing a network connection between the first device and the second device;
generating a presentation of the virtual object in the second device, wherein the second device is a multimedia device in the real environment, and wherein the presentation includes a shared display inside and outside of the augmented reality environment; and
generating a transaction interface in the first device, the second device, or a combination thereof to initiate a transaction of the virtual object, wherein the transaction interface is superimposed over the augmented reality environment in the first device and the presentation in the second device.

12. The system of claim 11 , further comprising:
receiving a selection of the virtual object from one or more user interface elements of the transaction interface; and
generating a search request for a transaction information of the selected virtual object based, at least in part, on the selection, wherein the search request includes an identifier associated with the selected virtual object.

13. The system of claim 12 , further comprising:
receiving the transaction information associated with the identifier from a user library, wherein a data stored in the user library is in sync with the first device, the second device, or a combination thereof;
generating a presentation of the transaction information in the transaction interface of the first device, the second device, or a combination thereof; and
transmitting a transaction authorization request based, at least in part, on the transaction information, wherein the transaction authorization request includes payment authentication information, user credentials, or a combination thereof.

14. The system of claim 11 , wherein the virtual object is displayed simultaneously in the first device and the second device or sequentially in the first device and the second device.

15. The system of claim 11 , further comprising:
differentiating the virtual object from one or more background displays in the augmented reality environment;
determining an identifier for the virtual object;
retrieving a stored representation of the virtual object from a user library based, at least in part, on the identifier; and
casting the stored representation of the virtual object to the first device, the second device, or a combination thereof, wherein the casting is based on establishing a connection via a near field communication.

16. The system of claim 11 , further comprising:
pairing a user interface of the first device with a user interface of the second device, wherein a screen command for a specific action in the user interface of the first device prompts a reciprocal action in the user interface of the second device.

17. The system of claim 11 , furth

Assignees

• Worldpay Ltd

Inventors

• Gordon Kevin
• Spender Charlotte

Classifications

• G06T2219/2012

  Colour editing, changing, or manipulating; Use of colour codes · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06T2219/2016

  Rotation, translation, scaling · CPC title

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06Q20/3223

  Realising banking transactions through M-devices · CPC title