Methods and systems for displaying virtual objects from an augmented reality environment on a multimedia device

Patent metadata

Field	Value
Publication number	US-11875469-B2
Application number	US-202218050654-A
Country	US
Kind code	B2
Filing date	Oct 28, 2022
Priority date	Apr 14, 2020
Publication date	Jan 16, 2024
Grant date	Jan 16, 2024

Abstract

Methods and systems are disclosed for displaying an augmented reality virtual object on a multimedia device. One method comprises detecting, in an augmented reality environment displayed using a first device, a virtual object; detecting, within the augmented reality environment, a second device, the second device comprising a physical multimedia device; and generating, at the second device, a display comprising a representation of the virtual object.

First claim

What is claimed is:

1. A method for prompting an updated display of one or more virtual objects at a multimedia device, the method comprising:
detecting, in an augmented reality environment displayed using a first device, the one or more virtual objects;
determining, within the augmented reality environment, an object identifier associated with the one or more virtual objects;
receiving, by the first device, a user input comprising an interaction with the one or more virtual objects;
retrieving, by the first device, a stored representation of the one or more virtual objects based on the determined object identifier;
detecting, a second device associated with the augmented reality environment; and
displaying, by the first device, the retrieved stored representation of the one or more virtual objects to the second device.

2. The method of claim 1 , wherein the user device comprises an augmented reality device connected to the second device via a virtual network.

3. The method of claim 1 , wherein the interaction is a user selection of the one or more virtual objects.

4. The method of claim 3 , wherein the user selection comprises a touch gesture or a voice command.

5. The method of claim 1 , wherein the user input is received via a controller associated with the user device, and wherein the interaction comprises a selection to rotate, zoom in, zoom out, change color, change dimensions of the one or more virtual objects, purchase the one or more virtual objects, view items related to the one or more virtual objects, display the one or more virtual objects with one or more other virtual objects, or a combination thereof.

6. The method of claim 1 , wherein the stored representation includes: a 3D model, a 2D image, a schematic diagram, a photographic image, an icon, or a stored depiction.

7. The method of claim 1 , wherein the one or more virtual objects is displayed at the user device and at the second device simultaneously.

8. The method of claim 1 , further comprising:
prompting, by the user device, a display of at least a portion of the augmented reality environment on the second device,
wherein the portion of the augmented reality environment includes background scenic features.

9. The method of claim 1 , further comprising:
prompting, by the user device, a display of a payment interface for purchase of the one or more virtual objects.

10. The method of claim 9 , further comprising:
determining, by the user device, transaction specifications associated with the one or more virtual objects, the transaction specifications including weight, price, delivery information, color, geometric dimensions, promotional code(s), user review(s), image(s) of the one or more virtual objects, size information, use information, material composition, nutritional information, dosage, serving size, ingredient information, warnings, warranty information, or a combination thereof; and
prompting, by the user device, the display of the payment interface to include the transaction specifications.

11. A user device for prompting an updated display of one or more virtual objects at a multimedia device, the user device comprising:
one or more processors; and
a data storage comprising instructions which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
detecting, in an augmented reality environment displayed, the one or more virtual objects;
determining, within the augmented reality environment, an object identifier associated with the one or more virtual objects;
receiving a user input comprising an interaction with the one or more virtual objects;
retrieving a stored representation of the one or more virtual objects based on the determined object identifier;
detecting the multimedia device associated with the augmented reality environment; and
displaying the retrieved stored representation of the one or more virtual objects to the multimedia device.

12. The user device of claim 11 , wherein the user device comprises an augmented reality device connected to the multimedia device via a virtual network.

13. The user device of claim 11 , wherein the interaction is a user selection of the one or more virtual objects.

14. The user device of claim 13 , wherein the user selection comprises a touch gesture or a voice command.

15. The user device of claim 11 , wherein the user input is received via a controller associated with the user device, and wherein the interaction comprises a selection to rotate, zoom in, zoom out, change color, change dimensions of the one or more virtual objects, purchase the one or more virtual objects, view items related to one or more virtual objects, display the one or more virtual objects with one or more other virtual objects, or a combination thereof.

16. The user device of claim 11 , wherein the stored representation includes: a 3D model, a 2D image, a schematic diagram, a photographic image, an icon, or a stored depiction.

17. The user device of claim 11 , wherein the one or more virtual objects are displayed at the user device and at the multimedia device simultaneously.

18. The user device of claim 11 , wherein the operations further comprise prompting the display of at least a portion of the augmented reality environment on the multimedia device, and wherein the portion of the augmented reality environment includes background scenic features.

19. The user device of claim 11 , wherein the operations further comprise:
prompting the display of a payment interface for purchase of the one or more virtual objects;
determining transaction specifications associated with the one or more virtual objects, the transaction specifications including weight, price, delivery information, color, geometric dimensions, promotional code(s), user review(s), image(s) of the object, size information, use information, material composition, nutritional information, dosage, serving size, ingredient information, warnings, warranty information, or a combination thereof; and
prompting the display of the payment interface to include the transaction specifications.

20. A non-transitory computer readable medium comprising instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:
detecting, in an augmented reality environment displayed using a first device, the one or more virtual objects;
determining, within the augmented reality environment, an object identifier associated with the one or more virtual objects;
receiving, by the first device, a user input comprising an interaction with the one or more virtual objects;
retrieving, by the first device, a stored representation of the one or more virtual objects based on the determined object identifier;
detecting, a second device associated with the augmented reality environment; and
displaying, by the first device, the retrieved stored representation of the one or more virtual objects to the second device.

Assignees

• Worldpay Ltd

Inventors

• Gordon Kevin
• Spender Charlotte

Classifications

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06Q20/123

  Shopping for digital content · CPC title