Providing advertisements in an augmented reality environment

Patent metadata

Field	Value
Publication number	US-9536251-B2
Application number	US-201113296236-A
Country	US
Kind code	B2
Filing date	Nov 15, 2011
Priority date	Nov 15, 2011
Publication date	Jan 3, 2017
Grant date	Jan 3, 2017

Abstract

A computer-implemented method for providing advertisements in an augmented reality environment to a user includes receiving data related to a marker, the marker placed amongst one or more physical objects captured by the video camera. The computer-implemented method also includes retrieving dynamic digital content associated with the marker. Further, the computer-implemented method includes displaying the dynamic digital content amongst the one or more physical objects. Furthermore, the computer-implemented method includes receiving a user interaction with the dynamic digital content. Moreover, the computer-implemented method includes performing an action based on the user interaction.

First claim

What is claimed is:

1. A computer-implemented method for providing dynamic digital content within an augmented reality environment by an augmented reality framework, comprising:
receiving, from a client device connected to an augmented reality network in communication with the augmented reality framework, image data captured by a video camera device of the client device that depicts a marker, wherein the marker includes a specific pattern corresponding to a first dynamic digital content and the marker covers, at least in part, a physical product;
receiving, from the client device, first factor information corresponding to a first user;
retrieving first dynamic digital content from a database based on the specific pattern of the marker and the first factor information;
transmitting the first dynamic digital content to the client device for generating a first augmented reality environment on the client device that combines a first current video stream captured by the video camera device and a first virtual video stream including the first dynamic digital content;
receiving, from the client device, second factor information corresponding to a second user;
retrieving second dynamic digital content from the database based on the second factor information;
transmitting the second dynamic digital content to the client device for generating a display of a second augmented reality environment on the client device that combines a second current video stream captured by the video camera device and a second virtual video stream including the second dynamic digital content, wherein the second dynamic digital content is dynamically updated from the first dynamic digital content based on the specific pattern of the marker and the second factor information, the second dynamic digital content having display attributes displayable in accordance with a display capability of the client device;
receiving a user interaction with the second dynamic digital content detected by the client device; and
performing an action based on the user interaction.

2. The method of claim 1 , wherein the first dynamic digital content comprises an advertisement related to the physical product.

3. The method of claim 1 , further comprising:
converting the marker to a network address, wherein the dynamic digital content is retrieved using the network address.

4. The method of claim 1 , wherein the marker comprises a QR code marker.

5. The method of claim 1 , wherein a video renderer running on the client device is configured to combine the second current video stream and the second virtual video stream into a single video stream.

6. The method of claim 1 , further comprising:
adjusting the second dynamic digital content based on detected movements of the video camera device in relation to the markers.

7. A non-transitory computer-readable medium storing instructions that when executed by a processor included in an augmented reality framework, performs a method for providing dynamic digital content within an augmented reality environment, comprising:
receiving, from a client device connected to an augmented reality network in communication with the augmented reality framework, image data related to a marker captured by the video camera device as covering, at least in part, a physical product, wherein the marker depicts a specific pattern corresponding to dynamic digital content;
receiving, from the client device, first factor information corresponding to a first user;
retrieving first dynamic digital content from a database based on the specific pattern of the marker and the first factor information;
transmitting the first dynamic digital content to the client device for generating a first augmented reality environment on the client device that combines a first current video stream captured by the video camera device and a first virtual video stream including the first dynamic digital content;
receiving, from the client device, second factor information corresponding to a second user;
retrieving second dynamic digital content from the database based on the second factor information;
transmitting the second dynamic digital content to the client device for generating a display of a second augmented reality environment on the client device that combines a second current video stream captured by the video camera device and a second virtual video stream including the second dynamic digital content, wherein the second dynamic digital content is dynamically updated from the first dynamic digital content based on the specific pattern of the marker and the second factor information, the second dynamic digital content having display attributes displayable in accordance with a display capability of the client device;
receiving a user interaction with the second dynamic digital content detected by the client device; and
performing an action based on the user interaction.

8. The non-transitory computer-readable medium of claim 7 , wherein the first dynamic digital content comprises an advertisement related to the physical product.

9. The non-transitory computer-readable medium of claim 7 , further comprising:
converting the marker to a network address, wherein the dynamic digital content is retrieved using the network address.

10. The non-transitory computer-readable medium of claim 7 , wherein the marker comprises a QR code marker.

11. The non-transitory computer-readable medium of claim 7 , wherein a video renderer running on the client device is configured to combine the second current video stream and the second virtual video stream into a single video stream.

12. The non-transitory computer-readable medium of claim 7 , further comprising:
adjusting the second dynamic digital content based on movements of the video camera device in relation to the markers.

13. A computing device within an augmented reality framework for providing dynamic digital content within an augmented reality environment, comprising:
a network interface in communication with a client device through an augmented reality network, and configured to:
receive, from the client device, image data captured by a video camera device of the client device that depicts a marker, wherein the marker includes a specific pattern corresponding to a first dynamic digital content and the marker covers, at least in part, a physical product;
receive, from the client device, first factor information corresponding to a first user;
retrieve first dynamic digital content from a database, wherein the first dynamic digital content is received based on the specific pattern of the marker and the first factor information;
receive, from the client device, second factor information corresponding to a second user;
retrieve second dynamic digital content from a database, wherein the second dynamic digital content is received based on the specific pattern of the marker and the second factor information; and

a dynamic digital content processor configured to:
control the network interface to transmit the first dynamic digital content to the client device for generating a first augmented first augmented reality environment for presentation on the client device that combines a first current video stream captured by the video camera device and a first virtual video stream including the first dynamic digital content;
control the network interface to transmit the second dynamic digital content to the client device for generating a second augmented first augmented reality environment for presentation on the client device that combines a second current video stream captured by the video camera device and a second virtual video stream including the

Assignees

• Huang Wyatt (Ling-Wei)
• Chang Balduran (Chia-Chun)
• Huang Connie (Shih-Ting)
• Excalibur Ip Llc

Inventors

• Huang Wyatt (Ling-Wei)
• Chang Balduran (Chia-Chun)
• Huang Connie (Shih-Ting)

Classifications

• G06Q30/0267 Primary

  Wireless devices · CPC title

• G06Q30/0255 Primary

  based on user history · CPC title

• G06K7/1417

  2D bar codes · CPC title

• G06F3/005

  Input arrangements through a video camera · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title