Object mapping techniques for mobile augmented reality applications

Patent metadata

Field	Value
Publication number	US-9623334-B2
Application number	US-201414560064-A
Country	US
Kind code	B2
Filing date	Dec 4, 2014
Priority date	Dec 22, 2010
Publication date	Apr 18, 2017
Grant date	Apr 18, 2017

Abstract

Techniques are disclosed that involve mobile augmented reality (MAR) applications in which users (e.g., players) may experience augmented reality (e.g., altered video or audio based on a real environment). Such augmented reality may include various alterations. For example, particular objects may be altered to appear differently. Such alterations may be based on stored profiles and/or user selections. Further features may also be employed. For example, in embodiments, characters and/or other objects may be sent (or caused to appear) to other users in other locations. Also, a user may leave a character at another location and receive an alert when another user/player encounters this character. Also, characteristics of output audio may be affected based on events of the MAR application.

First claim

The invention claimed is:

1. A method, comprising:
capturing a video stream using a wearable camera of a first platform to generate an incoming video stream;
identifying an object in one or more images from an incoming video stream and generating feature data describing size and position of the identified object in an object recognition module of the first platform;
matching the identified object to a profile in a character profile database, the character profile database including an action associated with the identified object;
based on a profile corresponding to the identified object in the character profile database, generating an alteration of the identified object including overlaying an image from the character profile database over the identified object in the incoming video stream;
displaying the alteration of the identified object at the first platform;
propagating the alteration to a second platform through a wireless communications interface of the first platform; and
display the alteration of the identified object at the second platform.

2. The method of claim 1 , wherein said altering comprises:
receiving an incoming video stream, the incoming video stream including the one or more images; and
generating an output video stream, the output video stream including the alteration of the identified object.

3. The method of claim 1 :
wherein the alteration of the identified object appears as a virtual object associated with a mobile augmented reality (MAR) application; and
wherein the profile includes an association between an object type of the identified object and the virtual object.

4. The method of claim 3 , further comprising:
receiving the association from a user of the MAR application.

5. The method of claim 3 , further comprising changing the association based on a user selection.

6. The method of claim 3 , further comprising:
providing a communications band between two or more users of the MAR application, and
interrupting the communications band based on an event of the MAR application.

7. The method of claim 6 , wherein the communications band provides for audio communications among the two or more users.

8. The method of claim 1 , wherein the identified object is a character of a mobile augmented reality (MAR) application, and wherein the alteration changes an appearance of the character.

9. The method of claim 1 , wherein the alteration comprises a removal of the identified object.

10. The method of claim 1 , wherein the identified object is an object being handled by a user of a mobile augmented reality (MAR) application.

11. The method of claim 1 , further comprising:
providing one or more activation parameters for a virtual object; and
when a circumstance of a mobile augmented reality (MAR) application user matches the one or more activation parameters, rendering the virtual object in the output video stream.

12. The method of claim 11 , wherein the one or more activation parameters includes a location and/or a time.

13. An apparatus comprising:
a wearable camera to capture a video stream to generate an incoming video stream;
a storage medium to store an association between a real object type and a virtual object in an object association module and to store a character profile database having profiles and actions associated with identified objects;
a video processing module to identify a real object within the incoming video stream to generate feature data describing size and position of the identified object, to match the identified object to a profile in the character profile database, and to, based on the association, generate an alteration to the object for an output video stream including overlaying an image from the character profile database over the identified object in the incoming video stream; and
a wireless communications interface to propagate the alteration to a second apparatus for display of the alternation of the identified object at the second apparatus.

14. The apparatus of claim 13 , further comprising an output device to display the alteration.

15. The apparatus of claim 13 , wherein the object is a character of a mobile augmented reality (MAR) application.

16. The apparatus of claim 13 :
wherein the associated actions comprise one or more activation parameters for a virtual object; and
wherein the video processing module is to render the virtual object when a circumstance of a mobile augmented reality (MAR) application user matches the one or more activation parameters.

17. A system, comprising:
a plurality of user platforms to provide a mobile augmented reality (MAR) application for a corresponding plurality of users, wherein each of the user platforms includes:
a wearable camera to capture a video stream to generate an incoming video stream;
a storage medium to store an association between a real object type and a virtual object in an object association module and to store a character profile database having profiles and actions associated with identified objects; and
a video processing module to identify a real object within the incoming video stream to generate feature data describing size and position of the identified object, to match the identified object to a profile in the character profile database, and to, based on the association, generate an alteration to the object for an output video stream including overlaying an image from the character profile database over the identified object in the incoming video stream; and
a wireless communications interface to propagate the alteration to a second user platform for display of the alteration of the identified object at the second user platform.

18. The system of claim 17 , wherein a first of the user platforms receives an alert when a user of a second of the plurality of user platforms encounters a character placed by a user of the first user platform at a remote location.

19. The system of claim 17 , wherein a first of the user platforms and a second of the user platforms is each to display an object having results, the results from users of the first and second user platforms.

20. An article comprising a non-transitory machine-accessible medium having stored thereon instructions that, when executed by a machine, cause the machine to perform operations comprising:
capturing a video stream using a wearable camera of a first platform to generate an incoming video stream;
identifying an object in one or more images from an incoming video stream and generating feature data describing size and position of the identified object in an object recognition module of the first platform;
matching the identified object to a profile in a character profile database, the character profile database including an action associated with the identified object;
based on the profile corresponding to the identified object in the character profile database, generating an alteration of the identified object including overlaying an image from the character profile database over the identified object in the incoming video stream;
displaying the alteration of the identified object at the first platform; and
propagating the alteration to a second platform through a wireless communications interface of the first platform for display of the alteration of the identified object at the second platform.

Assignees

• Intel Corp

Inventors

• Anderson Glen J
• Ganapathy Subhashini

Classifications

• A63F2300/8082

  Virtual reality · CPC title

• H04N21/4788

  communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)} · CPC title

• G09G2370/16

  Use of wireless transmission of display information · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• H04N21/41407

  embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57) · CPC title