Augmented reality device with predefined object data

Patent metadata

Field	Value
Publication number	US-9846965-B2
Application number	US-201313835459-A
Country	US
Kind code	B2
Filing date	Mar 15, 2013
Priority date	Mar 15, 2013
Publication date	Dec 19, 2017
Grant date	Dec 19, 2017

Abstract

Techniques for displaying an augmented reality toy. Embodiments capture a visual scene for display. The visual scene includes a first physical object and is captured using one or more camera devices. The first physical object is identified as a first predetermined object type, based on one or more object identifiers associated with the first physical object. Embodiments retrieve predefined geometric information corresponding to the first predetermined object type and render a sequence of frames for display in which the captured visual scene is augmented, based on the predefined geometric information.

First claim

What is claimed is:

1. A method of displaying a first physical object, comprising:
capturing a visual scene for display, wherein the visual scene includes the first physical object and wherein the visual scene is captured using one or more camera devices;
classifying the first physical object as a first predetermined object type, based on one or more object identifiers associated with the first physical object;
upon classifying the first physical object as the first predetermined object type, retrieving predefined geometric information corresponding to the first predetermined object type, wherein the predefined geometric information provides a three-dimensional model describing a shape of objects of the first predetermined object type, and wherein the predefined geometric information specifies a first region of the three-dimensional model and one or more augmentations applicable to the first region of the objects of the first predetermined object type;
determining which one of a plurality of configurations the first physical object is currently in, wherein the first physical object is configured to be physically manipulatable into each of the plurality of configurations; and
rendering a sequence of frames for display in which the first region of the first physical object within the captured visual scene is animated in a predefined manner depicting a virtual light source within the first physical object, based on the determined configuration of the first physical object, by applying the one or more augmentations to a first virtual object generated based on the retrieved predefined geometric information corresponding to the first physical object in the captured visual scene.

2. The method of claim 1 , wherein identifying the first physical object as the first predetermined object type further comprises:
analyzing the visual scene to determine a plurality of edges of the first physical object within the visual scene,
wherein the first predetermined object type is identified further based on the determined plurality of edges.

3. The method of claim 1 , further comprising:
measuring one or more environmental illumination characteristics of an environment in which an augmented reality device is located, wherein the environmental illumination characteristics include at least one of a position of a light source within an environment in which the augmented reality device is located, an angle of the light source, an indication of whether the light source is omnidirectional, a color of the light source, an intensity of the light source and a reflectivity value of the first physical object; and
adjusting the appearance of the augmented first physical object based on the measured one or more environmental illumination characteristics.

4. The method of claim 1 , wherein the visual scene is augmented to include one or more virtual objects, and further comprising:
determining one or more illumination effects associated with a first one of the one or more virtual objects,
wherein the visual scene is augmented further based on the determined one or more illumination effects.

5. The method of claim 1 , wherein identifying the first physical object as a first predetermined object type, based on one or more object identifiers associated with the first physical object, further comprises:
receiving a signal associated with the first physical object; and
processing the received signal to determine the one or more object identifiers that are encoded within the signal.

6. The method of claim 1 , wherein identifying the first physical object as a first predetermined object type, based on one or more object identifiers associated with the first physical object, further comprises:
detecting an embedded marker within the first physical object; and
determine the first physical object corresponds to the first predetermined object type, based on the detected embedded marker.

7. The method of claim 6 , wherein the embedded marker is embedded in the first physical object using an infrared-absorbing material, and wherein the embedded marker is detected using an infrared camera coupled to the augmented reality device.

8. The method of claim 1 , further comprising:
inserting an animated virtual character into the visual scene,
wherein the animated virtual character is depicted in the rendered sequence of frames as interacting with the first physical object in the rendered sequence of frames, based on the retrieved predefined geometric information.

9. The method of claim 8 , further comprising:
determining one or more dynamics rules based on the first physical object, wherein the one or more dynamics rules govern the physics that apply to the animated virtual character; and
affecting the interaction between the animated virtual character and the first physical object based on the determined dynamics rules.

10. A computer-readable memory containing a program that, when executed, performs an operation for displaying a first physical object, comprising:
capturing a visual scene for display, wherein the visual scene includes the first physical object and wherein the visual scene is captured using one or more camera devices;
classifying the first physical object as a first predetermined object type, based on one or more object identifiers associated with the first physical object;
upon classifying the first physical object as the first predetermined object type, retrieving predefined geometric information corresponding to the first predetermined object type, wherein the predefined geometric information provides a three-dimensional model describing a shape of objects of the first predetermined object type, and wherein the predefined geometric information specifies a first region of the three-dimensional model and one or more augmentations applicable to the first region of the objects of the first predetermined object type;
determining which one of a plurality of configurations the first physical object is currently in, wherein the first physical object is capable of being physically manipulated into each of a plurality of configurations; and
rendering a sequence of frames for display in which the first region of the first physical object within the captured visual scene is animated in a predefined manner depicting a virtual light source within the first physical object, based on the determined configuration of the first physical object, by applying the one or more augmentations to a first virtual object generated based on the retrieved predefined geometric information corresponding to the first physical object in the captured visual scene.

11. The computer-readable memory of claim 10 , wherein identifying the first physical object as the first predetermined object type further comprises:
analyzing the visual scene to determine a plurality of edges of the first physical object within the visual scene,
wherein the first predetermined object type is identified further based on the determined plurality of edges.

12. The computer-readable memory of claim 10 , the operation further comprising:
measuring one or more environmental illumination characteristics of an environment in which an augmented reality device is located, wherein the environmental illumination characteristics include at least one of a position of a light source within an environment in which the augmented reality device is located, an angle of the light source, an indication of whether the light source is omnidirectional, a color of the light source, an intensity of the light source and a reflectivity value of the first physical object; and
adjusting the appearance of the augmented first physical object based on the measured on

Assignees

• Disney Entpr Inc

Inventors

• Mitchell Kenneth John
• Sumner Robert Walker

Classifications

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title