Transitioning augmented reality objects in physical and digital environments

Patent metadata

Field	Value
Publication number	US-9846970-B2
Application number	US-201514971781-A
Country	US
Kind code	B2
Filing date	Dec 16, 2015
Priority date	Dec 16, 2015
Publication date	Dec 19, 2017
Grant date	Dec 19, 2017

Abstract

Described are apparatuses, methods and storage media associated with transitioning an augmented reality object between physical and digital environments, wherein the augmented reality object is embodied in at least two information carrying objects, which information carrying objects comprise a sensor-enabled physical object and a digital object.

First claim

The invention claimed is:

1. An apparatus for transitioning an augmented reality object between physical and digital environments, comprising:
a computer processor and memory, wherein the memory comprises a sensor detection module, a modality tracking module, and an actuator module, wherein the modules are to be operated by the computer processor;
wherein the sensor detection module is to detect an object identifier of a first information carrying object and a characteristic of the first information carrying object in a sensor data received from a sensor;
wherein the modality tracking module is to determine, based on the object identifier and the characteristic, a transition event trigger associated with the first information carrying object and a transition event output associated with a second information carrying object;
wherein the actuator module is to activate, via an actuator, a renderable attribute in the second information carrying object; and
wherein the first information carrying object is a first of two types of objects and the second information carrying object is a second of the two types of objects, and wherein the two types of object are a sensor-enabled physical object and a digital object rendered in the digital environment.

2. The apparatus according to claim 1 , wherein the modality tracking module is to further determine a renderable parameter of the renderable attribute according to the characteristic.

3. The apparatus according to claim 2 , wherein the renderable attribute in the second information carrying object approximates the characteristic of the first information carrying object according to the renderable parameter, determined by the modality tracking module at least in part according to a renderable attribute map.

4. The apparatus according to claim 3 , wherein the object identifier is a first object identifier, the characteristic is a first characteristic, the transition event trigger is a first transition event trigger, the transition event output is a first transition event output, the sensor-enabled physical object is a first sensor-enabled physical object, the digital object is a first digital object, the renderable attribute is a first renderable attribute, the renderable parameter is a first renderable parameter, and the sensor data is a first sensor data;
wherein the sensor detection module is to detect a second object identifier of the second information carrying object and a second characteristic of the second information carrying object in a second sensor data received from the sensor;
wherein the modality tracking module is to determine, based on the second object identifier and the second characteristic, a second transition event trigger associated with the second information carrying object and a second transition event output associated with a third information carrying object, which third information carrying object comprises at least one of a second sensor-enabled physical object and a second digital object; and
wherein the actuator module is to activate a second renderable attribute in the third information carrying object, which second renderable attribute comprises a second renderable parameter determined by the modality tracking module according to the second characteristic, wherein the second renderable attribute in the third information carrying object approximates the second characteristic of the second information carrying object, determined by the modality tracking module at least in part according to the renderable attribute map.

5. The apparatus according to claim 1 , wherein the sensor-enabled physical object comprises a physical object comprising an emitter or detector of at least one of an acoustic energy, an electromagnetic radiation, an electric energy, an acceleration, and a magnetic field.

6. The apparatus according to claim 1 , wherein the characteristic of the first information carrying object comprises at least one of a physical characteristic of the sensor-enabled physical object and a rendered digital characteristic of the digital object.

7. The apparatus according to claim 1 , wherein the characteristic comprises at least one of a time, an orientation, a position, a rate of change in position, a relative position, an encoded information, a color, and a sound.

8. The apparatus according to claim 1 , wherein:
the sensor is a sensor of the sensor-enabled physical object and a sensor of the digital object;
the actuator is an actuator of the sensor-enabled physical object and an actuator of the digital object;
wherein the sensor of the sensor-enabled physical object comprises at least one of a microphone, a motion detector, a camera, a capacitive surface, an electromagnetic detector, a vibration detector, a proximity detector, and a fiducial marker detector,
wherein the sensor of the digital object comprises a registration by the sensor detection module with a digital object rendering module to receive information regarding rendering of the digital object by the digital object rendering module; and
wherein the actuator of the sensor-enabled physical object comprises at least one of a speaker, a haptic output device, a motor, a projectile, and wherein the actuator of the digital object comprises a registration by the actuator of the digital object with the digital object rendering module to control rendering of the digital object by the digital object rendering module.

9. A method for transitioning an augmented reality object between physical and digital environments, comprising:
in a computing device comprising a processor, a memory, a sensor, a digital rendering environment, and an actuator;
transitioning an augmented reality object from a first information carrying object to a second information carrying object by:
with the sensor, detecting an object identifier of the first information carrying object and a characteristic of the first information carrying object in a sensor data received from the sensor;
based on the object identifier and the characteristic, determining a transition event trigger associated with the first information carrying object and a transition event output associated with the second information carrying object;
with the actuator, activating a renderable attribute in the second information carrying object;
wherein the first information carrying object is a first of two types of objects and the second information carrying object is a second of the two types of objects, and wherein the two types of object are a sensor-enabled physical object and a digital object rendered in the digital environment.

10. The method according to claim 9 , further comprising determining a renderable parameter of the renderable attribute according to the characteristic.

11. The method according to claim 10 , further comprising determining the renderable parameter at least in part according to a renderable attribute map, wherein the renderable attribute in the second information carrying object approximates the characteristic of the first information carrying object according to the renderable parameter at least in part according to the renderable attribute map.

12. The method according to claim 11 , wherein the object identifier is a first object identifier, the characteristic is a first characteristic, the transition event trigger is a first transition event trigger, the transition event output is a first transition event output, the sensor-enabled physical object is a first sensor-enabled physical object, the digital object is a first digital object, the renderable attribute is a first renderable attribute, the renderable parameter is a first renderable parameter, and the sensor data is a first sen

Assignees

• Intel Corp

Inventors

• Anderson Glen J
• Bowes Reese
• Agrawal Ankur

Classifications

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T2215/16

  Using real world measurements to influence rendering · CPC title

• G06F3/01

  Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) · CPC title