Representation of real-world features in virtual space

Patent metadata

Field	Value
Publication number	US-11216665-B2
Application number	US-201916541910-A
Country	US
Kind code	B2
Filing date	Aug 15, 2019
Priority date	Aug 15, 2019
Publication date	Jan 4, 2022
Grant date	Jan 4, 2022

Abstract

Embodiments provide for an augmented reality (AR) system able to track the movement of real-world objects and apply that movement to virtual objects. The AR system includes a radio configured to receive first sensor data from a sensor attached to a first physical object in physical space. The AR system further includes a processor configured to determine when a physical object changes from a first state to a second state object based on the first sensor data, and update an environmental map based on the change from the first state to the second state of the first physical object.

First claim

What is claimed is:

1. A method for updating an environmental map of an augmented reality (AR) system, the method comprising:
receiving first sensor data, first calibration data, and second calibration data from a first sensor attached to a first physical object in physical space, wherein the first calibration data corresponds to a first state associated with a first position of the first physical object in the physical space, and the second calibration data corresponds to a second state associated with a second position of the first physical object in the physical space, the first position differing from the second position;
determining a change from the first state to the second state based on a comparison of the first sensor data to the first calibration data, and a comparison of the first sensor data to the second calibration data;
receiving second sensor data from a second sensor in the physical space;
determining a change of an amount of light within the physical space based on the second sensor data;
updating a first virtual object corresponding to the first physical object within the environmental map based on the change from the first state to the second state;
updating illumination within the environmental map based on the change of the amount of light within the physical space;
updating a second virtual object within the environmental map based on the second sensor data, wherein the second virtual object corresponds to a second physical object within the physical space; and
updating a presentation based on the updated first virtual object, the updated second virtual object, and the updated illumination.

2. The method of claim 1 , wherein the first sensor is powered via a wireless radio frequency power source.

3. The method of claim 1 further comprising:
adding a third virtual object within the environmental map based on the change from the first state to the second state, wherein the third virtual object was occluded by the first physical object when the first physical object was in the first position but is not occluded when the first physical object is in the second position; and
updating the presentation based on adding the third virtual object to the environmental map.

4. The method of claim 1 , wherein updating the illumination within the environmental map based on the change of the amount of light within the physical space comprises:
adjusting at least one of an illumination intensity and an illumination color.

5. The method of claim 1 , wherein the first sensor is one of a Hall Effect sensor, a magnetometer, a light sensor, an accelerometer, a potentiometer, a capacitive sensor, and a color sensor.

6. The method of claim 1 , wherein the first sensor is removable attached to the first physical object.

7. The method of claim 1 , wherein the first sensor data is transmitted in response to the AR system wirelessly connecting to the first sensor.

8. The method of claim 1 , wherein the second sensor is attached to the second physical object in the physical space and is configured to detect the change of the amount of light within the physical space.

9. The method of claim 8 , wherein
determining the change of the amount of light within the physical space based on the second sensor data comprises determining a change from a third state of the second physical object to a fourth state of the second physical object based on the second sensor data, wherein the third state corresponds to a first amount of light, and the fourth state corresponds to a second amount of light, and wherein updating the illumination within the environmental map based on the change of the amount of light within the physical space comprises:
adjusting an illumination intensity based on the change of the amount of light within the physical space.

10. A non-transitory computer-readable medium containing computer program code that, when executed by operation of one or more computer processors, performs an operation comprising:
receiving first sensor data, first calibration data, and second calibration data from a first sensor attached to a first physical object in physical space, wherein the first calibration data corresponds to a first state associated with a first position of the first physical object in the physical space, and the second calibration data corresponds to a second state associated with a second position of the first physical object in the physical space, the first position differing from the second position;
determining a change from the first state to the second state based a comparison of the first sensor data to the first calibration data, and a comparison of the first sensor data to the second calibration data;
receiving second sensor data from a second sensor in the physical space;
determining a change of an amount of light within the physical space based on the second sensor data;
updating a first virtual object corresponding to the first physical object within an environmental map based on the change from the first state to the second state;
updating illumination within the environmental map based on the change of the amount of light within the physical space;
updating a second virtual object within the environmental map based on the second sensor data, wherein the second virtual object corresponds to a second physical object within the physical space; and
displaying the updated first virtual object, the updated second virtual object, and the updated illumination on a display of an augmented reality system.

11. The non-transitory computer-readable medium of claim 10 , wherein the first sensor is powered via a wireless radio frequency power source.

12. The non-transitory computer-readable medium of claim 10 , wherein the operation further comprises:
adding a third virtual object within the environmental map based on the change from the first state to the second state, wherein the third virtual object was occluded by the first physical object when the first physical object was in the first position but is not occluded when the first physical object is in the second position; and
displaying the third virtual object as AR content based on adding the second virtual object to the environmental map.

13. The non-transitory computer-readable medium of claim 10 , wherein updating the illumination within the environmental map based on the change of the amount of light within the physical space comprises:
adjusting at least one of an illumination intensity and an illumination color.

14. The non-transitory computer-readable medium of claim 10 , wherein updating the environmental map based on the change from the first state to the second state comprises changing a position of the first virtual object in the environmental map.

15. An augmented reality system, comprising:
a display;
a radio configured to:
receive first sensor data, first calibration data, and second calibration data from a first sensor attached to a first physical object in physical space, wherein the first calibration data corresponds to a first state associated with a first position of the first physical object in the physical space, and the second calibration data corresponds to a second state associated with a second position of the first physical object in the physical space, the first position differs from the second position; and
receive second sensor data from a second sensor in the physical space; and

a processor configured to:
determine a change from the first state to the second state based on a comparison of the first sensor data to the first calibration data, and a comparison of the first sensor data to the second ca

Assignees

• Disney Entpr Inc

Inventors

• Drake Corey D
• Panec Timothy M
• Medrano Tritia V
• Thornton Stephen A
• Yeung Jason A
• Nocon Nathan D
• Baumbach Elliott H

Classifications

• H04L67/131

  Protocols for games, networked simulations or virtual reality · CPC title

• H04W4/021

  Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences · CPC title

• G06F16/5866

  using information manually generated, e.g. tags, keywords, comments, manually generated location and time information · CPC title

• H04L67/12

  specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks · CPC title

• G06V20/20 Primary

  in augmented reality scenes · CPC title