Placing large objects and objects separated by large distances in augmented reality

Patent metadata

Field	Value
Publication number	US-11238610-B2
Application number	US-201615233923-A
Country	US
Kind code	B2
Filing date	Aug 10, 2016
Priority date	Aug 10, 2016
Publication date	Feb 1, 2022
Grant date	Feb 1, 2022

Abstract

Systems and methods are described for placing large objects and objects separated by large distances in an AR environment. An AR headset system may place and generate digital objects using relative geographical coordinates (e.g., latitude, longitude, and altitude) between the user's current position and the object being placed. In one implementation, a digital object's geographical coordinates may be calculated by determining a user's geographical coordinates, using a distance determination device to measure a distance to a boundary in the user's real-world environment within an AR headset's field of view, and calculating an orientation of the AR headset relative to the user's position. In another implementation, a digital object's geographical coordinates may be calculated by determining the user's geographical coordinates, calculating an orientation of the AR headset relative to the user's position, and receiving input at a user input device specifying at what distance to place and generate a digital object.

First claim

What is claimed is:

1. A method comprising:
determining, by a processor, a first user geolocation of a first user using an augmented reality device, based on a latitude of the first user geolocation, a longitude of the first user geolocation, an altitude of the first user geolocation, or a combination thereof;
determining, by the processor, a distance measurement between the first user geolocation and a point from the first user geolocation that the first user is viewing within a field of view of the augmented reality device, wherein the point lies along a boundary within the field of view;
accessing, by the processor, map information based on the first user geolocation;
determining, by the processor, an object geolocation at which a digital object is placed by the first user within the field of view, the determining based on the first user geolocation, the distance measurement, the map information, and landmark information associated with known geographical coordinates, wherein the determined object geolocation exceeds a distance threshold from the first user geolocation, and wherein a size of the digital object when placed at the determined object geolocation is proportioned based at least on the first user geolocation;
displaying, by the augmented reality device, the digital object at the determined object geolocation; and
transmitting information associated with the digital object and the determined object geolocation to a second augmented reality device utilized by a second user located at a second user geolocation different from the first user geolocation, wherein the information is configured to be used by the second augmented reality device, to display the digital object at the determined object geolocation at which the digital object is placed by the first user, within a second field of view associated with the second augmented reality device.

2. The method of claim 1 , wherein determining the first user geolocation is further based on determining an orientation of the augmented reality device based at least on receiving electrical signals at a position sensor.

3. The method of claim 2 , wherein the orientation of the augmented reality device is determined in a north-east-south-west plane.

4. The method of claim 1 , wherein determining the distance measurement between the first user geolocation and the point from the first user geolocation that the first user is viewing within the field of view of the augmented reality device is further based on receiving an input indicating the distance measurement corresponding to the point.

5. The method of claim 1 , wherein determining the distance measurement between the first user geolocation and the point from the first user geolocation that the first user is viewing within the field of view of the augmented reality device is further based on reflecting light or reflecting sound off the point that lies along the boundary.

6. The method of claim 1 , wherein the boundary is an environmental boundary.

7. The method of claim 1 , wherein the boundary is a field of view boundary.

8. One or more computer storage media storing computer-usable instructions that, when executed by one or more computing devices, causes the one or more computing devices to perform operations, the operations comprising:
determining a first user geolocation of a first user using an augmented reality device, based on a latitude of the first user geolocation, a longitude of the first user geolocation, an altitude of the first user geolocation, or a combination thereof;
determining a distance measurement between the first user geolocation and a point from the first user geolocation that the first user is viewing within a field of view of the augmented reality device, wherein the point lies along a boundary within the field of view;
accessing map information, based on the first user geolocation;
determining an object geolocation at which a digital object is placed by the first user within the field of view, the determining based on the first user geolocation, the distance measurement, the map information, and landmark information associated with known geographical coordinates, wherein the determined object geolocation exceeds a distance threshold from the first user geolocation, and wherein a size of the digital object when placed at the determined object geolocation is proportioned based at least on the first user geolocation;
displaying the digital object at the determined object geolocation; and
transmitting information associated with the digital object and the determined object geolocation, to a second augmented reality device utilized by a second user located at a second user geolocation different from the first user geolocation, wherein the information is configured to be used by the second augmented reality device, to display the digital object at the determined object geolocation at which the digital object is placed by the first user, within a second field of view associated with the second augmented reality device.

9. The one or more computer storage media of claim 8 , wherein determining the first user geolocation is further based on determining an orientation of the augmented reality device, wherein the determining is based at least on receiving electrical signals at a position sensor.

10. The one or more computer storage media of claim 9 , wherein the orientation of the augmented reality device is determined in a north-east-south-west plane.

11. The one or more computer storage media of claim 8 , wherein determining the distance measurement between the first user geolocation and the point from the first user geolocation that the first user is viewing within the field of view of the augmented reality device is further based on receiving an input indicating the distance measurement corresponding to the point.

12. The one or more computer storage media of claim 8 , wherein determining the distance measurement between the first user geolocation and the point from the first user geolocation that the first user is viewing within the field of view of the augmented reality device is further based on reflecting light or reflecting sound off the point that lies along the boundary.

13. The one or more computer storage media of claim 8 , wherein the boundary is an environmental boundary.

14. The one or more computer storage media of claim 8 , wherein the boundary is a field of view boundary.

15. An augmented reality system, comprising:
an augmented reality device configured to:
determine, by a processor communicatively coupled to the augmented reality device, a first user geolocation of a first user using the augmented reality device, based on a latitude of the first user geolocation, a longitude of the first user geolocation, an altitude of the first user geolocation, or a combination thereof;
determine, by the processor, a distance measurement between the first user geolocation and a point from the first user geolocation that the first user is viewing within a field of view of the augmented reality device, wherein the point lies along a boundary within the field of view;
access, by the processor, map information and terrain information, based on the first user geolocation;
determine, by the processor, an object geolocation at which a digital object is placed by the first user within the field of view, the determining based on the first user geolocation, the distance measurement, the map information, and landmark information associated with known geographical coordinates, wherein the determined object geolocation exceeds a distance threshold from the first user geolocation, and wherein a size of t

Assignees

• Disney Entpr Inc

Inventors

• Patel Mehul
• Voris James

Classifications

• G06F1/163 Primary

  Wearable computers, e.g. on a belt · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T7/73 Primary

  using feature-based methods · CPC title

• G06F2200/1637

  Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer · CPC title