Systems and methods to provide a shared augmented reality experience

Patent metadata

Field	Value
Publication number	US-10481680-B2
Application number	US-201815887085-A
Country	US
Kind code	B2
Filing date	Feb 2, 2018
Priority date	Feb 2, 2018
Publication date	Nov 19, 2019
Grant date	Nov 19, 2019

Abstract

This disclosure relates to providing users with a shared augmented reality experience. Head-mounted devices are provided with the shared-augmented reality experience. The shared augmented reality experience may be provided to individual head-mounted devices based on sensor information conveyed by output signals of a sensor set of the individual head-mounted devices. The sensor set of the individual head-mounted devices have different reference frames. Discrepancies between the sensor set of the individual head-mounted devices may cause the shared-augmented reality experience to be presented with different perspectives. The individual head-mounted devices may have different perspectives of the shared-augmented reality experience caused by discrepancies between the sensor set of the individual head-mounted devices. The discrepancies between the sensor set of the individual head-mounted devices may be determined such that the shared-augmented reality experience is presented along a same or similar perspective.

First claim

What is claimed:

1. An augmented reality system comprising:
a first head-mounted device configured to be worn on a head of a user;
a first sensor set of one or more sensors coupled to the first head-mounted device, the first sensor set being configured to generate output signals conveying first view information and first range information, the first view information defining first visual content within a first field of view, the first range information including ranges from the first head-mounted device to objects present within the first field of view;
the first sensor set comprising a first heading sensor, the first heading sensor being configured to generate output signals conveying first heading information, the first heading information indicating a heading of the first head-mounted device in the real world with respect to a first reference frame;
one or more physical processors configured by machine-readable instructions to:
obtain the output signals generated by the first sensor set;
detect, based on the output signals generated by the first sensor set, presence of one or more reference points in the first visual content defined by the first view information;
receive, from a second head-mounted device, (i) second heading information indicating a heading of the second head-mounted device determined based on output signals generated by a second heading sensor coupled to the second head-mounted device, and (ii) position information conveying position and heading of the second head-mounted device relative to at least two reference points physically present in the real world;
determine, based on the position information conveying position and heading of the second head-mounted device relative to the at least two reference points, a calculated heading of the first heading sensor, wherein the calculated heading is a heading conveyed by the output signals of the first heading sensor while the first heading sensor is at the position and heading conveyed by the position information;
determine a heading difference between the calculated heading and the heading of the second head-mounted device determined based on the output signals generated by the second heading sensor;
effectuate presentation of views of augmented reality content through the first head-mounted device, wherein the augmented reality content is presented with respect to the heading of the first heading sensor; and
responsive to the presentation of views of augmented reality content through the first head-mounted device effectuate communication of the heading difference to the second head-mounted device, such that views of the augmented reality content presented through the second head-mounted device are presented with respect to the heading of the second heading sensor modified by the heading difference.

2. The system of claim 1 , wherein determining the calculated heading comprises:
determining, based on the presence of the at least two reference points in the first visual content defined by the first view information, the position of the first head-mounted device with respect to the at least two reference points;
determining, based on the position information, a difference between the position of the first head-mounted device and the second head-mounted device with respect to the at least two reference points; and
determining the calculated heading by modifying the heading of the first heading sensor by the difference between the position of the first head-mounted device and the second head-mounted device.

3. The system of claim 1 , wherein the individual ones of the one or more reference points includes individual electromagnetic radiation beacons, including light beacons.

4. The system of claim 3 , wherein the individual electromagnetic radiation beacons are identified by their individual wavelengths.

5. The system of claim 1 , wherein an arrangement of the augmented reality content presented through the first head-mounted device is arranged with respect a first reference point or a second reference point; and the arrangement of the augmented reality content presented through the second head-mounted device is arranged with respect to the same reference point as the first head-mounted device.

6. The system of claim 1 , wherein the second head-mounted device is configured to be worn on a head of a second user.

7. The system of claim 1 , wherein the first head-mounted device includes a first client computing device coupled to the first head-mounted device, the first client computing device includes the first heading sensor, and the second head-mounted device includes a second client computing device coupled to the second head-mounted device, the second client computing device includes the second heading sensor.

8. The system of claim 1 , wherein the augmented reality content is presented through the first head-mounted device and the second head-mounted device contemporaneously.

9. The system of claim 1 , wherein the position information conveying position and heading of the second head-mounted device relative to at least two reference points physically present in the real world is determined by a second sensor set of one or more sensors coupled to the second head-mounted device, the second sensor set being configured to generate output signals conveying second view information and second range information, the second view information defining second visual content within a second field of view, the second range information including ranges from the second head-mounted device to objects present within the second field of view.

10. The system of claim 9 , wherein the one or more physical processors are further configured by machine-readable instructions to:
obtain the output signals generated by the second sensor set;
detect, based on the output signals generated by the second sensor set, presence of the at least two reference points in the second visual content defined by the second view information; and
determine, based on the presence of the at least two reference points in the second visual content defined by the second view information, the position information conveying position and heading of the second head-mounted device relative to the at least two reference points.

11. A method for providing augmented reality experience, the method comprising:
obtaining output signals generated by a first sensor set coupled with a first head-mounted device, the first head-mounted device configured to be worn on a head of a user, the output signals conveying first view information and first range information, the first view information defining first visual content within a first field of view, the first range information including ranges from the first head-mounted device to objects present within the first field of view, the first sensor set further comprising a first heading sensor, the first heading sensor being configured to generate the output signals conveying first heading information, the first heading information indicating a heading of the first head-mounted device in a real world with respect to a first reference frame;
detecting, based on the output signals generated by the first sensor set, presence of one or more reference points in the first visual content defined by the first view information;
receiving, from a second head-mounted device, (i) second heading information indicating a heading of the second head-mounted device determined based on output signals generated by a second heading sensor coupled to the second head-mounted device, and (ii) position information conveying position and heading of the second head-mounted device relative to at least two reference points physically present in the real world;
determi

Assignees

• Disney Entpr Inc

Inventors

• Panec Timothy
• Baumbach Elliott
• Goslin Michael P

Classifications

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title

• G02B27/017

  Head mounted · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/012 Primary

  Head tracking input arrangements · CPC title