Mixed reality social interaction

Patent metadata

Field	Value
Publication number	US-9818228-B2
Application number	US-201615171964-A
Country	US
Kind code	B2
Filing date	Jun 2, 2016
Priority date	Aug 7, 2015
Publication date	Nov 14, 2017
Grant date	Nov 14, 2017

Abstract

Mixed reality social interactions are described. Techniques described herein include determining authentication information associated with a mixed reality display device and determining that a content item is visible in a mixed reality environment associated with the mixed reality display device. In an example, a content item may be determined to be visible based at least in part on content data indicating that the content item is owned by the mixed reality display device and/or has been shared with the mixed reality display device. The content data may also indicate an identification of a content item of the plurality of content items, an owner of the content item, and permissions associated with the content item. The techniques further describe causing a graphical representation of the content item to be presented via a display on the mixed reality display device.

First claim

What is claimed:

1. A system comprising:
a mixed reality display device; and
a device communicatively coupled to the mixed reality display device, the device comprising:
one or more processors;
memory; and
one or more modules stored in the memory and executable by the one or more processors to perform operations comprising:
determining a presence of the mixed reality display device based at least in part on authentication information associated with the mixed reality display device;
determining visibility of a plurality of content items for the mixed reality display device based at least in part on:
accessing content data associated with the plurality of content items, the content data indicating an identification of individual content items of the plurality of content items, an owner of each of the individual content items, and permissions associated with each of the individual content items;
determining, based at least in part on the authentication information and the content data, a content item of the plurality of content items that is at least one of owned by the mixed reality display device or has been shared with the mixed reality display device; and

causing a graphical representation of the content item to be presented via a display on the mixed reality display device.

2. The system as claim 1 recites, the operations further comprising:
sending rendering data associated with the content item to the mixed reality display device; and
causing the graphical representation of the content item to be rendered via the mixed reality display device.

3. The system as claim 2 recites, the operations further comprising, prior to causing the graphical representation of the content item to be rendered via the display, receiving a frame request from the mixed reality display device, the frame request including at least one of pose information associated with each eye of a user associated with the mixed reality display device, a time stamp, a desired resolution, or a desired field of view.

4. The system as claim 3 recites, the operations further comprising:
determining a frame message corresponding to the frame request, the frame message including at least one of the pose information associated with each eye of the user, the time stamp, a determined resolution, a determined field of view, or a render distance;
sending the frame message to the mixed reality display device; and
causing the graphical representation of the content item to be rendered via the display based at least in part on the frame message.

5. The system as claim 4 recites, wherein the frame message further includes rendered stereo images for each eye of the user.

6. The system as claim 1 recites, wherein the permissions indicate a plurality of devices with which the content item has been shared.

7. The system as claim 1 recites, wherein the permissions indicate interactions that are available for the content item and a plurality of devices permitted to cause the interactions.

8. A mixed reality display device comprising:
one or more processors;
memory; and
one or more modules stored in the memory and executable by the one or more processors to perform operations comprising:
determining authentication information associated with a second mixed reality display device;
determining that a content item of a plurality of content items is visible in a mixed reality environment associated with the second mixed reality display device based at least in part on:
accessing content data associated with the plurality of content items, the content data indicating an identification of the content item, an owner of the content item, and permissions associated with the content item; and
determining, based at least in part on the authentication information and the content data, that the content item is at least one of owned by the second mixed reality display device or has been shared with the second mixed reality display device; and

causing a graphical representation of the content item to be rendered via a display on the second mixed reality display device.

9. The mixed reality display device as claim 8 recites, the operations further comprising:
determining, based at least in part on the content data, that the content item is owned by the mixed reality display device;
determining that the content item has been made private; and
terminating the causing of the graphical representation of the content item to be rendered via the display of the second mixed reality display device.

10. The mixed reality display device as claim 9 recites, the operations further comprising:
causing a menu with graphical representations of sharing settings to be presented via the mixed reality display device, the sharing settings including a private sharing setting or a public sharing setting;
determining selection of the private sharing setting; and
determining that the content item has been made private based at least in part on the selection of the private sharing setting.

11. The mixed reality display device as claim 8 recites, the operations further comprising:
determining, based at least in part on the content data, that the second mixed reality display device is not the owner of the content item;
determining that the content item is no longer being shared with the second mixed reality display device; and
terminating the causing of the graphical representation of the content item to be rendered via the display on the second mixed reality display device.

12. The mixed reality display device as claim 11 recites, wherein:
determining that the content item is visible is further based at least in part on sharing settings associated with the content item; and
the operations further comprise:
determining, based at least in part on the content data, that a third mixed reality display device is the owner of the content item;
receiving a request from the third mixed reality display device to make the content item private;
changing the sharing settings based at least in part on the request; and
determining that the content item is no longer being shared with the second mixed reality display device based at least in part on changes to the sharing settings.

13. The mixed reality display device as claim 8 recites, the operations further comprising:
determining authentication information associated with a third mixed reality display device;
determining, based at least in part on the authentication information associated with the third mixed reality display device and the content data, that the content item is not owned by the third mixed reality display device and has not been shared with the third mixed reality display device; and
prohibiting the graphical representation of the content item from being rendered via a display on the third mixed reality display device.

14. The mixed reality display device as claim 8 recites, the operations further comprising:
receiving, from the owner of the content item, a request to share the content item with at least one additional mixed reality display device;
sending rendering data to the at least one additional mixed reality display device; and
causing the graphical representation of the content item to be rendered via a display on the at least one additional mixed reality display device.

15. A method comprising:
determining authentication information associated with a first mixed reality display device;
receiving, from the first mixed reality display device, a first request to share a content item of a plurality of content items with one or more second mixed reality display devices;

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Lanier Jaron
• Gal Ran
• Chang Wayne
• Luraschi Javier Arturo Porras
• Mateevitsi Viktor A
• Speiginer Gheric
• Menke Joseph

Classifications

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• H04W12/06

  Authentication · CPC title

• H04W4/043

  Electricity · mapped topic

• H04W12/02 Primary

  Protecting privacy or anonymity, e.g. protecting personally identifiable information [PII] · CPC title

• H04W12/33

  using wearable devices, e.g. using a smartwatch or smart-glasses · CPC title