Systems and methods for content sharing between artificial-reality devices

Patent metadata

Field	Value
Publication number	US-11941725-B2
Application number	US-202117528992-A
Country	US
Kind code	B2
Filing date	Nov 17, 2021
Priority date	Nov 17, 2021
Publication date	Mar 26, 2024
Grant date	Mar 26, 2024

Abstract

In one embodiment, a method includes, by an operating system of a first artificial-reality device, receiving a notification that virtual objects are shared with the first artificial-reality device by a second artificial-reality device, where the virtual objects are shared by being placed inside a sender-side shared space anchored to a physical object. The method further includes the first artificial-reality device accessing descriptors of a physical object and a spatial-relationship definition between the physical object and a receiver-side shared space, detecting physical objects based on the descriptors, determining pose of the receiver-side shared space, detecting physical constraints within the receiver-side shares space, receiving display instructions for the virtual objects, and rendering the virtual objects on the first artificial-reality device in the receiver-side shared space.

First claim

What is claimed is:

1. A method comprising: by a first artificial-reality device,
receiving a notification from a server that one or more virtual objects are shared with the first artificial-reality device by a second artificial-reality device, wherein the one or more virtual objects are shared based on being placed by a user of the second artificial-reality device inside a sender-side shared space anchored to a sender-side physical object;
accessing descriptors of a receiver-side physical object and a spatial-relationship definition between the receiver-side physical object and a receiver-side shared space, wherein the receiver-side shared space is configured to be used to both receive other virtual objects and send other virtual objects, wherein the other virtual objects are placed within the receiver-side shared space, and wherein the receiver-side shared space is connected with the sender-side shared space;
detecting the receiver-side physical object based on the descriptors of the receiver-side physical object;
determining a pose of the receiver-side shared space based on the detected receiver-side physical object and the spatial-relationship definition;
detecting physical constraints corresponding to one or more other physical objects within the receiver-side shared space;
receiving display instructions for the one or more virtual objects; and
rendering, based on the display instructions and the physical constraints, the one or more virtual objects within the receiver-side shared space so that the one or more virtual objects avoid spatially overlapping with the one or more other physical objects in the receiver-side shared space.

2. The method of claim 1 , further comprising:
accessing, before the notification is received by the first artificial-reality device, mapped location data of an environment surrounding the first artificial-reality device;
using the mapped location data to generate a recommendation for the receiver-side shared space; and
storing, based on the recommendation for the receiver-side shared space, the descriptors of the receiver-side physical object and the spatial-relationship definition between the receiver-side physical object and the receiver-side shared space.

3. The method of claim 2 , wherein the mapped location data comprise information about the other physical objects in the environment and placement of virtual objects in the environment.

4. The method of claim 1 , wherein at least one of the sender-side shared space and the receiver-side shared space is a planar surface and the one or more virtual objects are rendered on top of the planar surface.

5. The method of claim 1 , wherein the receiver-side shared space has different dimensions than the sender-side shared space.

6. The method of claim 1 , further comprising the second artificial-reality device sending the one or more virtual objects at a different time than the first artificial-reality device receives the one or more virtual objects.

7. The method of claim 1 , wherein the second artificial-reality device is one of a plurality of artificial-reality devices that share virtual objects with the first artificial-reality device, wherein the receiver-side shared space is configured to display the virtual objects shared by the plurality of artificial-reality devices.

8. The method of claim 1 , wherein the sender-side shared space is configured to automatically transmit virtual objects placed within the sender-side shared space to the first artificial-reality device and displayed on the receiver-side shared space.

9. The method of claim 1 , wherein the one or more virtual objects are confined within the receiver-side shared space.

10. The method of claim 1 , further comprising:
after rendering the one or more virtual objects within the receiver-side shared space, animating the one or more virtual objects to have the one or more virtual objects move out of the received-side shared space and into an environment surrounding the received-side shared space.

11. The method of claim 1 , wherein a placement of the one or more virtual objects relative to the sender-side shared space differs from a placement of the one or more virtual objects relative to the receiver-side shared space.

12. The method of claim 1 , further comprising:
rendering a second virtual object encapsulating content from an application running on an operating system of the first artificial-reality device;
detecting, based on hand-tracking data, that a user of the first artificial-reality device moved the second virtual object into the receiver-side shared space; and
in response to detecting that the user of the first artificial-reality device moved the second virtual object into the receiver-side shared space, sharing the second virtual object with the second artificial-reality device by causing the second artificial-reality device to render the second virtual object within the sender-side shared space.

13. One or more computer-readable non-transitory storage media embodying software that is operable when executed by a first artificial-reality device to:
receive a notification from a server that one or more virtual objects are shared with the first artificial-reality device by a second artificial-reality device, wherein the one or more virtual objects are shared based on being placed by a user of the second artificial-reality device inside a sender-side shared space anchored to a sender-side physical object;
access descriptors of a receiver-side physical object and a spatial-relationship definition between the receiver-side physical object and a receiver-side shared space, wherein the receiver-side shared space is configured to be used to both receive other virtual objects and send other virtual objects, wherein the other virtual objects are placed within the receiver-side shared space, and wherein the receiver-side shared space is connected with the sender-side shared space;
detect the receiver-side physical object based on the descriptors of the receiver-side physical object;
determine a pose of the receiver-side shared space based on the detected receiver-side physical object and the spatial-relationship definition;
detect physical constraints corresponding to one or more other physical objects within the receiver-side shared space;
receive display instructions for the one or more virtual objects; and
render, based on the display instructions and the physical constraints, the one or more virtual objects within the receiver-side shared space so that the one or more virtual objects avoid spatially overlapping with the one or more other physical objects in the receiver-side shared space.

14. The media of claim 13 , wherein the software is further operable when executed to:
access, before the notification is received by the first artificial-reality device, mapped location data of an environment surrounding the first artificial-reality device;
use the mapped location data to generate a recommendation for the receiver-side shared space; and
store, based on the recommendation for the receiver-side shared space, the descriptors of the receiver-side physical object and the spatial-relationship definition between the receiver-side physical object and the receiver-side shared space.

15. The media of claim 14 , wherein the mapped location data comprise information about the other physical objects in the environment and placement of virtual objects in the environment.

16. The media of claim 13 , wherein the receiver-side shared space has different dimensions than the sender-side shared space.

17. A first artificial-r

Assignees

• Meta Platforms Tech Llc

Inventors

• Louie Alexander Michael
• Hlavac Michal
• Stevens Jasper

Classifications

• G06T11/00 Primary

  Two-dimensional [2D] image generation · CPC title

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• G06T13/80

  Two-dimensional [2D] animation, e.g. using sprites · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title