Artificial reality augments and surfaces

Patent metadata

Field	Value
Publication number	US-11847753-B2
Application number	US-202318151524-A
Country	US
Kind code	B2
Filing date	Jan 9, 2023
Priority date	Aug 31, 2020
Publication date	Dec 19, 2023
Grant date	Dec 19, 2023

Abstract

Aspects of the present disclosure are directed to providing an artificial reality environment with augments and surfaces. An “augment” is a virtual container in 3D space that can include presentation data, context, and logic. An artificial reality system can use augments as the fundamental building block for displaying 2D and 3D models in the artificial reality environment. For example, augments can represent people, places, and things in an artificial reality environment and can respond to a context such as a current display mode, time of day, a type of surface the augment is on, a relationship to other augments, etc. Augments can be on a “surface” that has a layout and properties that cause augments on that surface to display in different ways. Augments and other objects (real or virtual) can also interact, where these interactions can be controlled by rules for the objects evaluated based on information from the shell.

First claim

We claim:

1. A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for managing interactions between virtual containers, the process comprising:
registering a relationship, between two or more virtual containers comprising at least a first virtual container and an other virtual container, for sharing virtual container parameters, the virtual container parameters comprising one or more of: a position of the other virtual container in an artificial reality environment, a type of the other virtual container, a shape of the other virtual container, content items written into the other virtual container, a handle to invoke logic in the other a virtual container, or any combination thereof;
identifying an event related to the virtual container parameters; and
in response to identifying the event and based on the registered relationship, providing at least some of the virtual container parameters to one or more virtual containers of the two or more virtual containers;
wherein at least one virtual container, of the one or more virtual containers, has at least two display modes and is configured to evaluate, based on at least one of the virtual container parameters provided to the at least one virtual container, one or more conditions associated with the at least two display modes for the at least one virtual container, to enable a current display mode for presenting the at least one virtual container.

2. The non-transitory computer-readable storage medium of claim 1 ,
wherein a system with which the relationship is registered further has defined one or more privacy policies specifying types of virtual container parameters that can be shared between virtual containers, and
wherein the registering the relationship includes determining that the relationship conforms to the one or more privacy policies.

3. The non-transitory computer-readable storage medium of claim 2 , wherein the one or more privacy policies specify that some virtual container parameters can only be shared between virtual containers that were created by the same parent or ancestor application or virtual container.

4. The non-transitory computer-readable storage medium of claim 2 , wherein the one or more privacy policies specify that some virtual container parameters can only be shared between virtual containers in response to a user action indicating an interaction between the virtual containers.

5. The non-transitory computer-readable storage medium of claim 2 , wherein the one or more privacy policies specify that some virtual container parameters can only be shared between virtual containers that have been assigned to the same real-world surface.

6. The non-transitory computer-readable storage medium of claim 1 , wherein the event comprises the first virtual container and the other virtual container having been moved to be in contact or within a threshold distance of each other.

7. The non-transitory computer-readable storage medium of claim 1 , wherein at least one display mode, of the at least two display modes of the at least one virtual container, was inherited by the at least one virtual container based on the at least one virtual container having been created as an instance of type of virtual container class that defines the at least one display mode.

8. The non-transitory computer-readable storage medium of claim 1 , wherein the current display mode is enabled based on determining that the current display mode is a deepest display mode, in a hierarchy of display modes for the at least one virtual container, that satisfy the one or more conditions.

9. The non-transitory computer-readable storage medium of claim 1 , wherein the enabling the current display mode includes moving the at least one virtual container to a side of a user's field of view.

10. The non-transitory computer-readable storage medium of claim 1 , wherein the virtual container parameters comprise one or more of: the position of the other virtual container in the artificial reality environment and/or the shape of the other virtual container.

11. The non-transitory computer-readable storage medium of claim 1 , wherein the virtual container parameters comprise one or more of: the type of the other virtual container and/or the content items written into the other virtual container.

12. The non-transitory computer-readable storage medium of claim 1 , wherein the virtual container parameters comprise the handle to invoke logic in the other a virtual container.

13. A method for managing interactions between virtual containers in one or more computing systems, the method comprising:
registering, by the one or more computing systems, a relationship, between two or more virtual containers comprising at least a first virtual container and an other virtual container, for sharing virtual container parameters;
identifying, by the one or more computing systems, an event related to the virtual container parameters; and
in response to identifying the event and based on the registered relationship, providing, by the one or more computing systems, at least some of the virtual container parameters to one or more virtual containers of the two or more virtual containers;
wherein at least one virtual container, of the one or more virtual containers, has at least two display modes and is configured to evaluate, based on at least one of the virtual container parameters provided to the at least one virtual container, one or more conditions associated with the at least two display modes for the at least one virtual container, to enable a current display mode for presenting the at least one virtual container.

14. The method of claim 13 , wherein the virtual container parameters comprise one or more of: a position of the other virtual container in an artificial reality environment and/or a shape of the other virtual container.

15. The method of claim 13 , wherein the virtual container parameters comprise one or more of: a type of the other virtual container and/or content items written into the other virtual container.

16. The method of claim 13 , wherein the event comprises the first virtual container and the other virtual container having been moved to be in contact or within a threshold distance of each other.

17. The method of claim 13 ,
wherein a system with which the relationship is registered further has defined one or more privacy policies specifying types of virtual container parameters that can be shared between virtual containers, and
wherein the one or more privacy policies specify:
that some virtual container parameters can only be shared between virtual containers in response to a user action indicating an interaction between the virtual containers, and/or
that some virtual container parameters can only be shared between virtual containers that have been assigned to the same real-world surface.

18. A computing system for managing interactions between virtual containers, the computing system comprising:
one or more processors; and
one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to perform a process comprising:
registering a relationship, between two or more virtual containers comprising at least a first virtual container and an other virtual container, for sharing virtual container parameters;
identifying an event related to the virtual container parameters; and
in response to identifying the event and based on the registered relationship, providing at

Assignees

• Meta Platforms Tech Llc

Inventors

• Tichenor James
• Zwiegincew Arthur
• Schoen Hayden
• Marcolina Alex
• Alt Gregory
• Harris Todd
• Deng Merlyn
• Fox Barrett
• Hlavac Michal

Classifications

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06T2219/2004

  Aligning objects, relative positioning of parts · CPC title