Mapping a Real-World Room for A Shared Artificial Reality Environment

Patent metadata

Field	Value
Publication number	US-2026100007-A1
Application number	US-202519298724-A
Country	US
Kind code	A1
Filing date	Aug 13, 2025
Priority date	Sep 29, 2022
Publication date	Apr 9, 2026
Grant date	—

Abstract

A room manager can generate mappings for a real-world room that support a shared XR environment. For example, the real-world room can include real-world objects and surfaces, such as a table(s), chair(s), wall(s), door(s), window(s), etc. The room manager can generate XR object definitions based on information received about the real-world room, object(s), and surface(s). For example, the room manager can implement a flow that guides a user equipped with an XR system to provide information for the XR object definitions, such as real-world surfaces that map to the XR object(s), borders (e.g., measured using a component of the XR system), such as borders on real-world surfaces, semantic information (e.g., number of seat assignments at an XR table, size of XR objects, etc.), and other suitable information. Implementations generate previews of the shared XR environment, such as a local preview and a remote preview.

First claim

I/We claim:

1 . A method for configuring occlusion masks in an artificial reality (XR) environment, the method comprising:
rendering, by a first XR system of a first user, a shared XR environment, wherein the shared XR environment corresponds to a real-world room, wherein at least two users, including the first user, are local users in the real-world room, wherein the local users view at least part of the shared XR environment in A) mixed reality or B) in passthrough using a video capture of the real-world room; receiving, from a second XR system of a second user of the local users, tracking location and pose data for an avatar in the XR environment corresponding to the second user, wherein the avatar is not rendered by the first XR system in the XR environment; generating an occlusion mask attached relative, in the XR environment, to the location and pose data for the avatar of the second user, wherein the occlusion mask causes portions of virtual objects that are behind the occlusion mask, from the point of view of the first user, to not be rendered; and rendering a virtual object in the XR environment, wherein the generated occlusion mask causes at least part of the virtual object to not be displayed by the first XR system.

2 . The method of claim 1 , wherein the occlusion mask has a size that is larger than the avatar of the second user.

3 . The method of claim 1 , wherein a geometry for the occlusion mask A) corresponds to a geometry for the avatar of the second user and B) is larger in size than the geometry for the avatar.

4 . The method of claim 1 , further comprising:
determining, based on the received tracking location and pose data for the avatar in the XR environment corresponding to the second user, a movement speed for the second user; and altering a size of the occlusion mask based on the detected movement speed.

5 . The method of claim 4 , wherein the size of the occlusion mask is increased when the determined movement speed meets a criteria.

6 . The method of claim 4 , wherein, when the determined movement speed is above a threshold, the size of the occlusion mask is set relative to the determined movement speed, until the occlusion mask reaches a maximum size.

7 . The method of claim 1 , further comprising:
rendering, by the first XR system, a second virtual object and an avatar that corresponds to a remote user in the shared XR environment; and generating a second occlusion mask attached relative, in the XR environment, to the location and geometry of the second virtual object, wherein the second occlusion mask causes portions of user avatars or virtual objects that are behind the second occlusion mask, from the point of view of the first user, to not be rendered, and wherein the generated second occlusion mask causes at least part of the avatar that corresponds to the remote user to not be displayed by the first XR system.

8 . A computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for configuring occlusion masks in an artificial reality (XR) environment, the process comprising:
rendering, by a first XR system of a first user, a shared XR environment, wherein the shared XR environment corresponds to a real-world room, wherein at least two users, including the first user, are local users in the real-world room, wherein the local users view at least part of the shared XR environment in A) mixed reality or B) in passthrough using a video capture of the real-world room; receiving, from a second XR system of a second user of the local users, tracking location and pose data for an avatar in the XR environment corresponding to the second user, wherein the avatar is not rendered by the first XR system in the XR environment; generating an occlusion mask attached relative, in the XR environment, to the location and pose data for the avatar of the second user, wherein the occlusion mask causes portions of virtual objects that are behind the occlusion mask, from the point of view of the first user, to not be rendered; and rendering a virtual object in the XR environment, wherein the generated occlusion mask causes at least part of the virtual object to not be displayed by the first XR system.

9 . The computer-readable storage medium of claim 8 , wherein the occlusion mask has a size that is larger than the avatar of the second user.

10 . The computer-readable storage medium of claim 8 , wherein a geometry for the occlusion mask A) corresponds to a geometry for the avatar of the second user and B) is larger in size than the geometry for the avatar.

11 . The computer-readable storage medium of claim 8 , wherein the process further comprises:
determining, based on the received tracking location and pose data for the avatar in the XR environment corresponding to the second user, a movement speed for the second user; and altering a size of the occlusion mask based on the detected movement speed.

12 . The computer-readable storage medium of claim 11 , wherein the size of the occlusion mask is increased when the determined movement speed meets a criteria.

13 . The computer-readable storage medium of claim 11 , wherein, when the determined movement speed is above a threshold, the size of the occlusion mask is set relative to the determined movement speed, until the occlusion mask reaches a maximum size.

14 . The computer-readable storage medium of claim 8 , wherein the process further comprises:
rendering, by the first XR system, a second virtual object and an avatar that corresponds to a remote user in the shared XR environment; and generating a second occlusion mask attached relative, in the XR environment, to the location and geometry of the second virtual object, wherein the second occlusion mask causes portions of user avatars or virtual objects that are behind the second occlusion mask, from the point of view of the first user, to not be rendered, and wherein the generated second occlusion mask causes at least part of the avatar that corresponds to the remote user to not be displayed by the first XR system.

15 . A computing system for configuring occlusion masks in an artificial reality (XR) environment, the computing system comprising:
one or more processors; and one or more memories storing instructions that, when executed by the one or more processors, cause the edge computing system to perform a process comprising:
rendering, by a first XR system of a first user, a shared XR environment that corresponds to a real-world room, wherein at least two users, including the first user view at least part of the shared XR environment in A) mixed reality or B) in passthrough using a video capture of the real-world room;
receiving, from a second XR system of a second user of the users, tracking location and pose data for an avatar in the XR environment corresponding to the second user, wherein the avatar is not rendered by the first XR system in the XR environment;
generating an occlusion mask attached relative, in the XR environment, to the location and pose data for the avatar; and
rendering a virtual object in the XR environment, wherein the generated occlusion mask causes at least part of the virtual object to not be displayed by the first XR system.

16 . The computing system of claim 15 , wherein the occlusion mask has a size that is larger than the avatar of the second user.

17 . The computing system of claim 15 , wherein a geometry for the occlusion mask A) corresponds to a geometry for the avatar of the second user and B) is la

Assignees

• Meta Platforms Tech Llc

Inventors

• Wanbo Björn
• Lebeau Michael James
• Steptoe William Arthur Hugh
• Mallinson Jonathan
• Wilson Steven James
• Rajendran Vasanth Kumar
• Baran Vasyl

Classifications

• G06T3/40

  Scaling of whole images or parts thereof, e.g. expanding or contracting · CPC title

• G06T2219/024

  Multi-user, collaborative environment · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title