Dynamic Host Renderer For Artificial Reality Systems

Patent metadata

Field	Value
Publication number	US-2024371069-A1
Application number	US-202318311919-A
Country	US
Kind code	A1
Filing date	May 4, 2023
Priority date	May 4, 2023
Publication date	Nov 7, 2024
Grant date	—

Abstract

Aspects of the present disclosure are directed to a host renderer for artificial reality system(s) that provides dynamic rendering for application(s). Implementation of the host renderer decouple rendering of content from content source(s) to improve compatibility, extensibility, processing efficiency, and other aspects of content rendering. An artificial reality application can generate a scene graph with scene components, or renderable/drawable elements of the scene graph. The host renderer is configured to receive an encoded version of the artificial reality application's scene graph and issue processor rendering calls to render the drawable/renderable components of the scene graph. The host renderer abstracts the hardware level rendering calls and provides the artificial reality application access to hardware rendering via the host renderer. Implementations of the host renderer can perform rendering optimizations and issue a diverse set of processor rendering calls to diverse hardware.

First claim

I/We claim:

1 . A method for dynamically rendering scene components from multiple artificial reality (XR) applications using a host bridge, the method comprising:
receiving, at the host bridge, an encoded scene component, wherein, the encoded scene component stores information about a scene component originated by a non-native XR application, and the scene component comprises a renderable element; decoding, at the host bridge, the encoded scene component into one or more host bridge primitives; generating, at the host bridge, engine compatible rendering information using the one or more host bridge primitives, wherein the engine compatible rendering information comprises a) one or more engine compatible primitives converted from the one or more host bridge primitives, and/or b) one or more hardware level application programming interface calls generated using the one or more host bridge primitives; and providing, by the host bridge to a XR rendering engine, the engine compatible rendering information, wherein, the XR rendering engine issues, using the engine compatible rendering information, render draw calls to one or more processors that, in response to the render draw calls, render the scene component.

2 . The method of claim 1 , wherein,
the XR rendering engine receives one or more other engine compatible primitives that store information for a native scene component, the native scene component is originated by a native XR application, the render draw calls to the one or more processors are issued by the XR rendering engine using the engine compatible rendering information and the one or more other engine compatible primitives, and in response to the render draw calls, the one or more processors jointly render the scene component and native scene component.

3 . The method of claim 2 , wherein the render draw calls issued by the XR rendering engine comprise one or more rendering pipelines that cause the one or more processors to execute the one or more rendering pipelines and jointly render the scene component and the native scene component.

4 . The method of claim 1 , wherein,
the engine compatible rendering information comprises the one or more hardware level application programming interface calls, the one or more hardware level application programming interface calls render into a render target of the XR rendering engine, and the XR rendering engine generates the render draw calls such that the render target is applied to model information from one or more engine compatible primitives.

5 . The method of claim 4 , wherein the render target comprises an engine compatible material.

6 . The method of claim 5 , wherein, when the one or more processors execute the one or more draw calls, applying the engine compatible material to the model information from the one or more engine compatible primitives renders the scene component.

7 . The method of claim 1 , wherein the engine compatible rendering information comprises the one or more engine compatible primitives.

8 . The method of claim 7 , wherein,
the encoded scene component comprises encoded structure information and encoded material information, the host bridge primitives comprise decoded structure information and decoded material information generated by decoding the encoded structure information and encoded material information, and the one or more engine compatible primitives comprise engine compatible model information and engine compatible material information generated by converting the decoded structure information and decoded material information.

9 . The method of claim 8 , wherein the one or more processors execute the one or more draw calls using the engine compatible model information and engine compatible material information comprised by the one or more engine compatible primitives to render the scene component.

10 . A computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for dynamically rendering scene components from multiple artificial reality (XR) applications using a host bridge, the process comprising:
receiving, at the host bridge, an encoded scene component, wherein, the encoded scene component stores information about a scene component originated by a non-native XR application; decoding, at the host bridge, the encoded scene component into one or more host bridge primitives; generating, at the host bridge, engine compatible rendering information using the one or more host bridge primitives, wherein the engine compatible rendering information comprises a) one or more engine compatible primitives converted from the one or more host bridge primitives, and/or b) one or more hardware level application programming interface calls generated using the one or more host bridge primitives; and providing, by the host bridge to a XR rendering engine, the engine compatible rendering information, wherein, the XR rendering engine issues, using the engine compatible rendering information, render draw calls to one or more processors that, in response to the render draw calls, render the scene component.

11 . The computer-readable storage medium of claim 10 , wherein,
the XR rendering engine receives one or more other engine compatible primitives that store information for a native scene component, the native scene component is originated by a native XR application, the render draw calls to the one or more processors are issued by the XR rendering engine using the engine compatible rendering information and the one or more other engine compatible primitives, and in response to the render draw calls, the one or more processors jointly render the scene component and native scene component.

12 . The computer-readable storage medium of claim 11 , wherein the render draw calls issued by the XR rendering engine comprise one or more rendering pipelines that cause the one or more processors to execute the one or more rendering pipelines and jointly render the scene component and the native scene component.

13 . The computer-readable storage medium of claim 10 , wherein,
the engine compatible rendering information comprises the one or more hardware level application programming interface calls, the one or more hardware level application programming interface calls render into a render target of the XR rendering engine, and the XR rendering engine generates the render draw calls such that the render target is applied to model information from one or more engine compatible primitives.

14 . The computer-readable storage medium of claim 13 , wherein the render target comprises an engine compatible material.

15 . The computer-readable storage medium of claim 14 , wherein, when the one or more processors execute the one or more draw calls, applying the engine compatible material to the model information from the one or more engine compatible primitives renders the scene component.

16 . The computer-readable storage medium of claim 10 , wherein the engine compatible rendering information comprises the one or more engine compatible primitives.

17 . The computer-readable storage medium of claim 16 , wherein,
the encoded scene component comprises encoded structure information and encoded material information, the host bridge primitives comprise decoded structure information and decoded material information generated by decoding the encoded structure information and encoded material information, and the one or more engine compatible primitives comprise engine compatible model informat

Assignees

• Meta Platforms Tech Llc

Inventors

• Luh Walter J
• Sylvia Cameron
• Medvedev Alexey
• Griffith Eric

Classifications

• G06T9/00 Primary

  Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00) · CPC title

• G06T19/00

  Manipulating three-dimensional [3D] models or images for computer graphics · CPC title

• G06T15/005 Primary

  General purpose rendering architectures · CPC title