3D scene description data, scene rendering apparatus for rendering a scene from 3D scene description data, and apparatus for encoding a scene into 3D scene description data

Patent metadata

Field	Value
Publication number	US-12555308-B2
Application number	US-202318455161-A
Country	US
Kind code	B2
Filing date	Aug 24, 2023
Priority date	Feb 27, 2021
Publication date	Feb 17, 2026
Grant date	Feb 17, 2026

Abstract

Scene rendering apparatus for rendering a scene from a 3D scene description data, configured to derive, from the 3D scene description data, first data defining a 3D object and second data defining an animation of the object and trigger condition information which defines a condition for viewing position and/or viewing orientation. Additionally, the scene rendering apparatus is configured to check whether the condition for viewing position and/or viewing orientation is met, and responsive to the condition for viewing position and/or viewing orientation being met, trigger the animation of the object.

First claim

The invention claimed is:

1 . A scene rendering apparatus for rendering a scene from a 3D scene description data, the apparatus configured to:
derive, from the 3D scene description data, first data defining a movable 3D object, and second data defining a movability of the movable 3D object and movement constraint information which defines constraints for the movability of the movable 3D object.

2 . The scene rendering apparatus of claim 1 , configured to obey the constraints for the movability of the movable 3D object in moving the movable 3D object according to user interaction.

3 . The scene rendering apparatus of claim 1 , configured to derive from first data mesh information on a definition of a mesh of the movable 3D object and a definition of a skeleton of the movable 3D object.

4 . The scene rendering apparatus of claim 3 , configured to derive from the second data
information on a plurality of morph targets, each morph target defining a compensating deformation of a first mesh for assuming a respective primitive pose and an indication of a subset of morph targets out of the plurality of morph targets, a usage of which is available in moving the movable 3D object during a time sub-period, while any morph targets not comprised by the subset is unavailable, wherein a persistence of the definition of the mesh of the movable 3D object, the definition of the skeleton of the movable 3D object and the information on a plurality morph targets exceed the time sub-period, and/or updates on an indication of a set of morph targets which define a compensating deformation of the first mesh for assuming a respective primitive pose, wherein the updates change the indication so that the set of morph targets temporally changes during the persistence of the definition of the mesh of the movable 3D object and the definition of the skeleton of the moveable 3D object.

5 . The scene rendering apparatus of claim 4 , configured to derive updates on the indication of the subset of morph targets so that the subset changes in consecutive time sub-periods.

6 . The scene rendering apparatus of claim 3 , configured to derive from the second data
joint information on joints of the skeleton, and joint constraint information indicating a restriction of a space of freedom of the joints and/or indicating a selection out of the joints which are immobilized.

7 . The scene rendering apparatus of claim 6 , wherein the joint constraint information restricts the space of freedom of the joints by way of restricting an angular movability range of the joints.

8 . The scene rendering apparatus of claim 6 , wherein the joint constraint information restricts the space of freedom of the joints by way of restricting an translational movability range of the joints.

9 . The scene rendering apparatus of claim 6 , configured to derive updates of the joint constraint information so that the restriction of the space of freedom of the joints and/or the selection out of the joints which are immobilized temporally changes.

10 . The scene rendering apparatus of claim 1 , configured to derive from the second data
information on a plurality of morph targets associated with the movable 3D object for a time period and an indication of a subset of morph targets out of the plurality of morph targets, a usage of which is available in moving the movable 3D object during a time sub-period within the time period, while any morph target not comprised by the subset is unavailable, and/or updates on an indication of a set of morph targets available in moving the movable 3D object, wherein the updates change the indication so that the set of morph targets temporally changes.

11 . The scene rendering apparatus of claim 1 , configured to derive from the second data
joint information on joints of the movable 3D object, and joint constraint information indicating a restriction of a space of freedom of the joints and/or indicating a selection out of the joints which are immobilized.

12 . The scene rendering apparatus of claim 1 , configured to derive the movement constraint information from
an extension portion of a section of a glTF file of the 3D scene description data, the section relating to the movable 3D object, or a meta data track of the glTF file.

13 . The scene rendering apparatus of claim 1 , wherein
the 3D scene description data defines a default movement of the movable 3D object, and the movement constraint information defines the constraints for the movability of the movable 3D object relative to poses of the movable 3D object defined by the default movement.

14 . A method for rendering a scene from a 3D scene description data, comprising deriving, from the 3D scene description data, first data defining a movable 3D object, and second data defining a movability of the movable 3D object and movement constraint information which defines constraints for the movability of the movable 3D object.

15 . A non-transitory digital storage medium having a computer program stored thereon, when executed by a processor, to perform a method for rendering a scene from a 3D scene description data, comprising deriving, from the 3D scene description data, first data defining a movable 3D object, and second data defining a movability of the movable 3D object and movement constraint information which defines constraints for the movability of the movable 3D object.

Assignees

• Fraunhofer Ges Forschung

Inventors

• Hellge Cornelius
• Schierl Thomas
• Eisert Peter
• Hilsmann Anna
• Skupin Robert
• Sánchez De La Fuente Yago
• Morgenstern Wieland
• Bhullar Gurdeep Singh

Classifications

• G06T17/20

  Finite element generation, e.g. wire-frame surface description, {tesselation} · CPC title

• G06T13/40

  of characters, e.g. humans, animals or virtual beings · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T15/205

  Image-based rendering · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title