Multi-track based immersive media playout

Patent metadata

Field	Value
Publication number	US-12250359-B2
Application number	US-202217816093-A
Country	US
Kind code	B2
Filing date	Jul 29, 2022
Priority date	Jan 15, 2021
Publication date	Mar 11, 2025
Grant date	Mar 11, 2025

Abstract

Methods, apparatus, and systems for dynamically indicating a playout group in various scenarios are disclosed. In one example aspect, a method includes determining a playout group corresponding to a volumetric video in a three-dimensional space based on a playout group information, the playout group including a plurality of components, wherein each component of a certain type has a version that is different from another component of the certain type, obtaining a two-dimensional volumetric video content from a media track corresponding to the playout group, and reconstructing the volumetric video into a three-dimensional space based on the plurality of components with different versions.

First claim

What is claimed is:

1. A method of processing media content, comprising:
determining a playout group corresponding to a volumetric video in a three-dimensional space based on a playout group information, the playout group including a plurality of components, wherein each component of a certain type has a version that is different from another component of the certain type;
obtaining a two-dimensional volumetric video content from a media track corresponding to the playout group, wherein the plurality of components in the playout group includes components with different versions that correspond to a same atlas or atlas tile and are respectively stored in different media tracks; and
reconstructing the volumetric video into a three-dimensional space based on the plurality of components with different versions.

2. The method of claim 1 , wherein the components include visual volumetric video-based coding (V3C) components, wherein the V3C components includes at least one of occupancy components, geometry components, or attribute components, wherein different versions of the occupancy components, different versions of the geometry components, and different versions of the attribute components, respectively, have dependency between each other.

3. The method of claim 1 , wherein the playout group includes V3C components from multiple alternative track groups.

4. The method of claim 1 , wherein the different versions include at least one of different encoding methods, different bit rates, or different resolutions.

5. The method of claim 1 , wherein the components in the playout group correspond to one or more atlases or atlas tiles, wherein each atlas or atlas tile corresponds to at least one of an attribute component, an occupancy component, or a geometry component with multiple versions.

6. The method of claim 1 , wherein the playout group is configured based on: a timed-metadata track for configuring dynamic playout grouping information in a sample entry or in one or more samples belonging to the sample entry or in the sample entry and the one or more samples belonging to the sample entry, or a sample group including samples in a track contained video-encoded component data or a track contained atlas or atlas tile.

7. The method of claim 1 , wherein configuration information of the playout group is described by a dynamic playout group configuration box identified by a box type.

8. The method of claim 7 , wherein the dynamic playout group configuration box includes at least one of: one or more playout group structures; one or more identifiers of viewport; or one or more quality levels of playout group.

9. A method of processing media content, comprising:
configuring, by a server, a playout group including one or more types of components, wherein the plurality of components in the playout group includes components with different versions that correspond to a same atlas or atlas tile and are respectively stored in different media tracks;
configuring, by the server, a playout group information corresponding to the playout group; and
transmitting, by the server, to a user device, the playout group information in a media presentation description.

10. The method of claim 9 , wherein the components include visual volumetric video-based coding (V3C) components, wherein the V3C components includes at least one of occupancy components, geometry components, or attribute components.

11. The method of claim 9 , further comprising adding at least one of a playout group identifier corresponding to the playout group or an alternative group identifier to the media presentation description to indicate the playout group information.

12. The method of claim 11 , wherein the playout group identifier corresponds to one or more playout groups associated with V3C components in a presentation set or V3C components in an adaptation set.

13. The method of claim 9 , further comprising adding at least one of a playout group identifier corresponding to the playout group or an alternative group identifier to an adaptation set or presentation set to indicate the playout group information in dynamic adaptive streaming over hypertext transfer protocol (DASH).

14. The method of claim 9 , further comprising configuring a playout group descriptor to include playout group information in the media presentation description.

15. The method of claim 14 , wherein the playout group descriptor corresponds to V3C components in a representation set associated with one or more playout groups.

16. The method of claim 14 , wherein the playout group descriptor includes at least of one or more identifiers of playout group, one or more quality levels of playout group, or one or more identifiers of V3C component in an adaptation set.

17. An apparatus for wireless communication, comprising a memory and a processor, wherein the processor reads code from the memory and implements a method of processing media content, the method comprising:
determining a playout group corresponding to a volumetric video in a three-dimensional space based on a playout group information, the playout group including a plurality of components, wherein each component of a certain type has a version that is different from another component of the certain type;
obtaining a two-dimensional volumetric video content from a media track corresponding to the playout group, wherein the plurality of components in the playout group includes components with different versions that correspond to a same atlas or atlas tile and are respectively stored in different media tracks; and
reconstructing the volumetric video into a three-dimensional space based on the plurality of components with different versions.

18. The apparatus of claim 17 , wherein the components include visual volumetric video-based coding (V3C) components, wherein the V3C components includes at least one of occupancy components, geometry components, or attribute components, wherein different versions of the occupancy components, different versions of the geometry components, and different versions of the attribute components, respectively, have dependency between each other.

19. The apparatus of claim 17 , wherein the playout group includes V3C components from multiple alternative track groups.

20. The apparatus of claim 17 , wherein the different versions include at least one of different encoding methods, different bit rates, or different resolutions.

Assignees

• Zte Corp

Inventors

• Li Qiuting

Classifications

• H04N13/161 Primary

  Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) · CPC title

• H04N13/194

  Transmission of image signals · CPC title

• H04N13/178

  Metadata, e.g. disparity information · CPC title

• H04N19/70 Primary

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N19/132

  Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking · CPC title