Method and apparatus for storage and signaling of sub-sample entry descriptions

Patent metadata

Field	Value
Publication number	US-2021105492-A1
Application number	US-202017061610-A
Country	US
Kind code	A1
Filing date	Oct 2, 2020
Priority date	Oct 2, 2019
Publication date	Apr 8, 2021
Grant date	—

Abstract

Described are methods, apparatuses and computer program products for signaling and storing compressed point clouds. Sub-sample entries associated with sequences of sub-samples within sequences of samples may indicate whether sequences of sub-samples were encapsulated alone in a track, without other sub-samples or additional header data. Sub-sample entry types can be indexed at track-level sub-sample description boxes. Point cloud compression coded bitstream component types may be signaled by including respective point cloud unit header information in a codec-specific parameters-related field of track level sub-sample description boxes. Sub-sample information boxes may indicate sub-sample entry indices for respective sub-samples. A flag in such information boxes may indicate the presence of sub-sample description entry indexes. Description index boxes can contain sub-sample description entry indexes in the same container as sub-sample information boxes. Track fragment header boxes can include sub-sample description entry indices that apply to samples of a track fragment.

First claim

That which is claimed is:

1 . A method comprising:
accessing a point cloud compression coded bitstream, said point cloud compression coded bitstream configured to be stored as one or more media tracks; forming a track level sub-sample description box comprising a plurality of sub-sample entry types for a respective plurality of sub-samples; and indicating one or more types of point cloud compression coded bitstream components by including respective point cloud unit header information in a codec-specific parameters-related field of the track level sub-sample description box.

2 . The method of claim 1 , further comprising:
extending a sub-sample information box to indicate the sub-sample entry index by indicating a presentation order of a sub-sample entry in a related sub-sample description box and indicating that the sub-sample entry index is present in the sub-sample information box using a version value or by setting a flag within said sub-sample information box.

3 . The method of claim 1 , further comprising:
accessing the attribute information bitstreams, the geometry information bitstreams, the occupancy information bitstream and the patch information bitstream; detecting that the attribute information bitstreams, the geometry information bitstreams, the occupancy information bitstream and the patch information bitstream follow a compatible coding and timing structure; and causing construction and storage of a video media track based at least upon the compatible coding and timing structure.

4 . The method of claim 1 , wherein said at least one media track has a packing type that is signaled via said sub-sample entry index.

5 . The method of claim 1 , wherein said point cloud compression coded bitstream comprises at least one attribute information bitstream, at least one geometry information bitstream, at least one occupancy information bitstream, and at least one patch information bitstream.

6 . The method of claim 5 , further comprising:
accessing the attribute information bitstreams, the geometry information bitstreams, the occupancy information bitstream and the patch information bitstream; storing the attribute information bitstreams in an attribute video media track; storing the geometry information bitstream in a geometry video media track; storing the occupancy information bitstream in an occupancy video media track; storing the patch information bitstream in another coded media or metadata track; and causing construction and storage of metadata in the file indicating a pattern for one or more components of the attribute video media track, the geometry video media track, the occupancy video media track, and the separate coded media or metadata track.

7 . The method of claim 6 , wherein the metadata is interleaved indicator metadata indicating an interleaving pattern for said one or more components of the attribute video media track, the geometry video media track, the occupancy video media track, and the separate coded media or metadata track.

8 . The method of claim 6 , wherein each of said one or more components for which the pattern is indicated are accessible using the sub-sample information box, said sub-sample-information box defining said presentation order and configuration information for said one or more components, said sub-sample information box configured to indicate said pattern.

9 . An apparatus comprising at least one processor and at least one memory including computer program code for one or more programs, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:
access a point cloud compression coded bitstream, said point cloud compression coded bitstream configured to be stored as one or more media tracks; form a track level sub-sample description box comprising a plurality of sub-sample entry types for a respective plurality of sub-samples; and indicate one or more types of point cloud compression coded bitstream components by including respective point cloud unit header information in a codec-specific parameters-related field of the track level sub-sample description box.

10 . The apparatus of claim 9 , wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus at least to:
extend a sub-sample information box to indicate the sub-sample entry index by indicating a presentation order of a sub-sample entry in a related sub-sample description box and indicating that the sub-sample entry index is present in the sub-sample information box using a version value or by setting a flag within said sub-sample information box.

11 . The apparatus of claim 9 , wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus at least to:
access the attribute information bitstreams, the geometry information bitstreams, the occupancy information bitstream and the patch information bitstream; detect that the attribute information bitstreams, the geometry information bitstreams, the occupancy information bitstream and the patch information bitstream follow a compatible coding and timing structure; and cause construction and storage of a video media track based at least upon the compatible coding and timing structure.

12 . The apparatus of claim 9 , wherein said at least one media track has a packing type that is signaled via said sub-sample entry index.

13 . The apparatus of claim 9 , wherein said point cloud compression coded bitstream comprises at least one attribute information bitstream, at least one geometry information bitstream, at least one occupancy information bitstream, and at least one patch information bitstream.

14 . The apparatus of claim 13 , wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus at least to:
access the attribute information bitstreams, the geometry information bitstreams, the occupancy information bitstream and the patch information bitstream; store the attribute information bitstreams in an attribute video media track; store the geometry information bitstream in a geometry video media track; store the occupancy information bitstream in an occupancy video media track; store the patch information bitstream in another coded media or metadata track; and cause construction and storage of metadata in the file indicating a pattern for one or more components of the attribute video media track, the geometry video media track, the occupancy video media track, and the separate coded media or metadata track.

15 . The apparatus of claim 14 , wherein the metadata is interleaved indicator metadata indicating an interleaving pattern for said one or more components of the attribute video media track, the geometry video media track, the occupancy video media track, and the separate coded media or metadata track.

16 . The apparatus of claim 14 , wherein each of said one or more components for which the pattern is indicated are accessible using the sub-sample information box, said sub-sample-information box defining said presentation order and configuration information for said one or more components, said sub-sample information box configured to indicate said pattern.

17 . A computer program product comprises at least one non-transitory computer-readable storage medium having computer executable program code instructions stored therein, the computer executable program

Assignees

• Nokia Technologies Oy

Inventors

• Aksu Emre Baris
• Hannuksela Miska Matias

Classifications

• H04N21/2362

  Generation or processing of Service Information [SI] · CPC title

• H04N21/854

  Content authoring · CPC title

• H04N19/597 Primary

  specially adapted for multi-view video sequence encoding · CPC title

• H04N19/70

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N19/136

  Incoming video signal characteristics or properties · CPC title