Cluster-Based Dependency Signaling

Patent metadata

Field	Value
Publication number	US-2024114157-A1
Application number	US-202318528446-A
Country	US
Kind code	A1
Filing date	Dec 4, 2023
Priority date	Jul 15, 2013
Publication date	Apr 4, 2024
Grant date	—

Abstract

The signalization of the inter-layer dependencies between layers of a multi-layered data stream is described. A good compromise between a too intensive restriction of the potential diversity of inter-layer dependencies on the one hand and a too complex signaling of the inter-layer dependencies on the other hand has been found by describing the inter-layer dependencies by way of a first inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by a base layer-ID and a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by an extension layer-ID, the base layer ID and extension layer ID indexing the layers the portions of the multi-layer data stream are associated with. In accordance with this concept, emphasis may be shifted between increased diversity of the signalizable inter-layer dependencies on the one hand and reduced side-information overhead for signaling the inter-layer dependencies on the other hand.

First claim

1 - 20 . (canceled)

21 . A device configured to process a data stream representing a multi layered signal into which a video is coded at different layers, the data stream comprising a plurality of packets, each of which is associated with one of the different layers, the device configured to:
determine, for a first layer which belongs to a cluster of layers, whether a second layer of the cluster of layers is a direct reference layer for the first layer in terms of inter-layer prediction, by:
reading a first syntax element indicating inter-dependencies between layers within the cluster of layers, and
reading a second syntax element indicating whether the second layer is the direct reference layer for the first layer; and
subject packets of the first layer to decoding if the first layer is dependent on the second layer according to an inter-dependency structure.

22 . The device according to claim 21 , wherein the device is configured to read a third syntax element indicating a maximum number of layers in the cluster.

23 . The device according to claim 21 , wherein a value of a layer identification of the second layer is less than a value of a layer identification of the first layer.

23 . The device according to claim 21 , the device configured to, in subjecting packets of the first layer to decoding, decode a transform-coded prediction residual.

24 . The device according to claim 21 , the device configured to, in subjecting packets of the first layer to decoding, chose among spatial prediction, temporal prediction and the inter-layer prediction in units of blocks.

25 . A device configured to encode into a data stream representing a multi-layered signal a video using inter-layer prediction as different layers, the data stream comprising a plurality of packets, each of which is associated with one of the different layers, the device configured to:
determine, for a first layer which belongs to a cluster of layers, whether a second layer of the cluster of layers is a direct reference layer for the first layer in terms of inter-layer prediction; insert, into the data stream, a first syntax element indicating inter-dependencies between layers within the cluster of layers; and insert, into the data stream, a second syntax element indicating whether the second layer is the direct reference layer for the first layer, so that packets of the first layer are to be subject to decoding if the first layer is dependent on the second layer according to an inter-dependency structure.

26 . The device according to claim 25 , wherein the device is configured to insert, into the data stream, a third syntax element indicating a maximum number of layers in the cluster.

27 . The device according to claim 25 , wherein a value of a layer identification of the second layer is less than a value of a layer identification of the first layer.

28 . The device according to claim 25 , the device configured to encode packets of the first layer by use of transform coding of a prediction residual.

29 . The device according to claim 25 , the device configured to encode the first layer by choosing among spatial prediction, temporal prediction, and the inter-layer prediction in units of blocks.

30 . A method for decoding a data stream representing a multi-layered signal into which a video is coded using inter-layer prediction as different layers, the data stream comprising a plurality of packets, each of which is associated with one of the different layers, the method comprising:
determining, for a first layer which belongs to a cluster of layers, whether a second layer of the cluster of layers is a direct reference layer for the first layer in terms of inter-layer prediction, by:
reading a first syntax element indicating inter-dependencies between layers within the cluster of layers, and
reading a second syntax element indicating whether the second layer is the direct reference layer for the first layer; and
subjecting packets of the first layer to decoding if the first layer is dependent on the second layer according to an inter-dependency structure.

31 . A non-transitory computer-readable medium for storing data associated with a video, comprising:
a data stream stored in the non-transitory computer-readable medium, the data stream comprising a data stream representing a multi-layered signal a video using inter-layer prediction as different layers, the data stream comprising a plurality of packets, each of which is associated with one of the different layers, the data stream is obtained based on a plurality of operations comprising: determining, for a first layer which belongs to a cluster of layers, whether a second layer of the cluster of layers is a direct reference layer for the first layer in terms of inter-layer prediction; inserting, into the data stream, a first syntax element indicating inter-dependencies between layers within the cluster of layers; and inserting, into the data stream, a second syntax element indicating whether the second layer is the direct reference layer for the first layer, so that packets of the first layer are to be subject to decoding if the first layer is dependent on the second layer according to an inter-dependency structure.

32 . The non-transitory computer-readable medium according to claim 31 , the plurality of operations including inserting, into the data stream, a third syntax element indicating a maximum number of layers in the cluster.

33 . The non-transitory computer-readable medium according to claim 31 , wherein a value of a layer identification of the second layer is less than a value of a layer identification of the first layer.

34 . The non-transitory computer-readable medium according to claim 31 , the plurality of operations including encoding packets of the first layer by use of transform coding of a prediction residual.

35 . The non-transitory computer-readable medium according to claim 31 , the plurality of operations including encoding the first layer by choosing among spatial prediction, temporal prediction, and the inter-layer prediction in units of blocks.

Assignees

• Ge Video Compression Llc

Inventors

• Suehring Karsten
• Schierl Thomas
• Marpe Detlev
• Skupin Robert
• Sanchez De La Fuente Yago
• Tech Gerhard

Classifications

• H04N19/30 Primary

  using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) · CPC title

• H04N19/70 Primary

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N19/187

  the unit being a scalable video layer · CPC title

• H04L69/324

  in the data link layer [OSI layer 2], e.g. HDLC · CPC title

• H04N19/119

  Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks · CPC title