Picture coding supporting block merging and skip mode

Patent metadata

Field	Value
Publication number	US-12137242-B2
Application number	US-202318363057-A
Country	US
Kind code	B2
Filing date	Aug 1, 2023
Priority date	Nov 4, 2010
Publication date	Nov 5, 2024
Grant date	Nov 5, 2024

Abstract

A coding efficiency increase is achieved by using a common signalization within the bitstream with regard to activation of merging and activation of the skip mode. One possible state of one or more syntax elements within the bitstream may signalize for a current sample set of a picture that the sample set is to be merged and has no prediction residual encoded and inserted into the bitstream. A common flag may signalize whether the coding parameters associated with a current sample set are to be set according to a merge candidate or to be retrieved from the bitstream, and whether the current sample set of the picture is to be reconstructed based on a prediction signal depending on the coding parameters associated with the current sample set, without any residual data, or to be reconstructed by refining the prediction signal depending on the coding parameters associated with the current sample set by means of residual data within the bitstream.

First claim

The invention claimed is:

1. An apparatus having a processor and a memory for decoding a bitstream having a picture encoded therein, comprising:
a subdivider implemented on the processor and configured to subdivide the picture into sample sets of samples;
a merger implemented on the processor and configured to merge the sample sets into groups of one or more sample sets each;
a decoder implemented on the processor and configured to decode the picture using coding parameters transmitted in the bitstream in units of the groups of sample sets, wherein the decoder is configured to decode the picture by predicting the picture, decoding a prediction residual for predetermined sample sets and combining the prediction residual and a prediction resulting from predicting the picture, for the predetermined sample sets;
an extractor implemented on the processor and configured to extract the prediction residual and the coding parameters from the bitstream, along with one or more syntax elements for each of at least a subset of the sample sets, indicating as to whether the respective sample set is to be merged into one of the groups along with another sample set or not, wherein the merger is configured to perform the merging responsive to the one or more syntax elements,
wherein the extractor and the merger are configured to sequentially step through the sample sets according to a sample set scan order, and, for a current sample set, to:
extract a first binary syntax element from the bitstream using arithmetically decoding using a first context;
if the first binary syntax element assumes a first binary state, merge the current sample set into one of the groups by inferring the coding parameters for the current sample set to be equal to the coding parameter associated with this group, skip the extraction of the prediction residual for the current sample set and step to the next sample set in sample set scan order;
if the first binary syntax element assumes a second binary state, extract a second syntax element from the bitstream using arithmetically decoding using a second context different from the first context; and
depending on the second syntax element,
extract a third syntax element from the bitstream using arithmetically decoding using a third context different from the first context and the second context and merge the current sample set into one of the groups by inferring the coding parameters for the current sample set to be equal to the coding parameters associated with one of a set of predetermined candidate sample sets neighboring the respective sample set, which is signaled by the third syntax element, with extracting at least one further syntax element concerning the prediction residual for the current sample set or
perform the extraction of the coding parameters for the current sample set with extracting at least one further syntax element concerning the prediction residual for the current sample set,

wherein the prediction residual is represented by transformation coefficient levels.

2. The apparatus according to claim 1 , wherein the extractor is also configured to extract subdivision information from the bitstream, and the subdivider is configured to subdivide the picture into sample sets responsive to the subdivision information.

3. The apparatus according to claim 1 , wherein the bitstream further comprises a depth map with which the picture is associated.

4. The apparatus according to claim 1 , wherein the array of information samples is one of samples arrays related to different planes of the picture, which are coded independently from each other.

5. An apparatus having a processor and a memory for encoding a picture, comprising:
a subdivider implemented on the processor and configured to subdivide the picture into sample sets of samples;
a merger implemented on the processor and configured to merge the sample sets into groups of one or more sample sets each;
an encoder implemented on the processor and configured to encode the picture using coding parameters transmitted in the bitstream in units of the groups of sample sets, wherein the encoder is configured to encode the picture by predicting the picture and encoding a prediction residual for predetermined sample sets;
a stream generator implemented on the processor and configured to insert the prediction residual and the coding parameters into a bitstream, along with one or more syntax elements for each of at least a subset of the sample sets, indicating as to whether the respective sample set is merged into one of the groups along with another sample set or not,
wherein the stream generator is configured to sequentially step through the sample sets according to a sample set scan order, and, for a current sample set, to
insert a first binary syntax element into the bitstream using arithmetically encoding using a first context,
wherein the first binary syntax element indicates, when assuming a first binary state, that the current sample set is to be merged into one of the groups by inferring the coding parameters for the current sample set to be equal to the coding parameter associated with this group, and that the extraction of the prediction residual is to be skipped for the current sample set and the next sample set in sample set scan order is to be stepped to;

if the first binary syntax element assumes a second binary state,
insert a second syntax element into the bitstream using arithmetically encoding using a second context different from the first context; and
insert at least one further syntax element concerning the prediction residual for the current sample set,
wherein the second syntax element indicates whether the current sample set is to be merged into one of the groups or the extraction of the coding parameters is to be performed for the current sample set, wherein the stream generator is configured to, if the second syntax element indicates that the current sample set is to be merged, merge the current sample set by inferring the coding parameters for the current sample set to be equal to the coding parameters associated with one of a set of predetermined candidate sample sets neighboring the respective sample set, and insert a third syntax element into the bitstream, which signals the one of the set of predetermined candidate sample sets, using arithmetically encoding using a third context different from the first context and the second context,

wherein the prediction residual is represented by transformation coefficient levels.

6. The apparatus according to claim 5 , wherein the bitstream further comprising a depth map with which the picture is associated.

7. The apparatus according to claim 5 , wherein the array of information samples is one of samples arrays related to different planes of the picture, which are coded independently from each other.

8. A method for decoding a bitstream having a picture encoded therein, the method comprising:
subdividing the picture into sample sets of samples;
merging the sample sets into groups of one or more sample sets each;
decoding the picture using coding parameters transmitted in the bitstream in units of the groups of sample sets, wherein the decoder is configured to decode the picture by predicting the picture, decoding a prediction residual for predetermined sample sets and combining the prediction residual and a prediction resulting from predicting the picture, for the predetermined sample sets;
extracting the prediction residual and the coding parameters from the bitstream, along with one or more syntax elements for each of at least a subset of the sample sets, indicating as to whether the respective sample set is to be merged into one of the groups along with another sample set or not, wherein the merger is conf

Assignees

• Ge Video Compression Llc

Inventors

• Schwarz Heiko
• Kirchhoffer Heiner
• Helle Philipp
• Oudin Simon
• Stegemann Jan
• Bross Benjamin
• Marpe Detlev
• Wiegand Thomas

Classifications

• H04N19/184

  the unit being bits, e.g. of the compressed video stream · CPC title

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title

• H04N19/172

  the region being a picture, frame or field · CPC title

• H04N19/70 Primary

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N19/50

  using predictive coding (H04N19/61 takes precedence) · CPC title