Two-level signaling of filtering information in video processing

Patent metadata

Field	Value
Publication number	US-11206406-B1
Application number	US-202117357020-A
Country	US
Kind code	B1
Filing date	Jun 24, 2021
Priority date	Mar 4, 2019
Publication date	Dec 21, 2021
Grant date	Dec 21, 2021

Abstract

A video processing method is provided to include performing a conversion between a coded representation of a video comprising one or more video regions and the video, wherein the coded representation includes a first side information at a first level, and wherein a second side information at a second level is derived from the first side information such that the second side information provides parameters for a video unit coded with in-loop reshaping (ILR) in which a reconstruction of the video unit of a video region is based on a representation of a video unit in a first domain and a second domain and/or scaling chroma residue of a chroma video unit.

First claim

What is claimed is:

1. A method of processing video data, comprising:
performing a conversion between a bitstream of a video comprising one or more video regions and the video,
wherein the bitstream includes a first side information at a first level, and
wherein a second side information at a second level is derived based on the first side information such that the second side information provides parameters for a video unit of a first video region coded with a certain coding tool in which a reconstruction of the video unit is based on at least one of:
1) a forward mapping process for a luma component of the video unit, in which prediction samples of the luma component of the video unit are converted from an original domain to a reshaped domain,
2) an inverse mapping process, which is an inverse operation of the forward mapping process, that convert reconstructed samples of the luma component of the video unit in the reshaped domain to the original domain, or
3) a scaling process, in which residual samples of a chroma component of the video unit are scaled before being used to reconstruct the chroma component.

2. The method of claim 1 , wherein the second side information is derived based on one or more syntax elements present in the second level.

3. The method of claim 1 , wherein the first level is an adaptation parameter set level and the second level is a picture level, tile group level, or tile level.

4. The method of claim 3 , wherein the second side information is derived based on a first syntax element present in the second level indicating an identifier of the adaptation parameter set of first side information.

5. The method of claim 1 , wherein the first side information is present in the adaptation parameter set associated with the certain coding tool and the second side information is associated with picture header.

6. The method of claim 1 , wherein the second side information is inherited from the first side information.

7. The method of claim 1 , wherein the second side information is predicted from the first side information.

8. The method of claim 1 , wherein at least one of the first side information or the second side information comprises at least one of: information to enable or disable the certain coding tool, parameters of a piecewise linear model using in the forward mapping process, parameters using in the scaling process, or information to enable or disable the scaling process.

9. The method of claim 1 , a piecewise linear model is used in the forward mapping process to map the prediction samples of the luma component of the video unit into particular values.

10. The method of claim 9 , wherein scale coefficients of the piecewise linear model are determined base on first variables which are determined base on the parameters in the second side information and a second variable which are determined base on a bit depth.

11. The method of claim 1 , wherein the conversion includes encoding the video into the bitstream.

12. The method of claim 1 , wherein the conversion includes decoding the video from the bitstream.

13. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
perform a conversion between a bitstream of a video comprising one or more video regions and the video,
wherein the bitstream includes a first side information at a first level, and
wherein a second side information at a second level is derived based on the first side information such that the second side information provides parameters for a video unit of a first video region coded with a certain coding tool in which a reconstruction of the video unit is based on at least one of
1) a forward mapping process for a luma component of the video unit, in which prediction samples of the luma component of the video unit are converted from an original domain to a reshaped domain,
2) an inverse mapping process, which is an inverse operation of the forward mapping process, that convert reconstructed samples of the luma component of the video unit in the reshaped domain to the original domain, or
3) a scaling process, in which residual samples of a chroma component of the video unit are scaled before being used to reconstruct the chroma component.

14. The apparatus of claim 13 , wherein the second side information is derived based on one or more syntax elements present in the second level.

15. The apparatus of claim 13 , wherein the first level is an adaptation parameter set level and the second level is a picture level, tile group level, or tile level.

16. The apparatus of claim 15 , wherein the second side information is derived based on a first syntax element present in the second level indicating an identifier of the adaptation parameter set of first side information.

17. A non-transitory computer-readable storage medium storing instructions that cause a processor to:
perform a conversion between a bitstream of a video comprising one or more video regions and the video,
wherein the bitstream includes a first side information at a first level, and
wherein a second side information at a second level is derived based on the first side information such that the second side information provides parameters for a video unit of a first video region coded with a certain coding tool in which a reconstruction of the video unit is based on at least one of
1) a forward mapping process for a luma component of the video unit, in which prediction samples of the luma component of the video unit are converted from an original domain to a reshaped domain,
2) an inverse mapping process, which is an inverse operation of the forward mapping process, that convert reconstructed samples of the luma component of the video unit in the reshaped domain to the original domain, or
3) a scaling process, in which residual samples of a chroma component of the video unit are scaled before being used to reconstruct the chroma component.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the second side information is derived based on one or more syntax elements present in the second level.

19. The non-transitory computer-readable storage medium of claim 17 , wherein the first level is an adaptation parameter set level and the second level is a picture level, tile group level, or tile level.

20. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
generating the bitstream of the video which comprises one or more video regions and the video,
wherein the bitstream includes a first side information at a first level, and
wherein a second side information at a second level is derived based on the first side information such that the second side information provides parameters for a video unit of a first video region coded with a certain coding tool in which a reconstruction of the video unit is based on at least one of:
1) a forward mapping process for a luma component of the video unit, in which prediction samples of the luma component of the video unit are converted from an original domain to a reshaped domain,
2) an inverse mapping process, which is an inverse operation of the forward mapping process, that convert reconstructed samples of the luma component of the video unit in the reshaped domain to the original domain, or
3) a scaling process, in w

Assignees

• Beijing Bytedance Network Tech Co Ltd
• Bytedance Inc

Inventors

• Zhang Li
• Zhang Kai
• Liu Hongbin
• Wang Yue

Classifications

• H04N19/82

  involving filtering within a prediction loop · CPC title

• H04N19/31

  in the temporal domain · CPC title

• H04N19/30

  using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) · CPC title

• H04N19/46 Primary

  Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) · CPC title

• H04N19/186

  the unit being a colour or a chrominance component · CPC title