Video parameter set constraints for subpicture sub-bitstream extraction

Patent metadata

Field	Value
Publication number	US-12513312-B2
Application number	US-202218077823-A
Country	US
Kind code	B2
Filing date	Dec 8, 2022
Priority date	Jun 9, 2020
Publication date	Dec 30, 2025
Grant date	Dec 30, 2025

Abstract

A method of processing video data includes performing a conversion between a video and a bitstream of the video. The bitstream includes one or more layers including one or more sublayers including one or more pictures including one or more subpictures according to a rule that specifies a rewriting operation selectively performed on one or more syntax structures during a subpicture sub-bitstream extraction process by which an output target sub-bitstream is extracted from the bitstream. The one or more syntax elements include information of the output target sub-bitstream.

First claim

The invention claimed is:

1 . A method of processing video data, comprising:
performing a conversion between a video and a bitstream of the video, wherein the bitstream comprises one or more layers comprising one or more sublayers comprising one or more pictures comprising one or more subpictures according to a rule, wherein the rule specifies a rewriting operation selectively performed on multiple syntax elements during a subpicture sub-bitstream extraction process by which an output target sub-bitstream is extracted from the bitstream, wherein the syntax elements include information of the output target sub-bitstream, wherein the syntax elements include: (a) a first syntax element that indicates a coding level to which the output target sub-bitstream conforms, and (b) a second syntax element that indicates coding levels to which sublayer sequences in the output target sub-bitstream having index values 0 to tIdTarget-1 conform, where tIdTarget is an integer representing a target highest temporal layer identifier of sublayers in the output target sub-bitstream, wherein the second syntax element is sublayer_level_idc[k], wherein the syntax elements include a fifth syntax element that is indicative of whether a sublayer sequence with a target highest temporal layer identifier tIdTarget in the output target sub-bitstream is handled as having a constant bit rate, wherein the rule further specifies that, during the subpicture sub-bitstream extraction process, a supplemental enhancement information (SEI) network abstraction layer (NAL) unit that includes a scalable nesting SEI message not applicable to the output target sub-bitstream is removed from the output target sub-bitstream, wherein the output target sub-bitstream includes one or more output layers including subpictures identified by one or more target subpicture indexes, and wherein the SEI NAL unit is considered not applicable to the output target sub-bitstream responsive to the scalable nesting SEI message with a flag having a predetermined value and a first one or more subpicture identifiers of the SEI NAL unit not matching a second one or more subpicture identifiers in the output target sub-bitstream.

2 . The method of claim 1 , wherein the syntax elements include: (a) a third syntax element that is indicative of a coded picture buffer (CPB) size of each sublayer sequence in the output target sub-bitstream, and (b) a fourth syntax element that indicates a bit rate value of each sublayer sequence in the output target sub-bitstream, wherein the each sublayer sequence has an index value k, where k is in the range of 0 to tIdTarget, inclusive, and where tIdTarget is an integer representing a target highest temporal layer identifier of sublayers in the output target sub-bitstream.

3 . The method of claim 1 , wherein when present, the syntax elements are included in a video parameter set referenced by the output target sub-bitstream.

4 . The method of claim 1 , wherein, in case that the output target sub-bitstream comprises a single layer, the syntax elements are included in a sequence parameter set referenced by the output target sub-bitstream.

5 . The method of claim 1 , wherein the video comprises a 360-degree video.

6 . The method of claim 1 , wherein the conversion comprises encoding the video into the bitstream.

7 . The method of claim 6 , further comprising storing the bitstream in a non-transitory computer-readable recording medium.

8 . The method of claim 1 , wherein the conversion comprises decoding the bitstream to generate pixel values of the video.

9 . An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
perform a conversion between a video and a bitstream of the video, wherein the bitstream comprises one or more layers comprising one or more sublayers comprising one or more pictures comprising one or more subpictures according to a rule, wherein the rule specifies a rewriting operation selectively performed on multiple syntax elements during a subpicture sub-bitstream extraction process by which an output target sub-bitstream is extracted from the bitstream, wherein the syntax elements include information of the output target sub-bitstream, wherein the syntax elements include: (a) a first syntax element that indicates a coding level to which the output target sub-bitstream conforms, and (b) a second syntax element that indicates coding levels to which sublayer sequences in the output target sub-bitstream having index values 0 to tIdTarget-1 conform, where tIdTarget is an integer representing a target highest temporal layer identifier of sublayers in the output target sub-bitstream, wherein the second syntax element is sublayer_level_idc[k], wherein the syntax elements include a fifth syntax element that is indicative of whether a sublayer sequence with a target highest temporal layer identifier tIdTarget in the output target sub-bitstream is handled as having a constant bit rate, wherein the rule further specifies that, during the subpicture sub-bitstream extraction process, a supplemental enhancement information (SEI) network abstraction layer (NAL) unit that includes a scalable nesting SEI message not applicable to the output target sub-bitstream is removed from the output target sub-bitstream, wherein the output target sub-bitstream includes one or more output layers including subpictures identified by one or more target subpicture indexes, and wherein the SEI NAL unit is considered not applicable to the output target sub-bitstream responsive to the scalable nesting SEI message with a flag having a predetermined value and a first one or more subpicture identifiers of the SEI NAL unit not matching a second one or more subpicture identifiers in the output target sub-bitstream.

10 . The apparatus of claim 9 , wherein the syntax elements include: (a) a third syntax element that is indicative of a coded picture buffer (CPB) size of each sublayer sequence in the output target sub-bitstream, and (b) a fourth syntax element that indicates a bit rate value of each sublayer sequence in the output target sub-bitstream, wherein the each sublayer sequence has an index value k, where k is in the range of 0 to tIdTarget, inclusive, and where tIdTarget is an integer representing a target highest temporal layer identifier of sublayers in the output target sub-bitstream.

11 . The apparatus of claim 9 , wherein when present, the syntax elements are included in a video parameter set referenced by the output target sub-bitstream, and
wherein, in case that the output target sub-bitstream comprises a single layer, the syntax elements are included in a sequence parameter set referenced by the output target sub-bitstream.

12 . A non-transitory computer-readable storage medium storing instructions that cause a processor to:
perform a conversion between a video and a bitstream of the video, wherein the bitstream comprises one or more layers comprising one or more sublayers comprising one or more pictures comprising one or more subpictures according to a rule, wherein the rule specifies a rewriting operation selectively performed on multiple syntax elements during a subpicture sub-bitstream extraction process by which an output target sub-bitstream is extracted from the bitstream, wherein the syntax elements include information of the output target sub-bitstream, wherein the syntax elements include: (a) a first syntax element that indicates a coding level to which the output target sub-bitstream conforms, and (b) a second syntax element that indicates

Assignees

• Bytedance Inc

Inventors

• Wang Ye-Kui

Classifications

• H04N19/188

  the unit being a video data packet, e.g. a network abstraction layer [NAL] unit · CPC title

• H04N19/172

  the region being a picture, frame or field · CPC title

• H04N19/70

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N19/597

  specially adapted for multi-view video sequence encoding · CPC title

• H04N19/30 Primary

  using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) · CPC title