Syntax structures for high dynamic range and wide color gamut video coding

Patent metadata

Field	Value
Publication number	US-10595032-B2
Application number	US-201816103622-A
Country	US
Kind code	B2
Filing date	Aug 14, 2018
Priority date	Sep 21, 2015
Publication date	Mar 17, 2020
Grant date	Mar 17, 2020

Abstract

This disclosure relates to processing video data, including processing video data that is represented by an HDR/WCG color representation. In accordance with one or more aspects of the present disclosure, one or more syntax structures may be used to signal syntax elements and or other information that allow a video decoder or video postprocessing device to reverse the dynamic range adjustment (DRA) techniques of this disclosure to reconstruct the original or native color representation of the video data. Dynamic range adjustment (DRA) parameters may be applied to video data in accordance with one or more aspects of this disclosure in order to make better use of an HDR/WCG color representation, and may include the use of global offset values, as well as local scale and offset values for partitions of color component values.

First claim

What is claimed is:

1. A method of decoding video data that has been adjusted by performing a dynamic range adjustment, the method comprising:
receiving at least one syntax structure from an encoded video bitstream, the at least one syntax structure indicating adjustment information specifying how the dynamic range adjustment has been applied to the video data, and wherein the adjustment information includes:
a tone mapping adjustment value that indicates color values can be trimmed to a maximum or a minimum value, and
a number of partitions into which the video data was partitioned during the dynamic range adjustment; and

performing an inverse dynamic range adjustment on the video data in accordance with the adjustment information to generate unadjusted component values from the video data,
wherein performing the inverse dynamic range adjustment includes generating the unadjusted component values according to the number of partitions.

2. The method of claim 1 , wherein the adjustment information further includes a global offset value that applies to each of the partitions into which the video data was partitioned during the dynamic range adjustment.

3. The method of claim 2 ,
wherein the global offset value is a first global offset value, the first global offset value being substituted, prior to performing the dynamic range adjustment on the video data, for unadjusted component values less than the first global offset value;
wherein the adjustment information further includes a second global offset value; and
wherein performing the inverse dynamic range adjustment on the video data includes:
mapping component values matching the second global offset value to the first global offset value.

4. The method of claim 1 , wherein the video data includes luma components and chroma components, wherein the adjustment information includes a first number of partitions into which the luma components were partitioned during the dynamic range adjustment, a second number of partitions into which a first set of the chroma components were partitioned during the dynamic range adjustment, and a third number of partitions into which a second set of the chroma components were partitioned during the dynamic range adjustment, and wherein performing the inverse dynamic range adjustment includes:
generating unadjusted luma component values according to the first number of partitions;
generating unadjusted chroma component values corresponding to the first set of chroma components according to the second number of partitions; and
generating unadjusted chroma component values corresponding to the second set of chroma components according to the third number of partitions.

5. The method of claim 1 , further comprising:
deriving additional adjustment information from the at least one syntax structure, the additional adjustment information further specifying how the dynamic range adjustment has been applied to the video data.

6. The method of claim 1 , wherein performing the inverse dynamic range adjustment on the video data includes:
determining for each input sample for each component of the video data, a partition to which the input sample belongs, and
generating, for each of the partitions, the unadjusted component values.

7. The method of claim 1 , wherein the adjustment information further includes a local offset value and a local scale value for each of the partitions, and wherein generating the unadjusted component values includes:
generating the unadjusted component values according to the local offset value and the local scale value.

8. The method of claim 7 , wherein the local offset value for each of the partitions is represented by a first number of bits and a second number of bits, wherein the first number of bits is used to represent an integer part of the local offset value and the second number of bits is used to represent a fractional part of the local offset value, wherein the adjustment information further includes the first number of bits and the second number of bits, and
wherein performing the inverse dynamic range adjustment on the video data includes:
generating the unadjusted component values according to the local offset value for each of the partitions as represented by the first number of bits and the second number of bits.

9. The method of claim 7 , wherein the local scale value for each of the partitions is represented by a first number of bits and a second number of bits, wherein the first number of bits is used to represent an integer part of the local scale value and the second number of bits is used to represent a fractional part of the local scale value, wherein the adjustment information further includes the first number of bits and the second number of bits, and
wherein performing the inverse dynamic range adjustment on the video data includes:
generating the unadjusted component values according to the local scale value for each of the partitions as represented by the first number of bits and the second number of bits.

10. A method of encoding video data comprising:
performing a dynamic range adjustment on the video data to generate adjusted component values from the video data; and
generating at least one syntax structure in an encoded video bitstream, the at least one syntax structure indicating adjustment information specifying how the dynamic range adjustment has been applied to the video data, wherein the adjustment information includes:
a tone mapping adjustment value that indicates color values can be trimmed to a maximum or a minimum value, and
a number of partitions into which the video data was partitioned during the dynamic range adjustment, and

wherein performing the dynamic range adjustment includes generating the adjusted component values according to the number of partitions.

11. The method of claim 10 , wherein the adjustment information further includes a local offset value and a local scale value for each of the partitions, and wherein performing the dynamic range adjustment on the video data includes:
generating the adjusted component values according to the local offset value and the local scale value.

12. The method of claim 11 , wherein the local offset value for each of the partitions is represented by a first number of bits and a second number of bits, wherein the first number of bits is used to represent an integer part of the local offset value and the second number of bits is used to represent a fractional part of the local offset value, wherein the adjustment information further includes the first number of bits and the second number of bits, and
wherein performing the dynamic range adjustment on the video data includes:
generating the adjusted component values according to the local offset value for each of the partitions as represented by the first number of bits and the second number of bits.

13. An apparatus configured to decode video data that has been adjusted by performing a dynamic range adjustment, the apparatus comprising:
a memory configured to store the video data; and
one or more processors configured to:
receive at least one syntax structure in an encoded video bitstream, the at least one syntax structure indicating adjustment information specifying how the dynamic range adjustment has been applied to the video data, and wherein the adjustment information includes:
a tone mapping adjustment value that indicates color values can be trimmed to a maximum or a minimum value, and
a number of partitions into which the video data was partitioned during the dynamic range adjustment; and

perform an inverse dynamic range adjustment on the video data in accordance with t

Assignees

• Qualcomm Inc

Inventors

• Ramasubramonian Adarsh Krishnan
• Rusanovskyy Dmytro
• Sole Rojals Joel
• Lee Sungwon
• Bugdayci Sansli Done
• Karczewicz Marta

Classifications

• H04N19/36 Primary

  Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability · CPC title

• H04N19/85

  using pre-processing or post-processing specially adapted for video compression · CPC title

• H04N19/70

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N19/80

  Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence) · CPC title

• H04N19/186

  the unit being a colour or a chrominance component · CPC title