Apparatus, a method and a computer program for video coding and decoding

Patent metadata

Field	Value
Publication number	US-2016286226-A1
Application number	US-201514666713-A
Country	US
Kind code	A1
Filing date	Mar 24, 2015
Priority date	Mar 24, 2015
Publication date	Sep 29, 2016
Grant date	—

Abstract

A method comprising: obtaining a video bitstream comprising a low dynamic range (LDR) video representation; obtaining one or more tone mapping operators and an indication of at least one tone mapping operator to be applied; decoding enhancement data relating to said LDR video representation; modifying the LDR video representation into a first high dynamic range (HDR) video representation using said at least one tone mapping operator determined by said indication; and combining the first HDR video representation and the enhancement data relating to said LDR video representation to provide a second HDR video representation.

First claim

1 . A method comprising:
obtaining a video bitstream comprising a low dynamic range (LDR) video representation; obtaining, either from the video bitstream or from a separate bitstream, one or more tone mapping operators and an indication of at least one tone mapping operator to be applied; decoding, either from the video bitstream or from the separate bitstream, enhancement data relating to said LDR video representation; modifying the LDR video representation into a first high dynamic range (HDR) video representation using said at least one tone mapping operator determined by said indication; and combining the first HDR video representation and the enhancement data relating to said LDR video representation to provide a second HDR video representation.

2 . The method according to claim 1 , further comprising
decoding said enhancement data from one or more enhancement layers of the video bitstream comprising said LDR video representation; applying at least one post-processing operation on said first high dynamic range (HDR) video representation; and combining the one or more enhancement layers with the post-processed first HDR video representation to provide the second HDR video representation.

3 . The method according to claim 2 , further comprising
decoding a segmentation mask from the video bitstream; determining an inverse tone mapping operation to be applied to each subsection of said LDR video representation based at least in part upon said segmentation mask; and applying said inverse tone mapping operations to each subsection of said LDR video representation to provide the first high dynamic range (HDR) video representation.

4 . The method according to claim 2 , further comprising
decoding a segmentation mask from the bitstream; and applying post-processing operations to said LDR video representation according to at least one value in the segmentation mask.

5 . The method according to claim 2 , further comprising
decoding a multiplicative bi-prediction mask picture from the bitstream; and multiplying the multiplicative bi-prediction mask picture sample-wise with the LDR video representation to provide the first HDR video representation.

6 . The method according to claim 2 , wherein the enhancement data is decoded from the bitstream using a variable-length code (VLC) or arithmetic decoder where the variable length code or arithmetic coding context is based, in whole or in part, on a decoded value of the LDR video representation and/or an inverse tone mapping operator.

7 . The method according to claim 6 , wherein multiple inverse tone mapping operators are used, and the context is based, in whole or in part, on the tone mapping operator used for a given pixel.

8 . An apparatus comprising
at least one processor and at least one memory, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least obtaining a video bitstream comprising a low dynamic range (LDR) video representation; obtaining, either from the video bitstream or from a separate bitstream, one or more tone mapping operators and an indication of at least one tone mapping operator to be applied; decoding, either from the video bitstream or from the separate bitstream, enhancement data relating to said LDR video representation; modifying the LDR video representation into a first high dynamic range (HDR) video representation using said at least one tone mapping operator determined by said indication; and combining the first HDR video representation and the enhancement data relating to said LDR video representation to provide a second HDR video representation.

9 . The apparatus according to claim 8 , further comprising code causing the apparatus to perform at least:
decoding said enhancement data from one or more enhancement layers of the video bitstream comprising said LDR video representation; applying at least one post-processing operation on said first high dynamic range (HDR) video representation; and combining the one or more enhancement layers with the post-processed first HDR video representation to provide the second HDR video representation.

10 . The apparatus according to claim 9 , further comprising code causing the apparatus to perform at least:
decoding a segmentation mask from the video bitstream; determining an inverse tone mapping operation to be applied to each subsection of said LDR video representation based at least in part upon said segmentation mask; and applying said inverse tone mapping operations to each subsection of said LDR video representation to provide the first high dynamic range (HDR) video representation.

11 . The apparatus according to claim 9 , further comprising code causing the apparatus to perform at least:
decoding a segmentation mask from the bitstream; and applying post-processing operations, such as shifts or offsets, to said LDR video representation according to at least one value in the segmentation mask.

12 . The apparatus according to claim 9 , further comprising code causing the apparatus to perform at least:
decoding a multiplicative bi-prediction picture from the bitstream; and multiplying the multiplicative bi-prediction picture piecewise with the LDR video representation to provide the first HDR video representation.

13 . A computer readable storage medium stored with code thereon for use by an apparatus, which when executed by a processor, causes the apparatus to perform:
obtaining a video bitstream comprising a low dynamic range (LDR) video representation; obtaining, either from the video bitstream or from a separate bitstream, one or more tone mapping operators and an indication of at least one tone mapping operator to be applied; decoding, either from the video bitstream or from the separate bitstream, enhancement data relating to said LDR video representation; modifying the LDR video representation into a first high dynamic range (HDR) video representation using said at least one tone mapping operator determined by said indication; and combining the first HDR video representation and the enhancement data relating to said LDR video representation to provide a second HDR video representation.

14 . A method comprising:
providing a low dynamic range (LDR) video representation or information relating to the LDR video representation; providing a bitstream comprising one or more tone mapping operators and an indication of at least one tone mapping operator to be applied to said LDR video representation; and providing a bitstream comprising enhancement data to be applied to the LDR video representation after applying said at least one tone mapping operator.

15 . The method according to claim 14 , wherein the enhancement data is provided in the same bitstream that contains a coded LDR video representation, or the enhancement data is provided in a separate bitstream.

16 . The method according to claim 14 , wherein said enhancement data is carried as one or more scalable quality enhancement layers, such as SHVC enhancement layers.

17 . The method according to claim 14 , wherein said enhancement data is carried as an auxiliary picture in a base LDR bitstream.

18 . The method according to claim 14 , further comprising
providing, in the bitstream comprising the enhancement data, a segmentation mask for defining post-processing operations to be applied on the enhancement data.

19 . An apparatus comprising
at least one processor and at least one memory, said at least one

Assignees

• Nokia Technologies Oy

Inventors

• Ridge Justin
• Hannuksela Miska Matias

Classifications

• H04N19/34 Primary

  Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS] · CPC title

• H04N19/50

  using predictive coding (H04N19/61 takes precedence) · CPC title

• H04N19/30 Primary

  using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) · CPC title

• H04N19/46

  Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) · CPC title