High dynamic range video coding architectures with multiple operating modes

Patent metadata

Field	Value
Publication number	US-10609395-B2
Application number	US-201615748095-A
Country	US
Kind code	B2
Filing date	Jul 28, 2016
Priority date	Jul 28, 2015
Publication date	Mar 31, 2020
Grant date	Mar 31, 2020

Abstract

A high dynamic range (HDR) signal processing device may receive a video signal and an operating mode indication. The operating mode indication may indicate a format of the video signal, for example, an HDR format or a non-DR format. Whether to perform adaptive reshaping on the video signal may be determined based on the operating mode indication. For example, it may be determined to perform the adaptive reshaping if the operating mode indicates that the video signal is in an HDR format. It may be determined to bypass the adaptive reshaping if the operating mode indicates that the video signal is in the non-HDR format. Multiple types of HDR reconstruction metadata may be received via a network abstraction layer (NAL) unit.

First claim

What is claimed is:

1. A high dynamic range (HDR) signal processing device comprising:
a processor configured to:
receive a video signal and an operating mode indication configured to indicate a format of the video signal;
determine whether to perform adaptive reshaping on the video signal based on the operating mode indication, wherein the processor is configured to determine to perform the adaptive reshaping on a condition that the operating mode indicates that the video signal is in an HDR format, and determine to bypass the adaptive reshaping on a condition that the operating mode indicates that the video signal is in a non-HDR format;
determine whether to perform color gamut mapping on the video signal based on the operating mode indication, wherein the processor is configured to determine to perform the color gamut mapping on a condition that the operating mode indicates that the video signal is in the non-HDR format, and determine to bypass the color gamut mapping on a condition that the operating mode indicates that the video signal is in the HDR format; and
process the video signal based on the determination of whether to perform adaptive reshaping and the determination of whether to perform color gamut mapping.

2. The signal processing device of claim 1 , wherein the processor is configured to:
receive a plurality of types of HDR reconstruction metadata via a network abstraction layer (NAL) unit, wherein the plurality of types of HDR reconstruction metadata comprises at least one of the operating mode indication, adaptive reshaping metadata, modulation factor metadata, color enhancement metadata, or color space metadata.

3. The signal processing device of claim 1 , wherein the processor is configured to:
based on the determination to perform the adaptive reshaping, identify adaptive reshaping HDR reconstruction metadata and perform the adaptive reshaping on the video signal using the adaptive reshaping metadata.

4. The signal processing device of claim 1 , wherein the processor is configured to receive a plurality of types of HDR reconstruction metadata via a high priority message, each type of the HDR reconstruction metadata being associated with a payload type.

5. The signal processing device of claim 1 , wherein the processor is further configured to:
perform a transfer function on the video signal based on the operating mode indication, wherein on the condition that the operating mode indicates that the video signal is in the HDR format, the processor is further configured to identify adaptive reshaping metadata associated with the video signal and perform the transfer function using the adaptive reshaping metadata.

6. The signal processing device of claim 1 , wherein the processor is further configured to:
perform chroma upsampling on the video signal, wherein the chroma upsampling is performed based on an output of the adaptive shaping on the condition that the operating mode indicates that the video signal is in the HDR format.

7. The signal processing device of claim 1 , wherein the processor is further configured to:
identify color enhancement metadata associated with the video signal; and
perform color enhancement on the video signal using the color enhancement metadata.

8. The signal processing device of claim 1 , wherein the processor is further configured to perform color enhancement on the video signal based on an output of chroma upsampling.

9. The signal processing device of claim 1 , wherein the processor is further configured to:
identify color space metadata associated with color space conversion; and
perform the color space conversion on the video signal using the color space metadata.

10. The signal processing device of claim 1 , wherein the processor is further configured to perform color space conversion on the video signal, wherein the color space conversion is performed based on an output of the color gamut mapping on the condition that the operating mode indicates that the video signal is in the non-HDR format.

11. A high dynamic range (HDR) signal processing device comprising: a processor configured to:
receive a video signal and an operating mode indication configured to indicate a format of the video signal;
determine whether to perform adaptive reshaping on the video signal based on the operating mode indication, wherein the processor is configured to determine to perform the adaptive reshaping on a condition that the operating mode indicates that the video signal is in an HDR format, and determine to bypass the adaptive reshaping on a condition that the operating mode indicates that the video signal is in a non-HDR format;
determine whether to perform scaling factor derivation on the video signal based on the operating mode indication, wherein the processor is configured to determine to perform the scaling factor derivation on a condition that the operating mode indicates that the video signal is in the non-HDR format, and determine to bypass the scaling factor derivation on a condition that the operating mode indicates that the video signal is in the HDR format; and
process the video signal based on the determination of whether to perform adaptive reshaping and the determination of whether to perform the scaling factor derivation.

12. The signal processing device of claim 11 , wherein the processor, based on the determination to perform the scaling factor derivation, is further configured to identify modulation factor metadata associated with the scaling factor derivation and perform the scaling factor derivation on the video signal using the modulation factor metadata.

13. A high dynamic range (HDR) signal processing device comprising: a processor configured to:
receive a video signal and an operating mode indication configured to indicate a format of the video signal;
determine whether to perform adaptive reshaping on the video signal based on the operating mode indication, wherein the processor is configured to determine to perform the adaptive reshaping on a condition that the operating mode indicates that the video signal is in an HDR format, and determine to bypass the adaptive reshaping on a condition that the operating mode indicates that the video signal is in a non-HDR format;
determine whether to perform dynamic range conversion on the video signal based on the operating mode indication, wherein the processor is configured to determine to perform the dynamic range conversion on a condition that the operating mode indicates that the video signal is in the non-HDR format, and determine to bypass the dynamic range conversion on a condition that the operating mode indicates that the video signal is in the HDR format; and
process the video signal based on the determination of whether to perform adaptive reshaping and the determination of whether to perform the dynamic range conversion.

14. A video signal processing method comprising:
receiving a video signal and an operating mode indication configured to indicate a format of the video signal;
determining whether to perform adaptive reshaping on the video signal based on the operating mode indication, wherein a determination to perform the adaptive reshaping is made on a condition that the operating mode indicates that the video signal is in a high dynamic range (HDR) format, and a determination to bypass the adaptive reshaping is made on a condition that the operating mode indicates that the video signal is in a non-HDR format;
determining whether to perform color gamut mapping on the video signal based on the operating mode indication, wherein the determination to perform the color gamut mapping is made on a conditio

Assignees

• Vid Scale Inc

Inventors

• Kerofsky Louis
• He Yuwen
• Ye Yan

Classifications

• H04N19/117

  Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635) · CPC title

• H04N19/157

  Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter · CPC title

• H04N19/186 Primary

  the unit being a colour or a chrominance component · CPC title

• H04N19/188

  the unit being a video data packet, e.g. a network abstraction layer [NAL] unit · CPC title

• H04N19/85

  using pre-processing or post-processing specially adapted for video compression · CPC title