Hue-based video enhancement and rendering

Patent metadata

Field	Value
Publication number	US-11544827-B2
Application number	US-202117245840-A
Country	US
Kind code	B2
Filing date	Apr 30, 2021
Priority date	Apr 30, 2021
Publication date	Jan 3, 2023
Grant date	Jan 3, 2023

Abstract

Embodiments are directed towards hue-based video enhancement. An example method includes processing low dynamic range (LDR) video content to generate an inverse tone map (ITM) for transforming the LDR video content to high dynamic range (HDR) video content, converting the LDR video content into Hue, Saturation and Lightness (HSY) color space to produce H-channel data, S-channel data, and Y-channel data, de-noising the H-channel data, remapping the de-noised H-channel data, the S-channel data, and the Y-channel data based on the ITM; and rendering the HDR video content based thereon.

First claim

The invention claimed is:

1. A computing device, comprising:
memory that stores computer instructions; and
at least one processor that executes the computer instructions to perform actions, the actions comprising:
processing target low dynamic range (LDR) video content to generate an inverse tone map (ITM) for transforming the target LDR video content to high dynamic range (HDR) video content;
converting the target LDR video content into Hue, Saturation and Lightness (HSY) color space to produce H-channel data, S-channel data, and Y-channel data of the target LDR video content;
de-noising the H-channel data of the target LDR video content to at least remedy chroma error;
remapping the de-noised H-channel data, the S-channel data, and the Y-channel data based, at least in part, on the ITM; and
rendering the HDR video content based, at least in part, on the remapped de-noised H-channel data, the remapped S-channel data, and the remapped Y-channel data.

2. The computing device of claim 1 , wherein the HDR video content is superior to the target LDR video content in at least one of resolution, frame rate, or color dynamic range.

3. The computing device of claim 1 , wherein the remapping of the de-noised H-channel data is further based on chromatic discrimination associated with human eyes.

4. The computing device of claim 1 , wherein the actions further comprise identifying one or more objects in the target LDR video content.

5. The computing device of claim 4 , wherein the remapping of the de-noised H-channel data is further based on the identified one or more objects.

6. The computing device of claim 1 , wherein rendering the HDR video content comprises converting the remapped de-noised H-channel data, the remapped S-channel data, and the remapped Y-channel data into another color space.

7. The computing device of claim 1 , wherein the actions further comprise generating video enhancement instructions based, at least in part, on the de-noising and the remapping.

8. The computing device of claim 7 , wherein the actions further comprise sharing the generated video enhancement instructions with one or more other computing devices.

9. A method, comprising:
processing target video content to generate an inverse tone map (ITM) for enhancing the target video content;
converting the target video content into Hue, Saturation and Lightness (HSY) color space to produce H-channel data, S-channel data, and Y-channel data of the target video content;
de-noising the H-channel data of the target video content to at least remedy chroma error;
remapping the de-noised H-channel data, the S-channel data, and the Y-channel data based, at least in part, on the ITM; and
rendering enhanced video content based, at least in part, on the remapped de-noised H-channel data, the remapped S-channel data, and the remapped Y-channel data.

10. The method of claim 9 , wherein the remapping of the de-noised H-channel data is further based on chromatic discrimination associated with human eyes.

11. The method of claim 9 , further comprising identifying one or more objects in the target video content.

12. The method of claim 11 , wherein the remapping of the de-noised H-channel data is further based on the identified one or more objects.

13. The method of claim 9 , wherein rendering the enhanced video content comprises converting the remapped de-noised H-channel data, the remapped S-channel data, and the remapped Y-channel data into another color space.

14. The method of claim 9 , further comprising generating video enhancement instructions based, at least in part, on the de-noising and the remapping.

15. The method of claim 14 , further comprising transmitting metadata including the generated video enhancement instructions to one or more computing devices.

16. A non-transitory computer-readable storage medium storing contents that, when executed by one or more processors, cause the one or more processors to:
process target video content to generate an inverse tone map (ITM) for enhancing the target video content;
convert the target video content into Hue, Saturation and Lightness (HSY) color space to produce H-channel data, S-channel data, and Y-channel data of the target video content;
de-noise the H-channel data of the target video content to at least remedy chroma error;
remap the de-noised H-channel data, the S-channel data, and the Y-channel data based, at least in part, on the ITM; and
render enhanced video content based, at least in part, on the remapped de-noised H-channel data, the remapped S-channel data, and the remapped Y-channel data.

17. The computer-readable storage medium of claim 16 , wherein the remapping of the de-noised H-channel data is further based on chromatic discrimination associated with human eyes.

18. The computer-readable storage medium of claim 16 , wherein the contents further cause the one or more processors to identify one or more objects in the target video content.

19. The computer-readable storage medium of claim 18 , wherein the remapping of the de-noised H-channel data is further based on the identified one or more objects.

20. The computer-readable storage medium of claim 16 , wherein the contents further cause the one or more processors to generate video enhancement instructions based, at least in part, on the de-noising and the remapping.

Assignees

• Realnetworks Inc

Inventors

• Rassool Reza

Classifications

• H04N9/646

  for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters · CPC title

• G06T2207/20208

  High dynamic range [HDR] image processing · CPC title

• H04N9/643

  Hue control means, e.g. flesh tone control · CPC title

• G06T5/40

  using histogram techniques · CPC title

• G06T2207/10024

  Color image · CPC title