Hue preservation post processing for highlight recovery

Patent metadata

Field	Value
Publication number	US-11100620-B2
Application number	US-201816121389-A
Country	US
Kind code	B2
Filing date	Sep 4, 2018
Priority date	Sep 4, 2018
Publication date	Aug 24, 2021
Grant date	Aug 24, 2021

Abstract

Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.

First claim

What is claimed is:

1. An apparatus for processing image signal data, comprising:
a hue target circuit configured to generate a plurality of target hues for a plurality of color channels of each pixel in an image based on a plurality of candidate hue maps;
an intensity value calculator circuit configured to determine a plurality of intensity values for the plurality of color channels of a pixel in the image, the pixel having at least one of the intensity values above a predetermined threshold, using corresponding ratios of the target hues for the plurality of color channels of the pixel;
a hue preserved value calculator circuit configured to determine a hue preserved value for a color channel of the plurality of color channels of the pixel, using the intensity values and the target hues; and
a hue preservation processor configured to generate a recovered version of the image by adjusting hue information of the pixel, using the hue preserved value for the color channel of the pixel.

2. The apparatus of claim 1 , further comprising:
a first non-linear power corrector circuit configured to perform a non-linear power transformation of the intensity values to generate a plurality of tra 3 nsformed intensity values for the plurality of color channels of the pixel; and
a second non-linear power corrector circuit configured to perform the non-linear power transformation of the target hues to generate a plurality of transformed target hues for the plurality of color channels of the pixel,
wherein the hue preserved value calculator circuit is further configured to determine the hue preserved value using the transformed intensity values and a corresponding transformed target hue of the plurality of transformed target hues for the color channel of the pixel.

3. The apparatus of claim 2 , wherein the hue preserved value calculator circuit is further configured to:
determine a first luminance value for the pixel as a minimum of the transformed intensity values,
determine a second luminance value for the pixel as a minimum of the transformed target hues,
determine a first difference value for the pixel as a difference between a maximum of the transformed intensity values and the first luminance value,
determine a second difference value for the pixel as a difference between a maximum of the transformed target hues and the second luminance value,
determine a color cross ratio for the pixel as a ratio between the first difference value and the second difference value, and
determine the hue preserved value for the color channel of the pixel, using the first luminance value, the second luminance value, the color cross ratio and the corresponding transformed target hue for the color channel.

4. The apparatus of claim 2 , further comprising:
a blending circuit configured to blend, based on the target hues, the hue preserved value and a corresponding transformed intensity value of the plurality of transformed intensity values for the color channel of the pixel to generate a hue preserved output value for the color channel of the pixel.

5. The apparatus of claim 2 , further comprising a blending circuit configured to:
determine a first chromaticity value for the pixel as a ratio between a target hue of the plurality of target hues and a sum of the target hues,
determine a second chromaticity value for the pixel as a ratio between another target hue of the plurality of target hues and the sum,
determine a hue preservation weight as a function of the first chromaticity value and the second chromaticity value, and
blend, based on the hue preservation weight, the hue preserved value and a corresponding transformed intensity value of the plurality of transformed intensity values for the color channel of the pixel to generate a hue preserved output value for the color channel of the pixel.

6. The apparatus of claim 5 , further comprising an inverse non-linear power corrector circuit configured to:
perform an inverse of the non-linear power transformation of the hue preserved output value for the color channel of the pixel to generate a hue preserved post processed (HPPP) value for the color channel of the pixel.

7. The apparatus of claim 6 , wherein the hue preservation processor is further configured to:
generate the recovered version of the image by adjusting the hue information of the pixel using the HPPP value for the color channel of the pixel.

8. The apparatus of claim 1 , further comprising a hue processor configured to:
compare, for each color channel, the target hues for the plurality of color channels of the pixel, and
select a corresponding intensity value of the plurality of intensity values for that color channel of the pixel as the hue preserved value for that color channel, when a target hue of the plurality of target hues for that color channel is the largest among the plurality of target hues.

9. The apparatus of claim 1 , wherein the intensity value calculator circuit is configured to:
determine a first ratio between a first of the target hues for a first of the color channels and a second of the target hues for a second of the color channels,
determine a second ratio between the first target hue for the first color channel and a third of the target hues for a third of the color channels, and
determine one of the intensity values for the first color channel of the pixel using the first ratio and the second ratio.

10. A method, comprising:
generating a plurality of target hues for a plurality of color channels of each pixel in an image based on a plurality of candidate hue maps;
determining a plurality of intensity values for the plurality of color channels of a pixel in the image, the pixel having at least one of the intensity values above a predetermined threshold, using corresponding ratios of the target hues for the plurality of color channels of the pixel;
determining a hue preserved value for a color channel of the plurality of color channels of the pixel, using the intensity values and the target hues; and
generating a recovered version of the image by adjusting hue information of the pixel, using the hue preserved value for the color channel of the pixel.

11. The method of claim 10 , further comprising:
performing a non-linear power transformation of the intensity values to generate a plurality of transformed intensity values for the plurality of color channels of the pixel;
performing the non-linear power transformation of the target hues to generate a plurality of transformed target hues for the plurality of color channels of the pixel; and
determining the hue preserved value using the transformed intensity values and a corresponding transformed target hue of the plurality of transformed target hues for the color channel of the pixel.

12. The method of claim 11 , further comprising:
determining a first luminance value for the pixel as a minimum of the transformed intensity values;
determining a second luminance value for the pixel as a minimum of the transformed target hues;
determining a first difference value for the pixel as a difference between a maximum of the transformed intensity values and the first luminance value;
determining a second difference value for the pixel as a difference between a maximum of the transformed target hues and the second luminance value;
determining a color cross ratio for the pixel as a ratio between the first difference value and the second difference value; and
determining the hue preserved value for the color channel of the pixel, using the first luminance value, the second luminance value, the color cross ratio and the corresponding transformed target hue for the color channel.

Assignees

• Apple Inc

Inventors

• Tajbakhsh Touraj
• Wu Chihsin
• Cao Frederic

Classifications

• G06T2207/20208

  High dynamic range [HDR] image processing · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T7/90

  Determination of colour characteristics · CPC title

• H04N9/643 Primary

  Hue control means, e.g. flesh tone control · CPC title

• G06T5/009 Primary

  Physics · mapped topic