Hue preservation post processing with early exit for highlight recovery

Patent metadata

Field	Value
Publication number	US-11620738-B2
Application number	US-202117373362-A
Country	US
Kind code	B2
Filing date	Jul 12, 2021
Priority date	Sep 4, 2018
Publication date	Apr 4, 2023
Grant date	Apr 4, 2023

Abstract

Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.

First claim

What is claimed is:

1. An apparatus for processing image signal data, comprising:
a hue target circuit configured to generate a plurality of target hues for a plurality of color channels of a pixel in an image using candidate hue values for the plurality of color channels of the pixel;
an intensity value calculator circuit coupled to the hue target circuit, the intensity value calculator circuit configured to determine an intensity value for a color channel of the plurality of color channels of the pixel, using corresponding ratios of the plurality of target hues for the plurality of color channels of the pixel; and
a hue processor coupled to the hue target circuit and the intensity value calculator circuit, the hue processor configured to select the intensity value as a recovered hue value for the color channel of the pixel, when a target hue of the plurality of target hues for the color channel is the largest among the plurality of target hues.

2. The apparatus of claim 1 , further comprising a hue preservation post processing circuit coupled to the hue processor and the intensity value calculator circuit, the hue preservation post processing circuit being disabled for performing a hue preservation post processing for the color channel of the pixel upon selecting the intensity value as the recovered hue value.

3. The apparatus of claim 1 , wherein the hue processor is further configured to:
compare, for each color channel of the plurality of color channels, the plurality of target hues for the plurality of color channels of the pixel to select the intensity value as the recovered hue value.

4. The apparatus of claim 1 , wherein the hue processor is further configured to:
determine values of the plurality of target hues for the plurality of color channels of the pixel,
generate a signal for the color channel, in response to determining that the target hue for the color channel is the largest among the plurality of target hues, and
configure a demultiplexer circuit coupled to the hue processor using the signal as a select signal of the demultiplexer circuit to output the intensity value for the color channel of the pixel as the recovered hue value for the color channel of the pixel, the demultiplexer circuit coupled to the hue processor and the intensity value calculator circuit.

5. The apparatus of claim 1 , wherein the hue processor is further configured to:
generate a signal for another color channel of the plurality of color channels of the pixel, in response to determining that the target hue for the color channel is the largest among the plurality of target hues, and
configure a demultiplexer circuit coupled to the hue processor using the signal as a select signal of the demultiplexer circuit to pass another intensity value for the other color channel of the pixel from the intensity value calculator circuit to a hue preservation post processing circuit coupled to the intensity value calculator circuit for computing another recovered hue value for the other color channel of the pixel.

6. The apparatus of claim 1 , wherein the intensity value calculator circuit is further configured to:
determine a first ratio between a first of the plurality of target hues for the color channel and a second of the plurality of target hues for another color channel of the plurality of color channels,
determine a second ratio between the first target hue for the color channel and a third of the plurality of target hues for a remaining color channel of the plurality of color channels, and
determine the intensity value for the color channel of the pixel using the first ratio and the second ratio.

7. The apparatus of claim 1 , wherein the intensity value calculator circuit is further configured to:
determine the intensity value for the color channel of the pixel by applying a clipping to a processed version of a pixel value for the color channel of the pixel.

8. The apparatus of claim 7 , wherein the intensity value calculator circuit is further configured to:
limit the processed version of the pixel value to be within a defined maximum hue level of the color channel when applying the clipping.

9. The apparatus of claim 7 , wherein the intensity value calculator circuit is further configured to:
apply a piecewise linear curve to the processed version of the pixel value when applying the clipping, the piecewise linear curve represented as values in a look-up table stored at a computer readable storage medium coupled to the intensity value calculator circuit.

10. A method, comprising:
generating, by a hue target circuit of an image signal processor, a plurality of target hues for a plurality of color channels of a pixel in an image using candidate hue values for the plurality of color channels of the pixel;
determining, by an intensity value calculator circuit of the image signal processor coupled to the hue target circuit, an intensity value for a color channel of the plurality of color channels of the pixel, using corresponding ratios of the plurality of target hues for the plurality of color channels of the pixel; and
selecting, by the hue processor of the image signal processor coupled to the hue target circuit and the intensity value calculator circuit, the intensity value as a recovered hue value for the color channel of the pixel, when a target hue of the plurality of target hues for the color channel is the largest among the plurality of target hues.

11. The method of claim 10 , further comprising:
disabling, by the hue processor, a hue preservation post processing for the color channel of the pixel upon selecting the intensity value as the recovered hue value.

12. The method of claim 10 , further comprising:
comparing, by the hue processor for each color channel of the plurality of color channels, the plurality of target hues for the plurality of color channels of the pixel to select the intensity value as the recovered hue value.

13. The method of claim 10 , further comprising:
determining, by the hue processor, values of the plurality of target hues for the plurality of color channels of the pixel;
generating, by the hue processor, a signal for the color channel, in response to determining that the target hue for the color channel is the largest among the plurality of target hues; and
using, by a demultiplexer circuit of the image signal processor coupled to the hue processor, the signal to output the intensity value for the color channel of the pixel as the recovered hue value for the color channel of the pixel.

14. The method of claim 10 , further comprising:
generating, by the hue processor, a signal for another color channel of the plurality of color channels of the pixel, in response to determining that the target hue for the color channel is the largest among the plurality of target hues; and
using, by a demultiplexer circuit of the image signal processor coupled to the hue processor, the signal to pass another intensity value for the other color channel of the pixel for a hue preservation post processing to compute another recovered hue value for the other color channel of the pixel.

15. The method of claim 10 , further comprising:
determining, by the intensity value calculator circuit, a first ratio between a first of the plurality of target hues for the color channel and a second of the plurality of target hues for another color channel of the plurality of color channels;
determining, by the intensity value calculator circuit, a second ratio between the first target hue for the color channel and a third of the plurality of target hues for a remaining color channel of the plurality

Assignees

• Apple Inc

Inventors

• Tajbakhsh Touraj
• Wu Chihsin
• Cao Frederic

Classifications

• G06T2207/10024

  Color image · CPC title

• G06T7/90

  Determination of colour characteristics · CPC title

• G06T2207/20208

  High dynamic range [HDR] image processing · CPC title

• H04N9/643 Primary

  Hue control means, e.g. flesh tone control · CPC title

• G06T5/009 Primary

  Physics · mapped topic