Image adjustment based on local contrast

Patent metadata

Field	Value
Publication number	US-12014478-B2
Application number	US-202117155653-A
Country	US
Kind code	B2
Filing date	Jan 22, 2021
Priority date	Jan 22, 2021
Publication date	Jun 18, 2024
Grant date	Jun 18, 2024

Abstract

A method, processor, and computer readable medium for generating blended intensity data for processing by a further processor, the method comprising the steps of generating a local contrast map based on image data, the local contrast map comprising a plurality of contrast values. An alpha mask is generated by associating an alpha mask value to each contrast value. First intensity data based on the image data using a first intensity calculation method and second intensity data based on the image data using a second intensity calculation method are also generated. The blended intensity data is generated by blending from at least one of the first intensity data and the second intensity data based on the alpha mask values; and outputted to the further processor.

First claim

What is claimed is:

1. A method for generating blended intensity data for processing by a processor, the method comprising the steps of:
generating a local contrast map based on image data, the local contrast map comprising a plurality of contrast values;
generating an alpha mask by associating an alpha mask value to each of said contrast values, wherein generating the alpha mask comprises:
associating a first alpha mask value for a given contrast value if the given contrast value does not exceed a first threshold;
associating a second alpha mask value for the given contrast value if the given contrast value exceeds a second threshold; and
associating a third alpha mask value, the third alpha mask value being between the first alpha mask value and the second alpha mask value, when the given contrast value exceeds the first threshold and does not exceed the second threshold;

generating first intensity data using a first intensity calculation method and second intensity data using a second intensity calculation method, where the first intensity calculation method and the second intensity calculation method are different;
generating the blended intensity data by blending values from at least one of the first intensity data and the second intensity data based on the alpha mask values; and
outputting the blended intensity data to the processor.

2. The method for generating blended intensity data according to claim 1 , wherein the plurality of contrast values represent a difference between a maximum and minimum of a given group of pixels of the image data.

3. The method for generating blended intensity data according to claim 1 , wherein the third alpha mask value is determined based on at least one of:
a tuneable linear equation;
a look-up table; or
a power curve.

4. The method for generating blended intensity data according to claim 1 , further comprising creating combined intensity data based on a weighting of the first intensity data and the second intensity data associated with the third alpha mask value.

5. The method for generating blended intensity data according to claim 4 , wherein generating the blended intensity data comprises, for each contrast value of the contrast image:
blending from the first intensity data, if contrast value is associated with the first alpha mask value;
blending from the second intensity data if the contrast value is associated with the second alpha mask value; and
blending from the combined intensity data if the contrast value is associated with the third alpha mask value.

6. The method for generating blended intensity data according to claim 1 , wherein at least one of the first intensity calculation method or second intensity calculation method is a Luma intensity calculation method.

7. The method for generating blended intensity data according to claim 1 , wherein at least one of the first intensity calculation method or second intensity calculation method is a MaxRGB intensity calculation method.

8. The method for generating blended intensity data according to claim 1 , wherein the image data uses an RGB color model, and wherein the plurality of contrast values are based on a comparison between individual colour channels of the image data.

9. The method for generating blended intensity data according to claim 1 , wherein the image data uses a RAW or YUV color model.

10. A processor for generating blended intensity data for processing by a further processor, the processor comprising;
an input module for obtaining image data;
a contrast image generation module for generating a local contrast map based on image data, the local contrast map comprising a plurality of contrast values;
an alpha mask generation module for generating an alpha mask by associating an alpha mask value to each of said contrast values, wherein the alpha mask generation module:
associates a first alpha mask value for a given contrast value if the given contrast value does not exceed a first threshold;
associates a second alpha mask value for the given contrast value if the given contrast value exceeds a second threshold; and
associates a third alpha mask value, the third alpha mask value being between the first alpha mask value and the second alpha mask value, when the given contrast value exceeds the first threshold and does not exceed the second threshold;

an intensity data generation module for generating first intensity data using a first intensity calculation method and second intensity data using a second intensity calculation method, where the first intensity calculation method and the second intensity calculation method are different;
a blended intensity data calculation module for generating the blended intensity data by blending from at least one of the first intensity data and the second intensity data based on the alpha mask values; and
an output module for outputting the blended intensity data to the further processor.

11. The processor for generating blended intensity data according to claim 10 , wherein the contrast image generation module is arranged to generate the plurality of contrast values by determining a difference between a maximum and minimum of a given group of pixels of the image data.

12. The processor for generating blended intensity data according to claim 10 , wherein the third alpha mask value is determined based on at least one of:
a tuneable linear equation;
a look-up table; or
a power curve.

13. The processor for generating blended intensity data according to claim 10 , wherein the blended intensity data calculation module creates a combined intensity data based on a weighting of the first intensity data and the second intensity data associated with the third alpha mask value.

14. The processor for generating blended intensity data according to claim 13 , wherein the blended intensity data calculation module for each contrast value of the contrast image:
selects from the first intensity data, if contrast value is associated with the first alpha mask value;
selects from the second intensity data if the contrast value is associated with the second alpha mask value; and
selects from the combined intensity data if the contrast value is associated with the third alpha mask value.

15. The processor for generating blended intensity data according to claim 10 , wherein the intensity data generation module comprises at least a Luma intensity calculation unit for generating at least one of the first intensity data or the second intensity data.

16. The processor for generating blended intensity data according to claim 10 , wherein the intensity data generation module comprises at least a MaxRGB calculation unit for generating at least one of the first intensity data or the second intensity data.

17. The processor for generating blended intensity data according to claim 10 , wherein outputting the blended intensity data to the further processor comprises outputting the blended intensity data to at least one of:
a display processor;
an image signal processor;
a central processing unit;
a graphics processing unit;
a neural processing unit; or
a digital signal processor.

18. A non-transitory computer-readable storage medium comprising a set of computer-readable instructions stored thereon which, when executed by at least one processor, cause the at least one processor to generate blended intensity data for processing by a further processor, the instructions comprising:
generating a local contrast map based on image data, the local contrast map comprising a plurality of contrast values;

Assignees

• Apical Ltd
• Advanced Risc Mach Ltd

Inventors

• O'Neil Liam James
• Wang Yanxiang
• Kayim Güney
• Gomez Alexis Leonardo Lluis

Classifications

• G06T1/20

  Processor architectures; Processor configuration, e.g. pipelining · CPC title

• G06N3/04

  Architecture, e.g. interconnection topology · CPC title

• G06T5/20

  using local operators · CPC title

• G06T2207/20208

  High dynamic range [HDR] image processing · CPC title

• G06T7/90

  Determination of colour characteristics · CPC title