Methods and apparatuses for encoding an HDR images, and methods and apparatuses for use of such encoded images

Patent metadata

Field	Value
Publication number	US-10075738-B2
Application number	US-201515306873-A
Country	US
Kind code	B2
Filing date	Mar 19, 2015
Priority date	May 28, 2014
Publication date	Sep 11, 2018
Grant date	Sep 11, 2018

Abstract

Encoding a high dynamic range image (M_HDR), comprising: 1. converting the high dynamic range image to an image of lower luminance dynamic range (LDR_o) by applying the acts of: a) scaling the high dynamic range image to a predetermined scale of the luma axis such as [0,1], b) a sensitivity tone mapping which changes the brightnesses of pixel colors falling within at least a subrange comprising the darker colors in the high dynamic range image, c) a gamma function, and d) applying an arbitrary monotonically increasing function mapping the lumas resulting from performing the acts b and c to output lumas of the lower dynamic range image (LDR_o); and 2. outputting in an image signal (S_im) a codification of the pixel colors of the lower luminance dynamic range image (LDR_o), and 3. outputting in the image signal (S_im) values encoding the functional behavior of the above color conversions as metadata, or values for the inverse functions, which metadata allows to reconstruct a high dynamic range image (Rec_HDR) from the lower luminance dynamic range image (LDR_o).

First claim

The invention claimed is:

1. A method of encoding a high dynamic range image (M_HDR), comprising the steps of:
converting the high dynamic range image to an image of lower luminance dynamic range (LDR_o) by applying:
a) normalization of the high dynamic range image to a scale of the luma axis being [0,1] yielding a normalized high dynamic range image with normalized colors having normalized luminances (Yn_HDR),
b) calculating a gamma function on the normalized luminances yielding gamma-converted luminances (xg),
c) applying a first tone mapping yielding lumas (v) which is defined as v=log(1+(RHO−1)*xg)/log(RHO), with RHO having a predetermined value, and
d) applying an arbitrary monotonically increasing tone mapping function mapping the lumas to output lumas (Yn_LDR) of the lower dynamic range image (LDR_o); and

outputting in an image signal (S_im) a codification of the pixel colors of the lower luminance dynamic range image (LDR_o), and
outputting in the image signal (S_im) values encoding the function shapes of the above color conversions b to d as metadata, or values for their inverse functions, which metadata allows a receiver to reconstruct a reconstructed high dynamic range image (Rec_HDR) from the lower luminance dynamic range image (LDR_o), wherein RHO or a value being a function of RHO is outputted in the metadata.

2. A method of encoding a high dynamic range image (M_HDR) as claimed in claim 1 in which the gamma function calculation uses a gamma value equal to 1/(2.4).

3. A method of encoding a high dynamic range image (M_HDR) as claimed in claim 1 comprising determining a gain value (gai) for mapping the maximum luma of the lower dynamic range image (LDR_o) to a specific value of the possible values in the reconstructed high dynamic range image (Rec_HDR), and encoding that gain value in the image signal (S_im).

4. A method of encoding a high dynamic range image (M_HDR) as claimed in claim 3 , in which the identification of the first geometrical region is performed by a human grader via a user interface unit, and the amount of banding of the first geometrical region in the reconstructed high dynamic range image (Rec_HDR), and the visual quality of reconstruction of the second geometrical region in the reconstructed high dynamic range image (Rec_HDR) are judged by the human grader as acceptable or unacceptable, wherein in case of the acceptable judgement the values encoding the function shape of the redistribution mapping function or its inverse are encoded in the image signal, or in case of the inacceptable judgement the steps are done again with different parameters to come to an alternative redistribution mapping function.

5. An image decoder as claimed in claim 4 comprising a tone remapping unit arranged to apply a further tone mapping (Ff1, Ff2, . . . ) received in the image signal (S_im) to the lower dynamic range image (LDR_t) to obtain a second lower dynamic range image (LDR_ul) which reverses a code redistribution action previously applied by the encoder of the lower dynamic range image for obtaining a reduced banding in at least a region of the reconstructed high dynamic range image (Rec_HDR).

6. The method of encoding a high dynamic range image (M_HDR) of claim 1 comprising: after applying any of the above color mappings to determine the lower dynamic range image (LDR_o), applying a further technical tone mapping ( 301 ) to determine a second lower dynamic range image (LDR_i) which can be used to drive LDR displays as an alternative driving image alternative to the lower luminance dynamic range image (LDR_o), which technical tone mapping is determined by:
a) determining a first geometrical region of the lower luminance dynamic range image (LDR_o) for which the visibility of banding in the corresponding reconstructed high dynamic range image (Rec_HDR) is above an acceptable level,
b) determine a range of lumas (L_u) for that region,
c) determine a second range of pixel lumas (L_uu) adjacent on the luma axis to the range of lumas (L_u), wherein the second range is identified to fulfill the conditions that it has a number of lumas above a minimum number (MIN), and corresponds to a second geometrical image region which contains a texture which can be represented using less than the minimum number of codes in an LDR image (LDR_i) upon which to apply the functions yielding a reconstructed high dynamic range image (Rec_HDR) of sufficient visual quality for that second region, and
d) determining a redistribution mapping function which redistributes the lumas of the first and second range of lumas, so that additional codes are available for the first range, and outputting in the image signal (S_im) values encoding the function shape of the redistribution mapping function or preferably its inverse.

7. An image encoder arranged to encode a high dynamic range image (M_HDR), comprising:
a dynamic range conversion unit arranged to convert the high dynamic range image to an image of lower luminance dynamic range (LDR_o), the dynamic range conversion unit comprising:
a) a normalizer arranged to normalize the high dynamic range image to a luma axis ranging over [0,1] and to output normalized luminances (Yn_HDR),
b) a gamma conversion unit arranged to apply a gamma function to the normalized luminances and to output gamma-converted luminances (xg),
c) a first tone mapping unit arranged to apply a first tone mapping which yields lumas (v) which is defined as v=log(1+(RHO−1)*xg)/log(RHO), with RHO having a predetermined value,
d) an arbitrary tone mapping unit arranged to apply an arbitrary monotonically increasing function which maps the lumas (v) to output lumas (Yn_LDR) of the lower dynamic range image (LDR_o); and the image encoder further comprising:

an image compressor arranged to apply a data reduction transformation to the colors of the lower dynamic range image (LDR_o) which colors are organized in component images, and which reduction transformation involves at least applying a DCT transform to blocks of adjacent color component values, yielding a compressed codification (LDR 13 c) of the pixel colors of the lower luminance dynamic range mage; and
a formatter arranged to output in an image signal (S_im) the compressed codification (LDR_c), and arranged to in addition output in the image signal (S_im) values encoding the function shape of the color conversions as metadata, or values for their inverse functions, which metadata allows a receiver to reconstruct a high dynamic range image (Rec_HDR) based upon the lower luminance dynamic range image (LDR_o), the values comprising RHO or a value being a function of RHO.

8. An image decoder arranged to receive a high dynamic range image signal (S_im) and comprising:
a deformatter arranged to obtain a compressed pixellized lower dynamic range image (LDR_c) and parameter data (P) out of the image signal (S_im); and
a decompressor arranged to apply at least an inverse DCT transform to the compressed pixellized lower dynamic range image (LDR_c) to obtain a pixellized lower dynamic range image (LDR_t); and a dynamic range conversion unit ( 153 ) arranged to transform the lower dynamic range image (LDR_t) into a reconstructed high dynamic range image (Rec_HDR), wherein the dynamic range conversion unit comprises: a) an arbitrary tone mapping unit arranged to apply an arbitrary monotonically increasing tone mapping, the parameters which define it (P_CC) being received in the parameter data (P), b) a first tone mapping unit arranged to apply a mapping as defined by a function of the form:

xg
=

(

Assignees

• Koninklijke Philips Nv

Inventors

• Van Der Vleuten Renatus Josephus
• Mertens Mark Jozef Willem

Classifications

• G09G2320/0673

  for control of gamma adjustment, e.g. selecting another gamma curve · CPC title

• G09G2340/02

  Handling of images in compressed format, e.g. JPEG, MPEG · CPC title

• G09G2340/06

  Colour space transformation · CPC title

• H04N5/20

  Circuitry for controlling amplitude response · CPC title

• G09G2320/0271

  Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping · CPC title