Brightness region-based apparatuses and methods for HDR image encoding and decoding

Patent metadata

Field	Value
Publication number	US-9420288-B2
Application number	US-201314387575-A
Country	US
Kind code	B2
Filing date	Mar 25, 2013
Priority date	Mar 26, 2012
Publication date	Aug 16, 2016
Grant date	Aug 16, 2016

Abstract

The image encoder ( 549 ) for encoding an image of a high dynamic range scene, comprising: a pixel texture encoding unit ( 552 ), arranged to encode pixels colors of the image with an image representation (Im 1 ) comprising N-bit code words; an image analysis unit ( 550 ) arranged to determine and output a region differentiator grey value (gTS), which is a luma value demarcating below it lumas of all pixels of a first object in at least one block of the image, and above it lumas of all pixels of a second object in the at least one block of the image; and a formatter ( 554 ) arranged to co-encode in an output image signal (S(Im_ 1 , MET(gTS)) the image representation (Im 1 ) and the region differentiator grey value (gTS), makes highly versatile use of images encoding HDR scenes possible, in particular encoding them in image formats compatible with existing MPEG video coding standards.

First claim

The invention claimed is:

1. An image encoder for encoding an image of a high dynamic range scene, comprising:
a pixel texture encoding unit configured to encode pixels colors of the image with an image representation comprising N-bit code words;
an image analysis unit configured to determine and output a region differentiator grey value including a luma value demarcating below the luma value lumas of all pixels of a first object in at least one block of the image, and above the luma value lumas of all pixels of a second object in the at least one block of the image; and
a formatter arranged to co-encode in an output image signal the image representation and the region differentiator grey value.

2. The image encoder as claimed in claim 1 , comprising a luma mapping determination unit configured to determine a luma mapping for at least one of the first and the second object defining a mapping between the pixel lumas as encoded in the image representation and lumas of the pixels in a second image representation, and configured to supply the luma mapping to the formatter to co-encode into the output image signal.

3. The image encoder as claimed in claim 1 , wherein one of the first and second image representations is a high dynamic range representation encoded for a reference display with peak brightness above 750 nit.

4. The image encoder as claimed in claim 1 , configured to encode several region differentiator grey values in between spatial image sections comprising several of the N-bit code words encoding the pixel colors from the image representation.

5. The image encoder as claimed in claim 1 , wherein a region differentiator grey value is encoded before a run of a number of successive images, being a region differentiator grey value for all those successive images.

6. The image encoder as claimed in claim 1 , wherein at least one region differentiator grey value is encoded in a memory not physically adjacent to a memory storing the image representation, together with a geometric association code allowing association of each respective at least one region differentiator grey value with a geometrical region of the image representation to which it is applicable, the geometric association code comprising at least the coordinates of a block of the image representation.

7. The image encoder as claimed in claim 1 , wherein a first reserved value of a region differentiator grey value is encoded into the output image signal, indicating that, for at least one geometrical region of the image representation, lying according to a scan direction through the image beyond a location identifiable with the first reserved value, a transformation from the pixel values as encoded in the image representation to pixel values in a second image representation, is performed according to a predefined algorithm.

8. The image encoder as claimed in claim 1 , wherein a second reserved value of a region differentiator grey value is encoded into the output image signal, indicating that for at least one successive image, a display is rendered with a maximal output luminance below a predetermined value.

9. The image encoder as claimed in claim 2 , wherein the luma mapping determination unit is configured to determine several different luma mappings for at least one of the first and the second objects through transformation linking rules, or is configured to indicate with a processing indicator that several different luma mappings are used for transforming the pixel colors of at least one of the first and the second object to a new color representation of the second image representation.

10. An image decoder for decoding an encoded image representation of a high dynamic range scene, comprising:
a pixel texture decoding unit configured to obtain from the encoded image representation pixel colors of pixels of a decoded image;
a deformatter configured to extract from the encoded image representation a region differentiator grey value; and
an image segmentation unit configured to use the region differentiator grey value to obtain a segment of lower luma and a segment of higher luma in the decoded image.

11. The image decoder as claimed in claim 10 , comprising a pixel color transformation unit configured to apply a first color transform, transforming at least luma values of the pixel colors, to pixels in the segment of lower luma, and configured to apply a first color transform, transforming at least luma values of the pixel colors, to pixels in the segment of higher luma.

12. The image decoder as claimed in claim 10 , configured to apply a specific color transformation strategy to the pixel colors of at least one of the first and the second object if the deformatter extracts a region differentiator grey value of a reserved value.

13. The image decoder as claimed in claim 10 , comprising a transformation determination unit configured to select a pixel color transformation strategy from a memory source not associated with any of the data of the encoded image representation.

14. The image decoder as claimed in claim 13 , wherein the transformation determination unit is configured to determine the pixel color transformation strategy on the basis of at least one parameter of the rendering environment or a level of surround illumination.

15. The image decoder as claimed in claim 10 , wherein the image decoder is configured to obtain the encoded image representation and the region differentiator grey value from physically separate memories, and configured to associate the region differentiator grey value with a geometrical part of the encoded image representation.

16. A method for encoding an image of a high dynamic range scene, comprising:
encoding pixels colors of the image with an image representation comprising N-bit code words;
determining and outputting a region differentiator grey value including a luma value demarcating below the luma value lumas of all pixels of a first object in at least one block of the image, and above the luma value lumas of all pixels of a second object in the at least one block of the image; and
co-encoding in an output image signal the image representation and the region differentiator grey value.

17. A method for decoding an encoded image representation of a high dynamic range scene, comprising:
obtaining from the encoded image representation pixel colors of pixels of a decoded image;
extracting from the encoded image representation a region differentiator grey value; and
using the region differentiator grey value to obtain a segment of lower luma and a segment of higher luma in the decoded image.

18. A non-transitory computer readable medium comprising software code for encoding an image of a high dynamic range scene by encoding pixels colors of the image with an image representation comprising N-bit code words; determining and outputting a region differentiator grey value including a luma value demarcating below the luma value lumas of all pixels of a first object in at least one block of the image, and above the luma value lumas of all pixels of a second object in the at least one block of the image; and co-encoding in an output image signal the image representation and the region differentiator grey value.

Assignees

• Koninklijke Philips Nv

Inventors

• Mertens Mark Jozef Willem

Classifications

• H04N19/625 Primary

  using discrete cosine transform [DCT] · CPC title

• H04N19/14

  Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence) · CPC title

• H04N19/17

  the unit being an image region, e.g. an object · CPC title

• H04N19/102 Primary

  characterised by the element, parameter or selection affected or controlled by the adaptive coding · CPC title

• H04N19/186

  the unit being a colour or a chrominance component · CPC title