High dynamic range image processing device and method

Patent metadata

Field	Value
Publication number	US-9635377-B2
Application number	US-201414291706-A
Country	US
Kind code	B2
Filing date	May 30, 2014
Priority date	Jun 28, 2013
Publication date	Apr 25, 2017
Grant date	Apr 25, 2017

Abstract

Disclosed are a display device for processing and displaying an image signal. The display device includes an image receiver configured to receive packetized image data of an encoded image signal or a bit stream of image data of the encoded image signal, a decoder configured to parse metadata from the packetized image data or bit stream and decode the image signal from the image data of the encoded image signal; and an HDR image processor configured to analyze HDR information in the metadata, and generate an HDR image of the image signal from the analyzed HDR information and the decoded image signal.

First claim

What is claimed is:

1. An image processing device for processing an image signal comprising:
a metadata generator configured to generate metadata comprising high dynamic range (HDR) information of an image signal;
an image encoder configured to encode the image signal as one of packetized image data of the encoded image signal and a bit stream of image data of the encoded image signal; and
an HDR message generator configured to generate an HDR message comprising the generated metadata in a reserved area of the one of the packetized image data and the bit stream, wherein the HDR information comprises at least one of:
minimum and maximum brightness value for each scene or frame;
backlight peaking information comprising backlight unit (BLU) brightness mapping parameter for each scene or frame;
color specification information comprising color gamut and color temperature of an image;
a transfer parameter comprising gamma adjust and contrast enhancement (CE) control parameter;
scene information comprising surrounding environment information of a scene or frame timeline;
histogram information showing lowest, highest and most frequent pixel value information;
sharpness information showing strength information of a boundary area of an image; and
correlation information of scenes or frames,
wherein the HDR information comprises a compulsory HDR information and an optional HDR information which assists with the compulsory HDR information,
wherein the compulsory HDR information is always included in the metadata when one of the packetized image data and the bit stream is to be transmitted,
wherein the optional HDR information is sometimes omitted from the metadata when one of the packetized image data and the bit stream is to be transmitted, and
wherein the HDR information is additional information which is produced at an initial phase of producing the image, and includes a dynamic range which is higher than a dynamic range of the image.

2. The image processing device of claim 1 ,
wherein the reserved area comprises at least one of a picture parameter set (PPS) extended data area and a supplemental enhancement information (SEI) data area of a network abstraction layer (NAL) unit.

3. The image processing device of claim 1 , wherein the metadata is included in an extended layer of the packetized image data or the bit stream.

4. The image processing device of claim 1 , wherein the metadata is included in a base layer of the packetized image data or the bit stream.

5. The image processing device of claim 1 , wherein the metadata is included in an extended layer and a base layer of the packetized image data or the bit stream.

6. The image processing device of claim 1 , wherein the metadata comprises first metadata of a first scene or frame, and wherein second metadata of a second scene or frame adjacent to the first scene or frame that is the same as the first metadata is omitted.

7. The image processing device of claim 1 , wherein correlation of the scenes or frames comprises correlation of metadata of scenes or frames.

8. The image processing device of claim 1 , wherein the HDR information further comprises two or more of:
minimum and maximum brightness value for each scene or frame;
backlight peaking information comprising backlight unit (BLU) brightness mapping parameter for each scene or frame;
color specification information comprising color gamut and color temperature of an image;
a transfer parameter comprising gamma adjust and contrast enhancement (CE) control parameter;
scene information comprising surrounding environment information of a scene or frame timeline;
histogram information showing lowest, highest and most frequent pixel value information;
sharpness information showing strength information of a boundary area of an image; and
correlation information of scenes or frames.

9. The image processing device of claim 1 , wherein the HDR information further comprises at least one of:
scene information comprising surrounding environment information of a scene or frame timeline;
sharpness information showing strength information of a boundary area of an image; and
correlation information of scenes or frames.

10. A display device for processing and displaying an image signal comprising:
an image receiver configured to receive packetized image data of an encoded image signal or a bit stream of image data of the encoded image signal;
a decoder configured to parse metadata from the packetized image data or bit stream and decode the image signal from the image data of the encoded image signal; and
an HDR image processor configured to analyze HDR information in the metadata, and generate an HDR image of the image signal from the analyzed HDR information and the decoded image signal,
wherein the HDR information comprises at least one of:
minimum and maximum brightness value for each scene or frame;
backlight peaking information comprising backlight unit (BLU) brightness mapping parameter for each scene or frame;
color specification information comprising color gamut and color temperature of an image;
a transfer parameter comprising gamma adjust and contrast enhancement (CE) control parameter;
scene information comprising surrounding environment information of a scene or frame timeline;
histogram information showing lowest, highest and most frequent pixel value information;
sharpness information showing strength information of a boundary area of an image; and
correlation information of scenes or frames,
wherein the HDR information comprises a compulsory HDR information and an optional HDR information which assists with the compulsory HDR information,
wherein the compulsory HDR information is always included in the metadata when one of the packetized image data and the bit stream is to be transmitted,
wherein the optional HDR information is sometimes omitted from the metadata when one of the packetized image data and the bit stream is to be transmitted, and
wherein the HDR information is additional information which is produced at an initial phase of producing the image, and includes a dynamic range which is higher than a dynamic range of the image.

11. The display device of claim 10 , wherein the HDR image processor is further configured to adjust the generated HDR image.

12. The display device of claim 11 , wherein the HDR image processor is further configured to adjust the generated HDR backlight information using the adjusted HDR image.

13. The display device of claim 10 , further comprising:
a storage portion configured to store the analyzed HDR information.

14. The display device of claim 10 , wherein the HDR image processor is further configured to generate HDR backlight information using the generated HDR image.

15. The display device of claim 14 , wherein the HDR image processor is further configured to adjust the generated HDR backlight information using the HDR information.

16. The display device of claim 15 , wherein the HDR image processor is further configured to estimate a final output brightness level of an HDR image according to the generated HDR backlight information and compensate for deficient or excessive brightness.

17. The display device of claim 15 , wherein the HDR image processor is further configured to adjust the generated HDR image using the adjusted HDR backlight information.

18. The display device of claim 15 , wherein the adjusted HDR backlight information is adjusted by applying a maximum power limit of the backlight.

19. The display device of claim 14 , wh

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kim Sung-Soo
• Park Jae-Sung
• Hwang Min-Cheol

Classifications

• H04N19/85

  using pre-processing or post-processing specially adapted for video compression · CPC title

• H04N19/463 Primary

  by compressing encoding parameters before transmission · CPC title

• H04N19/30

  using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) · CPC title

• G09G3/3426

  the different display panel areas being distributed in two dimensions, e.g. matrix · CPC title

• G09G2370/04

  Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller · CPC title