Workflow for content creation and guided display management of EDR video

Patent metadata

Field	Value
Publication number	US-9554020-B2
Application number	US-201414894153-A
Country	US
Kind code	B2
Filing date	Nov 10, 2014
Priority date	Nov 13, 2013
Publication date	Jan 24, 2017
Grant date	Jan 24, 2017

Abstract

Video data with enhanced dynamic range (EDR) are color graded for a first and a second reference display with different dynamic range characteristics to generate a first color-graded output, a second color graded output, and associated first and second sets of metadata. The first color-graded output and the two sets of metadata are transmitted from an encoder to a decoder to be displayed on a target display which may be different than the second reference display. At the receiver, a decoder interpolates between the first and second set of metadata to generate a third set of metadata which drives the display management process for displaying the received video data onto the target display. The second set of metadata of metadata may be represented as delta metadata values from the first set of metadata values.

First claim

The invention claimed is:

1. A method for guiding the display management of enhanced dynamic range (EDR) images in a video sequence, the method comprising, in a decoder:
receiving a first set of metadata for a first image color graded on a first reference video display;
receiving a set of delta metadata for a second image color graded on a second reference video display, wherein the first and second images represent the same scene;
generating a second set of metadata for the second image color graded on the second reference display, using the first set of metadata and the delta metadata;
receiving image data for the first image;
accessing a set of parameters for a target video display;
interpolating a third set of metadata using the first set of metadata, the second set of metadata, and the parameters of the target display; and
mapping the image data for the first image into the target display using the image data, the third set of metadata, and the parameters for the target display;
wherein the method is performed by one or more computing devices.

2. The method of claim 1 , wherein the first reference display has a higher dynamic range than the second reference display.

3. The method of claim 1 , wherein the first set of metadata comprises display parameters related to the dynamic range of the first reference display and the second set of metadata comprises display parameters related to the dynamic range of the second reference display.

4. The method of claim 1 , wherein the first set of metadata comprises minimum, maximum, and mid-tones values for the first image.

5. The method of claim 1 , wherein the second set of metadata comprises minimum, maximum, and mid-tones values for the second image.

6. The method of claim 1 , wherein the second set of metadata comprises data related to ambient-light conditions when generating the second image data.

7. The method of claim 1 , where the interpolation step between two metadata values is described by
Nv =(1 −a ) Sv+a Tv,

where Nv is the interpolated value, Sv is a metadata value in the first set of metadata, Tv is a metadata value in the second set of metadata, and a is a constant.

8. The method of claim 7 , wherein the interpolation constant a is determined as a function of the peak brightness of the second display and the target display.

9. The method of claim 1 , where the interpolation step between two metadata values is described by
Nv=Sv+R peak ƒ ( Tv−Sv ),

where Nv is the interpolated value, Sv is a metadata value in the first set of metadata, Tv is a metadata value in the second set of metadata, ƒ is a roll-off factor, and R peak is a function of the peak brightness values of the target display and the second display.

10. The method of claim 9 , wherein R peak is based on the ratio of the peak brightness of the second display over the peak brightness of the target display.

11. The method of claim 5 , wherein the second set of metadata further comprises lift, gain, and gamma values for the second image.

12. A method for guiding the display management of enhanced dynamic range (EDR) images in a video sequence, the method comprising, in a decoder:
accessing a first set of metadata ( 110 ) for a first image color graded on a first reference video display;
accessing a fourth set of metadata ( 255 ) for a second image color graded on a second reference video display, wherein the first and second images represent the same scene;
receiving image data ( 107 ) for the first image;
accessing a set of parameters ( 215 ) for a target video display;
generating a mapping function ( 240 ) using the first set of metadata, the fourth set of metadata, and the parameters of the target display; and
mapping ( 230 ) the image data for the first image into the target display using the image data, the generated mapping function, and the parameters for the target display,
wherein the fourth set of metadata is generated by an encoder and transmitted to the decoder,
wherein generating the fourth set of metadata in the encoder comprises:
generating ( 120 ) a second set of metadata for the second image color graded on the second reference display; and
applying a metadata transformation ( 250 ) to the second set of metadata to generate the fourth set of metadata;

wherein the method is performed by one or more computing devices.

13. The method of claim 12 wherein generating the mapping function comprises:
generating a first mapping function using the first set of metadata and the parameters of the target display;
generating a second mapping function using the fourth set of metadata and the parameters of the target display; and
generating the mapping function by interpolating between the first and second mapping functions.

14. The method of claim 13 , wherein the second mapping function is generated in response to both min, max, mid brightness values and lift, gain, and gamma values in the fourth set of metadata.

15. The method of claim 1 , wherein the target display is different than the first reference display or the second reference display.

16. The method of claim 1 , wherein the target display is different than the first reference display and the second reference display.

17. An apparatus comprising a processor and configured to perform the method recited in claim 1 .

18. A non-transitory computer-readable storage medium having stored thereon computer-executable instructions for executing a method with a computer in accordance with claim 1 .

Assignees

• Dolby Laboratories Licensing Corp

Inventors

• Thurston Iii Kimball D
• Crenshaw James E
• Atkins Robin
• Chen Tao
• Kunkel Timo

Classifications

• H04N9/69

  for modifying the colour signals by gamma correction (controlling camera response for colour signals H04N23/83) · CPC title

• G06T5/007

  Physics · mapped topic

• G06T5/50

  using two or more images, e.g. averaging or subtraction · CPC title

• H04N2201/326

  relating to the rendering or output medium, device or process, e.g. monitor, paper or printer profile · CPC title

• H04N1/603 Primary

  controlled by characteristics of the picture signal generator or the picture reproducer · CPC title