Workflow for Content Creation and Guided Display Management of EDR Video

Patent metadata

Field	Value
Publication number	US-2016248939-A1
Application number	US-201414894153-A
Country	US
Kind code	A1
Filing date	Nov 10, 2014
Priority date	Nov 13, 2013
Publication date	Aug 25, 2016
Grant date	—

Abstract

Video data with enhanced dynamic range are color graded for a first and a second reference display with different dynamic range characteristics to generate a first color-graded output, a second color graded output, and associated first and second sets of metadata. The first color-graded output and the two sets of metadata are transmitted from an encoder to a decoder to be displayed on a target display which may be different than the second reference display. At the receiver, a decoder interpolates between the first and second set of metadata to generate a third set of metadata which drives the display management process for displaying the received video data onto the target display. The second set of metadata of metadata may be represented as delta metadata values from the first set of metadata values.

First claim

1 - 18 . (canceled)

19 . A method for guiding the display management of enhanced dynamic range (EDR) images in a video sequence, the method comprising, in a decoder:
receiving a first set of metadata for a first image color graded on a first display; receiving a set of delta metadata for a second image color graded on a second display, wherein the first and second images represent the same scene; generating a second set of metadata for the second image color graded on the second display, using the first set of metadata and the delta metadata; receiving image data for the first image; accessing a set of parameters for a target display; interpolating a third set of metadata using the first set of metadata, the second set of metadata, and the parameters of the target display; and mapping the image data for the first image into the target display using the image data, the third set of metadata, and the parameters for the target display.

20 . The method of claim 19 , wherein the first reference display has a higher dynamic range than the second reference display.

21 . The method of claim 19 , wherein the first set of metadata comprises display parameters related to the dynamic range of the first reference display and the second set of metadata comprises display parameters related to the dynamic range of the second reference display.

22 . The method of claim 19 , wherein the first set of metadata comprises minimum, maximum, and mid-tones values for the first image.

23 . The method of claim 19 , wherein the second set of metadata comprises minimum, maximum, and mid-tones values for the second image.

24 . The method of claim 19 , wherein the second set of metadata comprises data related to ambient-light conditions when generating the second image data.

25 . The method of claim 19 , where the interpolation step between two metadata values is described by
N ν=(1 −a ) Sν+a Tν,
where Nν is the interpolated value, Sν is a metadata value in the first set of metadata, Tν is a metadata value in the second set of metadata, and a is a constant.

26 . The method of claim 25 , wherein the interpolation constant a is determined as a function of the peak brightness of the second display and the target display.

27 . The method of claim 19 , where the interpolation step between two metadata values is described by
Nν=Sν+R peak f ( Tν−S ν),
where Nν is the interpolated value, Sν is a metadata value in the first set of metadata, Tν is a metadata value in the second set of metadata, f is a roll-off factor, and R peak is a function of the peak brightness values of the target display and the second display.

28 . The method of claim 27 , wherein R peak is based on the ratio of the peak brightness of the second display over the peak brightness of the target display.

29 . The method of claim 23 , wherein the second set of metadata further comprises lift, gain, and gamma values for the second image.

30 . A method for guiding the display management of enhanced dynamic range (EDR) images in a video sequence, the method comprising, in a decoder:
accessing a first set of metadata for a first image color graded on a first display; accessing a fourth set of metadata for a second image color graded on a second display, wherein the first and second images represent the same scene; receiving image data for the first image; accessing a set of parameters for a target display; generating a mapping function using the first set of metadata, the fourth set of metadata, and the parameters of the target display; and mapping the image data for the first image into the target display using the image data, the generated mapping function, and the parameters for the target display, wherein the fourth set of metadata is generated by an encoder by transforming a second set of metadata for the second image color graded on the second display; and wherein generating the fourth set of metadata comprises: generating a first display mapping function to map the first image data into the second display using one or more metadata values in the second set of metadata; generating temporary image data using the first display mapping function and the first image data; generating the second image in response to the temporary image data and lift, gain, and gamma data in the second set of metadata; adjusting a parameter of the first display mapping function by an offset to generate a second display mapping function; and generating, using an optimization technique, the fourth set of metadata and an optimized offset value, wherein the fourth set of metadata and the optimized offset value are generated so that given the first image, the fourth set of metadata, and the optimized offset value, the second display mapping function generates a third image, wherein the distance between the third image and the second image is minimum according to an image distance criterion.

31 . The method of claim 30 wherein generating the mapping function comprises:
generating a first mapping function using the first set of metadata and the parameters of the target display;
generating a second mapping function using the fourth set of metadata and the parameters of the target display; and
generating the mapping function by interpolating between the first and second mapping functions.

32 . The method of claim 31 , wherein the second mapping function is generated in response to both min, max, mid brightness values and lift, gain, and gamma values in the fourth set of metadata.

33 . The method of claim 19 , wherein the target display is different than the first display or the second display.

34 . The method of claim 19 , wherein the target display is different than the first display and the second display.

35 . An apparatus comprising a processor and configured to perform the method recited in claim 19 .

36 . A non-transitory computer-readable storage medium having stored thereon computer-executable instructions for executing a method with a computer in accordance with claim 19 .

Assignees

• Dolby Laboratories Licensing Corp

Inventors

• Thurston Iii Kimball D
• Crenshaw James E
• Atkins Robin
• Chen Tao
• Kunkel Timo

Classifications

• H04N9/69

  for modifying the colour signals by gamma correction (controlling camera response for colour signals H04N23/83) · CPC title

• G06T5/007

  Physics · mapped topic

• H04N2201/326

  relating to the rendering or output medium, device or process, e.g. monitor, paper or printer profile · CPC title

• H04N1/603 Primary

  controlled by characteristics of the picture signal generator or the picture reproducer · CPC title

• G06T5/50

  using two or more images, e.g. averaging or subtraction · CPC title