Systems and methods for appearance mapping for compositing overlay graphics

Patent metadata

Field	Value
Publication number	US-10977849-B2
Application number	US-201916674373-A
Country	US
Kind code	B2
Filing date	Nov 5, 2019
Priority date	Feb 21, 2013
Publication date	Apr 13, 2021
Grant date	Apr 13, 2021

Abstract

Systems and methods for overlaying a second image/video data onto a first image/video data are described herein. The first image/video data may be intended to be rendered on a display with certain characteristics—e.g., HDR, EDR, VDR or UHD capabilities. The second image/video data may comprise graphics, closed captioning, text, advertisement—or any data that may be desired to be overlaid and/or composited onto the first image/video data. The second image/video data may be appearance mapped according to the image statistics and/or characteristics of the first image/video data. In addition, such appearance mapping may be made according to the characteristics of the display that the composite data is to be rendered. Such appearance mapping is desired to render a composite data that is visually pleasing to a viewer, rendered upon a desired display.

First claim

The invention claimed is:

1. A method for overlaying a second image over a first image, the method comprising:
receiving the first image and the second image, the first image differing in dynamic range and size from the second image;
mapping a dynamic range of the first image to a dynamic range of a display to generate an adjusted first image, wherein said mapped dynamic range of the first image is different from a maximum dynamic range of the display;
performing appearance mapping of the second image to determine an adjusted second image that differs in dynamic range from the second image, wherein performing appearance mapping of the second image (i) is performed according to mapping information about the mapped dynamic range of the first image and image statistics regarding the second image, the image statistics including at least one of average luminance, minimum luminance, mean luminance, maximum luminance, dynamic range, reflective white, color temperature, whitepoint, color gamut and color palette, and (ii) involves selecting a dynamic range based on the dynamic range of the adjusted first image; and
forming a composite image by overlaying said adjusted second image onto a portion of the adjusted first image.

2. The method of claim 1 wherein the first image is at least one of High Dynamic Range (HDR) image, Extended Dynamic Range (EDR) image and Visual Dynamic Range (VDR) image.

3. The method of claim 1 wherein said second image comprises one of a group, said group comprising: graphics, close captioning, text, video overlay, Graphical User Interface (GUI), television (TV) guides, signals from broadcasting company, signals from content creation, subtitles, signals from set top box and signals from Audio-Video (AV) receiver.

4. A method for overlaying a second image over a first image, the method comprising:
receiving the first image and the second image, the first image differing in dynamic range and size from the second image;
mapping a dynamic range of the first image to a dynamic range of a display to generate an adjusted first image, wherein said mapped dynamic range of the first image is different from a maximum dynamic range of the display;
performing appearance mapping of the second image to determine an adjusted second image that differs in dynamic range from the second image, wherein performing appearance mapping of the second image (i) is performed according to mapping information about the mapped dynamic range of the first image and image statistics regarding the second image, the image statistics including at least one of average luminance, minimum luminance, mean luminance, maximum luminance, dynamic range, reflective white, color temperature, whitepoint, color gamut and color palette, and (ii) involves selecting a dynamic range based on the capabilities of the display; and
forming a composite image by overlaying said adjusted second image onto a portion of the adjusted first image.

5. The method of claim 4 wherein the first image is at least one of High Dynamic Range (HDR) image, Extended Dynamic Range (EDR) image and Visual Dynamic Range (VDR) image.

6. The method of claim 4 wherein said second image comprises one of a group, said group comprising: graphics, close captioning, text, video overlay, Graphical User Interface (GUI), television (TV) guides, signals from broadcasting company, signals from content creation, subtitles, signals from set top box and signals from Audio-Video (AV) receiver.

Assignees

• Dolby Laboratories Licensing Corp

Inventors

• Kunkel Timo
• Xu Ning
• Chen Tao
• Lee Bongsun
• Hulyalkar Samir N

Classifications

• H04N5/2723 Primary

  Insertion of virtual advertisement; Replacing advertisements physical present in the scene by virtual advertisement (data processing systems or methods specially adapted for marketing G06Q30/02) · CPC title

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• H04N9/67

  for matrixing (camera processing pipelines for matrixing of colour signals H04N23/85) · CPC title

• G09G2370/04

  Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller · CPC title