Video overlay modification for enhanced readability

Patent metadata

Field	Value
Publication number	US-10290110-B2
Application number	US-201615201812-A
Country	US
Kind code	B2
Filing date	Jul 5, 2016
Priority date	Jul 5, 2016
Publication date	May 14, 2019
Grant date	May 14, 2019

Abstract

Video overlays are modified to enhance readability. In one example a frame of a video sequence of frames is received and an overlay for display on the frame is received. A location of the overlay in the frame is determined. Background pixels in the frame that are in the overlay location are determined. Values of the identified pixels are analyzed and an overlay color is selected based on the analysis. The overlay is then blended into the frame using the selected overlay color.

First claim

What is claimed is:

1. A method comprising:
receiving a frame of a video sequence of frames in a buffer of a processor-based rendering system;
receiving an overlay for display on the frame in the buffer of the rendering system;
determining a location of the overlay in the frame in a background analyzer of the rendering system;
identifying background pixels in the frame that are in the overlay location in the background analyzer of the rendering system;
analyzing values of the identified pixels to determine whether the identified pixels create a complex background in the background analyzer of the rendering system, including determining spatial complexity of the frame in a location of the background pixels;
in response to determining that the identified pixels create a complex background, moving the overlay away from the complex background based on the analyzing in a modifier of the rendering system and the determined spatial complexity of the frame; and
blending the overlay into the frame using the moved overlay position in a blender of the rendering system.

2. The method of claim 1 , wherein the overlay is a text string.

3. The method of claim 1 , further comprising:
analyzing the colors and the brightness in the background pixels in the frame;
determining a contrast between individual pixels of a location of the background, where the overlay is to be positioned, with individual pixels of the overlay;
in response to determining that there is insufficient contrast between the overlay and the location of the background, moving the overlay to a different location of the background.

4. The method of claim 1 , further comprising selecting a color with more than a pre-determined contrast compared to the analyzed values.

5. The method of claim 4 , wherein analyzing values comprises generating a histogram of pixel color and brightness and wherein selecting an overlay color comprises selecting a color using the histogram.

6. The method of claim 1 , further comprising selecting an overlay color by not modifying the overlay color if the overlay has sufficient contrast to the background pixels.

7. The method of claim 1 , further comprising determining a complexity of the frame in the location of the background pixels and modifying the overlay based on the complexity.

8. The method of claim 7 , wherein modifying comprises moving the location of the overlay in the frame.

9. The method of claim 7 , wherein determining a complexity comprises generating a discrete cosine transform of the background pixels and comparing a spatial analysis of the DCT to a threshold.

10. The method of claim 7 , wherein determining a complexity comprises performing a wavelets analysis of the background pixels and comparing a spatial analysis of the wavelets analysis to a threshold.

11. The method of claim 1 , further comprising transmitting the blended frame to a head end transmitter.

12. The method of claim 1 , further comprising rendering the blended frame on a display.

13. An apparatus comprising:
a memory to store a video sequence of frames;
a decoder to receive a frame of the video sequence of frames;
an overlay generator to generate an overlay for display on the frame;
a background analyzer to determine a location of the overlay in the frame, to identify background pixels in the frame that are in the overlay location, to analyze values of the identified pixels, to determine whether the identified pixels create a complex background by, at least in part, determining spatial complexity of the frame in a location of the background pixels, and, in response to determining that the identified pixels create a complex background, to move the overlay away from the complex background based on the analysis and the determined spatial complexity of the frame; and
a blender to blend the overlay into the frame using the moved overlay position.

14. The apparatus of claim 13 , wherein the background analyzer selects an overlay color with more than a pre-determined contrast compared to the analyzed values.

15. The apparatus of claim 13 , wherein the background analyzer analyzes values by determining pixel color and brightness of the background and selects an overlay color that is darker than the pixel color.

16. The apparatus of claim 13 , wherein background analyzer selects an overlay color by not modifying the overlay color if the overlay has sufficient contrast to the background pixels.

17. The apparatus of claim 13 , wherein the background analyzer further determines a complexity of the frame in the location of the background pixels using a spatial analysis and moves the location of a portion of the overlay in the frame to a position having a lower complexity based on the spatial analysis.

18. A video system comprising:
a receiver to receive a video sequence of frames;
a memory to store the received video sequence;
a processor to decode the stored video sequence, to generate an overlay for display on the frame, to determine a location of the overlay in the frame, to identify background pixels in the frame that are in the overlay location, to analyze values of the identified pixels, to determine whether the identified pixels create a complex background by, at least in part, determining spatial complexity of the frame in a location of the background pixels, in response to determining that the identified pixels create a complex background, to move the overlay away from the complex background based on the analysis and the determined spatial complexity of the frame, and to blend the overlay into the frame using the moved overlay position; and
a display to show the rendered video with the overlay.

19. The video system of claim 18 , wherein the processor is a graphics processing unit.

20. The video system of claim 18 , wherein the processor determines a complexity of the frame in the location of the background pixels using a discrete cosine transform of the background pixels and moves the location of a portion of the overlay in the frame to a location that is less complex in the location of the background pixels.

Assignees

• Intel Corp

Inventors

• Lawrence Sean J W
• Angadimani Raghavendra

Classifications

• G06T7/90

  Determination of colour characteristics · CPC title

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title

• G06T7/13

  Edge detection · CPC title

• G06T7/33 Primary

  using feature-based methods · CPC title