Augmenting content using contextual features

Patent metadata

Field	Value
Publication number	US-12439123-B2
Application number	US-202318157325-A
Country	US
Kind code	B2
Filing date	Jan 20, 2023
Priority date	Jan 20, 2023
Publication date	Oct 7, 2025
Grant date	Oct 7, 2025

Abstract

Systems, apparatuses, and methods are described for contextually augmenting content, which may be offered based on segment types associated with various sentiments, emotions, and/or excitement levels which may be detected and/or aligned in the content. The contextual content augmentation may comprise in-video contextual advertising, which may be based on advertisement strategies such as segment-based, alignment/detection-based, market-based, and/or user-based strategies.

First claim

The invention claimed is:

1. A method comprising:
detecting, by a computing device, one or more advertisements in one or more first video regions of one or more segments of a content item;
selecting, based on a user interest level corresponding to the one or more segments of the content item satisfying a threshold, and based on an activity level of one or more second video regions, the one or more second video regions adjacent to the one or more first video regions; and
augmenting the one or more advertisements in the one or more first video regions by:
replacing the one or more advertisements in the one or more first video regions with a first portion of one or more second advertisements; and
causing a second portion of the one or more second advertisements to output in the one or more second video regions.

2. The method of claim 1 , further comprising:
generating the first portion of the one or more second advertisements by adding, to the one or more advertisements, one or more of:
animation of at least a portion of the one or more advertisements;
one or more changes to one or more colors of the one or more advertisements;
one or more changes to location of the one or more advertisements;
one or more size changes of one or more portions of the one or more advertisements;
addition of graphics and/or images to the one or more second video regions of the one or more advertisements; or
one or more changes to text of the one or more advertisements.

3. The method of claim 1 , wherein the user interest level corresponding to the one or more segments of the content item is based on determining that the one or more segments of the content item comprise one or more of:
an activity predicted to be uninteresting to viewers of the content item,
an activity predicted to be interesting to viewers of the content item, or
an activity predicted to be exciting to viewers of the content item.

4. The method of claim 1 , wherein the detecting the one or more advertisements comprises:
monitoring the one or more first video regions of the one or more segments of the content item for the one or more advertisements.

5. The method of claim 1 , further comprising:
identifying the one or more second advertisements based on a segment type of the one or more segments.

6. The method of claim 1 , further comprising:
generating the one or more second advertisements based on one or more of:
geographic information; or
viewer demographic information.

7. The method of claim 1 , wherein the selecting the one or more second video regions is further based on one or more of:
metadata corresponding to one or more segment types of the one or more segments;
closed captioning data associated with the one or more segments; or
audio associated with the one or more segments.

8. The method of claim 1 , wherein the selecting the one or more second video regions is further based on determining an availability of rights associated with the one or more advertisements.

9. The method of claim 1 , wherein the one or more advertisements comprise a brand logo on a subject in the content item.

10. The method of claim 1 , wherein the one or more advertisements correspond to a subject of the content item.

11. The method of claim 1 , further comprising:
determining the activity level of the one or more second video regions based on one or more of:
metadata associated with the one or more segments;
closed captioning associated with the one or more segments;
Media Analytics Framework (MAF) detection of the one or more segments; or
optical character recognition (OCR) associated with the one or more segments.

12. The method of claim 1 , wherein the
selecting the one or more second video regions is based on determining, using a heatmap corresponding to the one or more segments of the content item, that the one or more second video regions comprise a low heatmap level compared to other video regions of the one or more segments of the content item.

13. A non-transitory computer-readable medium storing instructions that, when executed, cause:
detecting one or more advertisements in one or more first video regions of one or more segments of a content item;
selecting, based on a user interest level corresponding to the one or more segments of the content item satisfying a threshold, and based on an activity level of one or more second video regions, the one or more second video regions adjacent to the one or more first video regions; and
augmenting the one or more advertisements in the one or more first video regions by:
replacing the one or more advertisements in the one or more first video regions with a first portion of one or more second advertisements; and
causing a second portion of the one or more second advertisements to output in the one or more second video regions.

14. The non-transitory computer-readable medium of claim 13 , wherein the instructions, when executed, cause:
generating the first portion of the one or more second advertisements by adding, to the one or more advertisements, one or more of:
animation of at least a portion of the one or more advertisements;
one or more changes to one or more colors of the one or more advertisements;
one or more changes to location of the one or more advertisements;
one or more size changes of one or more portions of the one or more advertisements;
addition of graphics and/or images to the one or more second video regions of the one or more advertisements; or
one or more changes to text of the one or more advertisements.

15. The non-transitory computer-readable medium of claim 13 , wherein the user interest level corresponding to the one or more segments of the content item is based on determining that the one or more segments of the content item comprise one or more of:
an activity predicted to be uninteresting to viewers of the content item,
an activity predicted to be interesting to viewers of the content item, or
an activity predicted to be exciting to viewers of the content item.

16. The non-transitory computer-readable medium of claim 13 , wherein the instructions, when executed, further cause:
identifying the one or more second advertisements based on a segment type of the one or more segments.

17. The non-transitory computer-readable medium of claim 13 , wherein the instructions, when executed, further cause:
generating the one or more second advertisements based on:
geographic information; or
viewer demographic information.

18. The non-transitory computer-readable medium of claim 13 , wherein the instructions, when executed, further cause the selecting the one or more second video regions based on one or more of:
metadata corresponding to one or more segment types of the one or more segments;
closed captioning data associated with the one or more segments; or
audio of the one or more segments.

19. An apparatus comprising:
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the apparatus to:
detect one or more advertisements in one or more first video regions of one or more segments of a content item;
select, based on a user interest level corresponding to the one or more segments of the content item satisfying a threshold, and based on an activity level of one or more second video regions, the one or more second video regions adjacent to the one or more first video regions; and
augment the one or more advertisements in the one or more first video regions by:
replacing the one or more ad

Assignees

• Comcast Cable Comm Llc

Inventors

• Younessian Ehsan

Classifications

• H04N21/2407

  Monitoring of transmitted content, e.g. distribution time, number of downloads (arrangements for monitoring programmes for broadcast or for distribution combined with broadcast H04H20/14) · CPC title

• H04N21/2541 Primary

  Rights Management (protecting software against unauthorised usage in a vending or licensing environment G06F21/10; security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08) · CPC title

• H04N21/2668

  Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)} · CPC title

• H04N21/8456

  by decomposing the content in the time domain, e.g. in time segments · CPC title

• H04N21/44008

  involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title