Systems and methods for programmatic quality control of content

Patent metadata

Field	Value
Publication number	US-11838561-B2
Application number	US-202117477000-A
Country	US
Kind code	B2
Filing date	Sep 16, 2021
Priority date	Sep 16, 2021
Publication date	Dec 5, 2023
Grant date	Dec 5, 2023

Abstract

Systems and methods for controlling quality of content are provided. Programmatic ad buying may facilitate and expedite ad buying via an automated process. However, quality control via a conventional ad buying process is done with manual intervention. A confidence tool may request, from a programmatic content library of a content provider, to analyze a content tag associated with programmatic content. The confidence tool may determine whether the content tag meets confidence criteria (e.g., specifications of a content presentation service). The confidence tool may notify the content provider of whether the content tag meets the confidence criteria. Based on this notification, the content provider may approve the content to be run or reject the content to prevent problematic content from running on the content presentation service.

First claim

What is claimed is:

1. A tangible, non-transitory, computer-readable medium, comprising computer-readable instructions that, when executed by one or more processors of an electronic device, cause the electronic device to:
identify programmatic content stored in a programmatic content library, wherein the programmatic content comprises content that is scheduled, at a content provider service, via an automated scheduling process, for presentation via a content presentation service; and
in response to identifying the programmatic content, perform quality control of the programmatic content, by:
receiving a content tag, indicative of the programmatic content, wherein the content tag comprises a link to the programmatic content;
identifying criteria of the content presentation service;
determining whether the content tag, the programmatic content, or both, meet the criteria of the content presentation service by analyzing the content tag, the programmatic content, or both;
when the content tag, the programmatic content, or both does not meet the criteria of the content presentation service, causing the content provider service to refrain from running the programmatic content; and
when the content tag, the programmatic content, or both meets the criteria of the content presentation service;
causing the content provider service to run the programmatic content; and
periodically performing, while the content tag, the programmatic content, or both continue to meet the criteria of the content presentation service, a delta check on the content tag, the programmatic content, or both, wherein performing the delta check comprises determining whether the content tag, the programmatic content, or both have undergone a change since passing the quality control that could cause the content tag, the programmatic content, or both to fail to meet the criteria of the content presentation service; and
in response to determining that the change has occurred, performing a second round of the quality control based upon the change.

2. The tangible, non-transitory, computer-readable medium of claim 1 , comprising computer-readable instructions that, when executed by the one or more processors, cause the electronic device to:
identify the programmatic content by requesting the programmatic content, via an application programming interface (API) of the content provider service.

3. The tangible, non-transitory, computer-readable medium of claim 2 , comprising computer-readable instructions that, when executed by the one or more processors, cause the electronic device to:
identify the programmatic content by requesting programmatic content associated with deals having a particular deal identifier, via an application programming interface (API) of the content provider service.

4. The tangible, non-transitory, computer-readable medium of claim 2 , comprising computer-readable instructions that, when executed by the one or more processors, cause the electronic device to:
identify the programmatic content by requesting programmatic content associated with deals having a particular deal type, via an application programming interface (API) of the content provider service.

5. The tangible, non-transitory, computer-readable medium of claim 4 , wherein the particular deal type comprises a programmatic guaranteed deal type.

6. The tangible, non-transitory, computer-readable medium of claim 2 , comprising computer-readable instructions that, when executed by the one or more processors, cause the electronic device to:
identify the programmatic content by requesting programmatic content that is in a pending state, not yet being run.

7. The tangible, non-transitory, computer-readable medium of claim 1 , wherein the programmatic content is defined based upon a deal generated in a demand side platform wherein the deal is generated in near-real-time with respect to performing the quality control.

8. The tangible, non-transitory, computer-readable medium of claim 1 , comprising computer-readable instructions that, when executed by the one or more processors, cause the electronic device to:
in response to identifying the programmatic content, identify deals associated with the programmatic content;
filter from the deals any of the deals not meeting a deal criteria indicative of deals to be quality controlled; and
filtering from the programmatic content any programmatic content not associated with the filtered deals.

9. The tangible, non-transitory, computer-readable medium of claim 1 , comprising computer-readable instructions that, when executed by the one or more processors, cause the electronic device to:
cause the content provider service to run the programmatic content, by sending an indication that the programmatic content has been approved to the content provider service.

10. The tangible, non-transitory, computer-readable medium of claim 1 , comprising computer-readable instructions that, when executed by the one or more processors, cause the electronic device to:
cause the content provider service to refrain from running the programmatic content, by sending an indication that the programmatic content has been rejected to the content provider service.

11. The tangible, non-transitory, computer-readable medium of claim 1 , comprising computer-readable instructions that, when executed by the one or more processors, cause the electronic device to:
determine that the content tag comprises a wrapped tag comprising an indirect link to the programmatic content;
perform an unwrapping of the wrapped tag, in response to determining that the content tag comprises a wrapped tag, by:
performing quality control on the wrapped tag; and
navigating to the indirect link; and

continuing to perform the unwrapping until a direct link to the programmatic content is found.

12. The tangible, non-transitory, computer-readable medium of claim 11 , comprising computer-readable instructions that, when executed by the one or more processors, cause the electronic device to:
in response to performing quality control on the wrapped tag, determine whether the wrapped tag has passed the quality control;
in response to determining that the wrapped tag has passed the quality control, perform the delta check on the wrapped tag, wherein performing the delta check comprises determining whether the wrapped tag has undergone a change since passing the quality control; and
in response to determining that the wrapped tag has changed since passing the quality control, re-performing the quality control on the wrapped tag.

13. The tangible, non-transitory, computer-readable medium of claim 12 , wherein performing the delta check comprises performing the delta check on one or more pixels associated with the wrapped tag.

14. The tangible, non-transitory, computer-readable medium of claim 1 , comprising computer-readable instructions that, when executed by the one or more processors, cause the electronic device to:
determine that the content tag comprises an inline tag comprising a direct link to the programmatic content; and
performing quality control on the inline tag and/or the programmatic content.

15. The tangible, non-transitory, computer-readable medium of claim 14 , comprising computer-readable instructions that, when executed by the one or more processors, cause the electronic device to:
in response to performing quality control on the inline tag and the programmatic content, determine whether the inline tag and the programmatic content have passed the quality control;
in response to determining that the inline tag and the programmatic content have passed

Assignees

• Nbcuniversal Media Llc

Inventors

• Levin Michael S
• Paige Alexandra
• Stepanov Tatiana
• Lynn Christopher
• Cacciatore Dana
• Costa Carlos
• Mason Rebecca
• Navea Janice
• Butler Joshua
• Krzywoglowy Stephane

Classifications

• H04N21/23418 Primary

  involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title

• H04N21/2402

  Monitoring of the downstream path of the transmission network, e.g. bandwidth available (traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876) · CPC title

• H04N21/4431

  characterized by the use of Application Program Interface [API] libraries · CPC title

• H04N21/812

  involving advertisement data (advertising per se G06Q30/02) · CPC title

• G06Q10/06395 Primary

  Quality analysis or management · CPC title