Methods, devices, and systems for embedding visual advertisements in video content

Patent metadata

Field	Value
Publication number	US-11032607-B2
Application number	US-201816213585-A
Country	US
Kind code	B2
Filing date	Dec 7, 2018
Priority date	Dec 7, 2018
Publication date	Jun 8, 2021
Grant date	Jun 8, 2021

Abstract

Aspects of the subject disclosure may include, for example, embodiments include obtaining video content, the video content comprises a plurality of frames, monitoring, by an image sensor, a facial feature of a user to determine a visual focus of the user in relation to the video content, and detecting from a group of frames of the plurality of frames at least a reduction in movements of objects in the group of frames. Further embodiments include determining, according to the monitoring and the detecting, a measure of attention of the user within a region of the group of frames, determining that the measure of attention of the user within the region of the group of frames satisfies a threshold, and embedding in at least a portion of subsequent frames of the plurality of frames a visual advertisement in the region via a communication device. Other embodiments are disclosed.

First claim

What is claimed is:

1. A device, comprising:
a processing system including a processor; and
a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising:
obtaining video content, wherein the video content comprises a plurality of frames;
monitoring, by an image sensor, a facial feature of a user to determine a visual focus of the user in relation to the video content;
identifying a first group of frames of the plurality of frames and identifying a second group of frames of the plurality of frames, wherein the first group of frames includes a first group of moving objects, wherein the second group of frames includes a second group of moving objects;
determining that the first group of moving objects in the first group of frames is fewer than the second group of moving objects in the second group of frames resulting in an object determination;
determining the first group of frames includes different media content than the second group of frames resulting in a scene determination;
determining, according to the monitoring and the object determination, a measure of attention of the user within a region of the first group of frames;
determining that the measure of attention of the user within the region of the first group of frames satisfies a threshold;
detecting a change in viewpoint by the user;
determining a viewpoint trajectory from the change in viewpoint;
identifying a portion of subsequent frames of the plurality of frames to insert a visual advertisement according to the scene determination, object determination, the measure of attention of the user, and the viewpoint trajectory;
identifying a current time period to embed the visual advertisement, wherein the portion of subsequent frames are within the current time period;
identifying a previous time period for embedding a previous visual advertisement in a previous group of frames;
determining a time period between the previous time period and the current time period;
determining the time period exceeding a time threshold; and
in response to the time period exceeding the time threshold, embedding in at least the portion of subsequent frames of the plurality of frames the visual advertisement in the region for presentation to the user via a communication device receiving the at least the portion of subsequent frames of the plurality of frames.

2. The device of claim 1 , wherein the threshold comprises a desired measure of attention of the user and a measure of movement of objects.

3. The device of claim 1 , wherein the region in the first group of frames satisfying the threshold comprises a low user attention region.

4. The device of claim 1 , wherein the facial feature of the user comprises at least one eye of the user, and wherein the monitoring comprises monitoring, by the image sensor, a pupil of the at least one eye of the user.

5. The device of claim 1 , wherein the image sensor comprises a camera sensor.

6. The device of claim 1 , wherein the determining of the measure of attention of the user comprises performing user attention analysis on the first group of frames.

7. The device of claim 6 , wherein the performing of the user attention analysis comprises performing video user attention analysis or performing audio user attention analysis.

8. The device of claim 1 , wherein the previous visual advertisement is same as the visual advertisement.

9. The device of claim 1 , wherein the previous visual advertisement is different than the visual advertisement.

10. The device of claim 1 , wherein the determining of the measure of attention of the user within the region of the first group of frames comprises determining the measure of attention of the user within the region of the first group of frames according to the change in viewpoint.

11. The device of claim 1 , wherein the determining of the measure of attention of the user within the region of the first group of frames comprises determining the measure of attention of the user within the region of the first group of frames in response to performing a spatial analysis on the first group of frames.

12. The device of claim 1 , wherein the video content comprises panoramic video content.

13. The device of claim 1 , wherein the communication device comprises a virtual reality headset.

14. A non-transitory, machine-readable medium, comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, the operations comprising:
obtaining video content, wherein the video content comprises a plurality of frames;
monitoring, by a sensor, a feature of a user to determine a focus of attention of the user in relation to the video content;
identifying a first group of frames of the plurality of frames and identifying a second group of frames of the plurality of frames, wherein the first group of frames includes a first group of moving objects, wherein the second group of frames includes a second group of moving objects;
determining that the first group of moving objects in the first group of frames is fewer than the second group of moving objects in the second group of frames resulting in an object determination;
detecting from sensor data supplied by the sensor a change in viewpoint of the user;
determining the first group of frames includes different media content than the second group of frames resulting in a scene determination;
determining, according to the object determination and the change in viewpoint, a measure of attention of the user within a region of the first group of frames according to the change in viewpoint;
determining that the measure of attention of the user within the region of the first group of frames satisfies a threshold;
detecting the change in viewpoint by the user;
determining a viewpoint trajectory from the change in viewpoint;
identifying a portion of subsequent frames of the plurality of frames to insert a visual advertisement according to the scene determination, object determination, the measure of attention of the user, and the viewpoint trajectory;
identifying a current time period to insert the visual advertisement, wherein the portion of subsequent frames are within the current time period;
identifying a previous time period for inserting a previous visual advertisement in a previous group of frames;
determining a time period between the previous time period and the current time period;
determining the time period exceeding a time threshold; and
in response to the time period exceeding the time threshold, inserting in at least the portion of subsequent frames of the plurality of frames the visual advertisement in the region for presentation to the user via a communication device receiving the at least the portion of subsequent frames of the plurality of frames.

15. The non-transitory, machine-readable medium of claim 14 , wherein the threshold comprises a desired measure of attention of the user and a measure of movement of objects.

16. The non-transitory, machine-readable medium of claim 14 , wherein the region in the first group of frames satisfying the threshold comprises a low user attention region.

17. The non-transitory, machine-readable medium of claim 14 , wherein the determining of the measure of attention of the user comprises performing user attention analysis on the first group of frames.

18. The non-transitory, machine-readable medium of claim 17 , wherein the performing of the user attention analysis comprises

Assignees

• At & T Ip I Lp

Inventors

• Han Bo
• Pejhan Sassan
• Liu Zhengye

Classifications

• H04N21/4223

  Cameras (H04N23/00 takes precedence) · CPC title

• H04N21/812 Primary

  involving advertisement data (advertising per se G06Q30/02) · CPC title

• H04N21/44008

  involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title

• H04N21/41407

  embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57) · CPC title

• H04N21/44218

  Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45) · CPC title