Methods, devices, and systems for embedding visual advertisements in video content

Patent metadata

Field	Value
Publication number	US-11582510-B2
Application number	US-202117241323-A
Country	US
Kind code	B2
Filing date	Apr 27, 2021
Priority date	Dec 7, 2018
Publication date	Feb 14, 2023
Grant date	Feb 14, 2023

Abstract

Aspects of the subject disclosure may include, for example, embodiments include obtaining video content, the video content comprises a plurality of frames, monitoring, by an image sensor, a facial feature of a user to determine a visual focus of the user in relation to the video content, and detecting from a group of frames of the plurality of frames at least a reduction in movements of objects in the group of frames. Further embodiments include determining, according to the monitoring and the detecting, a measure of attention of the user within a region of the group of frames, determining that the measure of attention of the user within the region of the group of frames satisfies a threshold, and embedding in at least a portion of subsequent frames of the plurality of frames a visual advertisement in the region via a communication device. Other embodiments are disclosed.

First claim

What is claimed is:

1. A device, comprising:
a processing system including a processor; and
a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising:
obtaining video content that comprises a plurality of frames;
determining a viewpoint trajectory in response to detecting a change in viewpoint by a user in viewing the video content;
performing a first determination that a first region of a first frame of the plurality of frames comprises a determined high user attention region;
during a presentation of the first frame, performing a second determination that the viewpoint has been adjusted to a second region of the first frame that comprises a determined low user attention region;
identifying a particular portion of subsequent frames of the plurality of frames to insert a visual advertisement according to the viewpoint trajectory, according to the first determination, and also according to the second determination, wherein the particular portion of the subsequent frames corresponds to the second region of the first frame, and wherein a different portion of the subsequent frames corresponds to the first region of the first frame; and
embedding the visual advertisement in the particular portion of the subsequent frames such that the visual advertisement is embedded in a determined low user attention region and not in a determined high user attention region, wherein the subsequent frames, including the different portion and the visual advertisement in the particular portion, are presented on a communication device associated with the user.

2. The device of claim 1 , wherein the operations comprise monitoring, by an image sensor, a facial feature of the user to determine a visual focus of the user in relation to the video content, and wherein the identifying of the particular portion of the subsequent frames of the plurality of frames comprises identifying the particular portion of the subsequent frames of the plurality of frames according to the visual focus of the user in relation to the video content.

3. The device of claim 2 , wherein the facial feature of the user comprises at least one eye of the user, and wherein the monitoring comprises monitoring, by the image sensor, a pupil of the at least one eye of the user.

4. The device of claim 2 , wherein the image sensor comprises a camera sensor.

5. The device of claim 1 , wherein the operations comprise:
identifying a first group of frames of the plurality of frames and identifying a second group of frames of the plurality of frames, wherein the first group of frames includes a first group of moving objects, wherein the second group of frames includes a second group of moving objects; and
determining the first group of moving objects in the first group of frames is fewer than the second group of moving objects in the second group of frames resulting in an object determination.

6. The device of claim 5 , wherein the identifying of the particular portion of the subsequent frames of the plurality of frames comprises identifying the particular portion of the subsequent frames of the plurality of frames according to the object determination.

7. The device of claim 5 , wherein the particular portion of the subsequent frames comprises a portion of the first group of frames.

8. The device of claim 1 , wherein the operations comprise:
determining a third group of frames of the plurality of frames associated with the viewpoint trajectory; and
determining a measure of attention of the user within a portion of the third group of frames, wherein the identifying of the particular portion of the subsequent frames of the plurality of frames comprises identifying the particular portion of the subsequent frames of the plurality of frames in response to determining that the measure of attention satisfies a threshold.

9. The device of claim 8 , wherein the determining of the measure of attention of the user comprises performing user attention analysis on the third group of frames.

10. The device of claim 9 , wherein the performing of the user attention analysis comprises performing video user attention analysis or performing audio user attention analysis.

11. The device of claim 1 , wherein the video content comprises panoramic video content.

12. The device of claim 1 , wherein the communication device comprises a virtual reality headset, wherein the performing the second determination that the viewpoint has been adjusted to the second region of the first frame is responsive to the detecting the change in viewpoint, wherein the operations further comprise performing a third determination that the particular portion of the subsequent frames does not include an object determined to be a distraction, performing a fourth determination, based on audio analysis, that the particular portion of the subsequent frames does not include noise above a particular level, and wherein the identifying the particular portion of the subsequent frames to insert the visual advertisement is further according to the third determination and also according to the fourth determination.

13. A non-transitory, machine-readable medium, comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, the operations comprising:
obtaining video content that comprises a plurality of frames;
determining a viewpoint trajectory in response to detecting a change in viewpoint by a user in viewing the video content;
monitoring, by an image sensor, a facial feature of the user to determine a visual focus of the user in relation to the video content;
performing a first determination that a first region of a first frame of the plurality of frames comprises a determined high user attention region;
during a presentation of the first frame, performing a second determination that the viewpoint has been adjusted to a second region of the first frame that comprises a determined low user attention region;
identifying a particular portion of subsequent frames of the plurality of frames to insert a visual advertisement according to the viewpoint trajectory, according to the first determination, according to the second determination, and also according to the visual focus, wherein the particular portion of the subsequent frames corresponds to the second region of the first frame, and wherein a different portion of the subsequent frames corresponds to the first region of the first frame; and
embedding the visual advertisement in the particular portion of the subsequent frames of the plurality of frames such that the visual advertisement is embedded in a determined low user attention region and not in a determined high user attention region, wherein the subsequent frames, including the different portion and the visual advertisement in the particular portion, are presented on a communication device associated with the user.

14. The non-transitory, machine-readable medium of claim 13 , wherein the facial feature of the user comprises at least one eye of the user, and wherein the monitoring comprises monitoring, by the image sensor, a pupil of the at least one eye of the user.

15. The non-transitory, machine-readable medium of claim 13 , wherein the image sensor comprises a camera sensor, wherein the performing the second determination that the viewpoint has been adjusted to the second region of the first frame is responsive to the detecting the change in viewpoint, wherein the operations further comprise performing a third determination that the particular portion of

Assignees

• At & T Ip I Lp

Inventors

• Han Bo
• Pejhan Sassan
• Liu Zhengye

Classifications

• H04N21/4316

  for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window · CPC title

• H04N21/4223

  Cameras (H04N23/00 takes precedence) · CPC title

• H04N21/44016 Primary

  involving splicing one content stream with another content stream, e.g. for substituting a video clip · CPC title

• H04N21/44218

  Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45) · CPC title

• H04N21/44008

  involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title