Dynamic digital object placement in video stream

Patent metadata

Field	Value
Publication number	US-12149758-B2
Application number	US-202318529955-A
Country	US
Kind code	B2
Filing date	Dec 5, 2023
Priority date	Sep 17, 2018
Publication date	Nov 19, 2024
Grant date	Nov 19, 2024

Abstract

Techniques and mechanisms described herein facilitate providing dynamic digital object placement in a video stream. An exchange network for engagements within video streaming content is maintained, and a number of engagement entities and content providers are connected to the exchange network. An engagement proposal is received from an engagement entity in the exchange network, containing media assets for an engagement and proposed engagement information. Content provider requirements are also received from a content provider in the exchange network, containing content provider requirements and one or more engagement surfaces associated with a video stream. The exchange network determines that the received engagement proposal matches the received content provider requirements. Once the exchange network matches the two entities, the media assets from the engagement entity are dynamically inserted into the video stream published by the content provider by mapping the media assets to the one or more engagement surfaces.

First claim

The invention claimed is:

1. A method comprising:
receiving a request to insert a media asset into a video stream playing on a device, wherein the media asset comprises three-dimensional (3D) object data;
identifying a segment of the video stream defined by markers in the video stream, wherein the identified segment depicts a 3D engagement surface in the video stream available for insertion of 3D media assets;
determining that the 3D media asset is mappable to the 3D engagement surface of the identified segment by verifying that:
(a) a resolution of the 3D object data conforms to resolution requirements for the 3D engagement surface; and
(b) dimensions of the 3D object data conform to dimensions of the 3D engagement surface in three dimensions; and

in response to the determining that the 3D media asset is mappable to the 3D engagement surface of the identified segment, inserting the 3D media asset into the video stream being played by the device by mapping the 3D media asset to the 3D engagement surface of the identified segment, such that the 3D media asset is displayed on the 3D engagement surface during the play of the video stream.

2. The method of claim 1 , wherein the 3D engagement surface comprises a surface that appears curved away from a plane defined by a display of the device, wherein:
the determining that the 3D media asset is mappable to the 3D engagement surface of the identified segment comprises:
determining that the spatial characteristics of the 3D object data conform to a curvature of the surface that appears curved away from the plane defined by the display of the device.

3. The method of claim 1 , further comprising:
transmitting the video stream to the device; and
determining that the device is starting a streaming session of the video stream in a middle section of the video stream and that the middle section of the video stream is within the identified segment,
wherein the mapping of the media asset to the 3D engagement surface of the identified segment is performed in response to determining that sufficient time remains to insert the media asset in the identified segment of the video stream before an end of the identified segment.

4. The method of claim 1 , wherein the 3D object data of the media asset is in a 3D file format.

5. The method of claim 1 , wherein the identified segment of the video stream comprises a 3D file format.

6. The method of claim 1 , wherein the markers comprise SCTE-35 or 1D3 tags.

7. The method of claim 1 , wherein the mapping of the media asset to the 3D engagement surface of the identified segment comprises: generating a video overlay for the video stream, the video overlay containing the media asset.

8. The method of claim 1 , wherein the inserting of the media asset in the video stream comprises inserting in the video stream lighting or shadow elements based on 3D properties of the media asset.

9. A system comprising:
communication circuitry configured to receive a request to insert a media asset into a video stream playing on a device, wherein the media asset comprises three-dimensional (3D) object data; and
processing circuitry configured:
to identify a segment of the video stream defined by markers in the video stream, wherein the identified segment depicts a 3D engagement surface in the video stream available for insertion of 3D media assets;
to determine that the 3D media asset is mappable to the 3D engagement surface of the identified segment by verifying that:
(a) a resolution of the 3D object data conforms to resolution requirements for the 3D engagement surface; and
(b) dimensions of the 3D object data conform to dimensions of the 3D engagement surface in three dimensions; and

to insert, in response to the determining that the 3D media asset is mappable to the 3D engagement surface of the identified segment, the 3D media asset into the video stream being played by the device by mapping the 3D media asset to the 3D engagement surface of the identified segment, such that the 3D media asset is displayed on the 3D engagement surface during the play of the video stream.

10. The system of claim 9 , wherein the 3D engagement surface comprises a surface that appears curved away from a plane defined by a display of the device, wherein:
the determining that the 3D media asset is mappable to the 3D engagement surface of the identified segment comprises:
determining that the spatial characteristics of the 3D object data conform to a curvature of the curved surface that appears curved away from the plane defined by the display of the device.

11. The system of claim 9 , wherein the processing circuitry is configured:
to transmit the video stream to the device; and
to determine that the device is starting a streaming session of the video stream in a middle section of the video stream and that the middle section of the video stream is within the identified segment,
wherein the mapping of the media asset to the 3D engagement surface of the identified segment is performed in response to determining that sufficient time remains to insert the media asset in the identified segment of the video stream before an end of the identified segment.

12. The system of claim 9 , wherein the 3D object data of the media asset is in a 3D file format.

13. The system of claim 9 , wherein the identified segment of the video stream comprises a 3D file format.

14. The system of claim 9 , wherein the markers comprise SCTE-35 or 1D3 tags.

15. The system of claim 9 , wherein the mapping of the media asset to the 3D engagement surface of the identified segment comprises: generating a video overlay for the video stream, the video overlay containing the media asset.

16. The system of claim 9 , wherein the inserting of the media asset in the video stream comprises inserting in the video stream lighting or shadow elements based on 3D properties of the media asset.

17. A non-transitory computer readable medium comprising instructions that, when executed by a processor, are configured to cause control circuitry:
to receive a request to insert a media asset into a video stream playing on a device, wherein the media asset comprises three-dimensional (3D) object data; and
to identify a segment of the video stream defined by markers in the video stream, wherein the identified segment depicts a 3D engagement surface in the video stream available for insertion of 3D media assets;
to determine that the 3D media asset is mappable to the 3D engagement surface of the identified segment by verifying that:
(a) a resolution of the 3D object data conforms to resolution requirements for the 3D engagement surface; and
(b) dimensions of the 3D object data conform to dimensions of the 3D engagement surface in three dimensions; and

to insert, in response to the determining that the 3D media asset is mappable to the 3D engagement surface of the identified segment, the 3D media asset into the video stream being played by the device by mapping the 3D media asset to the 3D engagement surface of the identified segment, such that the 3D media asset is displayed on the 3D engagement surface during the play of the video stream.

18. The system of claim 17 , wherein the 3D engagement surface comprises a surface that appears curved away from a plane defined by a display of the device, wherein:
the determining that the 3D media asset is mappable to the 3D engagement surface of the identified segment comprises:
determining that the spatial characteristics of the 3D object data conform to a curvature of the curved surface that appears

Assignees

• Adeia Media Holdings Llc

Inventors

• CARPENTER Cory

Classifications

• G06N20/00

  Machine learning · CPC title

• H04N21/8146

  involving graphical data, e.g. 3D object, 2D graphics · CPC title

• H04N21/251

  Learning process for intelligent management, e.g. learning user preferences for recommending movies (details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08) · CPC title

• H04N21/812 Primary

  involving advertisement data (advertising per se G06Q30/02) · CPC title

• G06Q30/0269

  based on user profile or attribute · CPC title