Video session with advertisement content

Patent metadata

Field	Value
Publication number	US-12035019-B2
Application number	US-202318306261-A
Country	US
Kind code	B2
Filing date	Apr 25, 2023
Priority date	Jul 27, 2018
Publication date	Jul 9, 2024
Grant date	Jul 9, 2024

Abstract

A system and method for inserting secondary content, e.g., advertisement content, graphics, images, etc., in a video environment. When a request is received from a client device for playing a video asset, a plurality of video tiles of the video asset are selected to be assembled as a video frame for delivery to the client device. A portion of the video tiles are identified that can be replaced with a corresponding set of advertisement content tiles, e.g., based on gaze vector information and/or a tile metadata specification containing advertisement insertion availability timing information with respect to each of the tiles of the video frame. After replacing the portion of the identified video tiles, the corresponding set of advertisement content tiles and remaining video tiles are assembled into the video frame including the advertisement content tiles at select locations, which is transmitted to the client device.

First claim

The invention claimed is:

1. A client device configured to engage in a video session, the client device comprising:
at least one microprocessor; and
a non-transitory computer-readable storage medium, coupled to the at least one microprocessor, further including computer-readable instructions, when executed by the at least one microprocessor, configured for:
generating a request for playing a video asset in a display environment viewable by a user operating the client device, the video asset comprising a plurality of video frames;
providing gaze vector information relative to a video frame of the video asset presented in the display environment, the gaze vector information defining a gaze direction associated with a viewport in the display environment where the user is viewing at any particular time during the video session, wherein the video frame comprises a plurality of regions viewable by the user and at least a first region within the viewport has a first video quality and at least a second region outside the viewport has a second video quality;
receiving at least one video frame of the video asset, the at least one video frame including advertisement content at a selectable location in the at least one video frame depending at least in part on the gaze vector information; and
rendering the at least one video frame including the advertisement content for presentation to the user.

2. The client device as recited in claim 1 , wherein the computer-readable instructions further comprise instructions operative for determining the gaze direction by tracking at least one of an orientation of the user's headset associated with the client device for displaying the video asset and a movement of the user's eyeballs with respect to different regions of the display environment while the video asset is being displayed.

3. The client device as recited in claim 1 , wherein the advertisement content comprises secondary content multiplexed into the at least one video frame to replace a portion of the at least one video frame at the selectable location.

4. The client device as recited in claim 3 , wherein the selectable location is within the viewport, outside the viewport, or at least partially within the viewport.

5. The client device as recited in claim 3 , wherein the selectable location is within a region of the at least one video frame containing low activity.

6. The client device as recited in claim 3 , wherein the selectable location is selected further based on respective advertisement insertion availability timing data associated with a plurality of portions of the at least one video frame.

7. The client device as recited in claim 3 , wherein the secondary content comprises at least one of a still image, a text box, and a video clip.

8. The client device as recited in claim 3 , wherein the video asset and the advertisement content are each tile-encoded into respective pluralities of data having different video qualities.

9. The client device as recited in claim 8 , wherein the respective pluralities of data corresponding to the video asset and the advertisement content comprise respective sets of phase-encoded bitstreams.

10. The client device as recited in claim 8 , wherein the respective pluralities of data corresponding to the video asset and the advertisement content comprise respective sets of block-intra-encoded bitstreams.

11. A non-transitory machine-readable storage medium having program instructions thereon, which are configured to perform following acts when executed by a microprocessor of a client device operative to engage in a video session:
generating a request for playing a video asset in a display environment viewable by a user operating the client device, the video asset comprising a plurality of video frames;
providing gaze vector information relative to a video frame of the video asset presented in the display environment, the gaze vector information defining a gaze direction associated with a viewport in the display environment where the user is viewing at any particular time during the video session, wherein the video frame comprises a plurality of regions viewable by the user and at least a first region within the viewport has a first video quality and at least a second region outside the viewport has a second video quality;
receiving at least one video frame of the video asset, the at least one video frame including advertisement content at a selectable location in the at least one video frame depending at least in part on the gaze vector information; and
rendering the at least one video frame including the advertisement content for presentation to the user.

12. The non-transitory machine-readable storage medium as recited in claim 11 , wherein the gaze direction is determined by tracking at least one of an orientation of the user's headset associated with the client device for displaying the video asset and a movement of the user's eyeballs with respect to different regions of the display environment while the video asset is being displayed.

13. The non-transitory machine-readable storage medium as recited in claim 11 , wherein the advertisement content comprises secondary content multiplexed into the at least one video frame to replace a portion of the at least one video frame at the selectable location.

14. The non-transitory machine-readable storage medium as recited in claim 13 , wherein the selectable location is within the viewport, outside the viewport, or at least partially within the viewport.

15. The non-transitory machine-readable storage medium as recited in claim 13 , wherein the selectable location is within a region of the at least one video frame containing low activity.

16. The non-transitory machine-readable storage medium as recited in claim 13 , wherein the selectable location is selected further based on respective advertisement insertion availability timing data associated with a plurality of portions of the at least one video frame.

17. The non-transitory machine-readable storage medium as recited in claim 13 , wherein the secondary content comprises at least one of a still image, a text box, and a video clip.

18. The non-transitory machine-readable storage medium as recited in claim 13 , wherein the video asset and the advertisement content are each tile-encoded into respective pluralities of data having different video qualities.

19. The non-transitory machine-readable storage medium as recited in claim 18 , wherein the respective pluralities of data corresponding to the video asset and the advertisement content comprise respective sets of phase-encoded bitstreams.

20. The non-transitory machine-readable storage medium as recited in claim 18 , wherein the respective pluralities of data corresponding to the video asset and the advertisement content comprise respective sets of block-intra-encoded bitstreams.

21. A method operative at a client device configured to engage in a video session, the method comprising:
generating a request for playing a video asset in a display environment viewable by a user operating the client device, the video asset comprising a plurality of video frames;
providing gaze vector information relative to a video frame of the video asset presented in the display environment, the gaze vector information defining a gaze direction associated with a viewport in the display environment where the user is viewing at any particular time during the video session, wherein the video frame comprises a plurality of regions viewable by the user a

Assignees

• Ericsson Telefon Ab L M

Inventors

• Phillips Chris
• Forsman Robert Hammond
• Changrani Vishal

Classifications

• H04L67/131

  Protocols for games, networked simulations or virtual reality · CPC title

• H04N13/383

  for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes · CPC title

• H04N21/816

  involving special video data, e.g 3D video · CPC title

• H04N21/23424 Primary

  involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement · CPC title

• H04N13/332

  Displays for viewing with the aid of special glasses or head-mounted displays [HMD] · CPC title