Spatially unequal streaming

Patent metadata

Field	Value
Publication number	US-12563112-B2
Application number	US-202418747320-A
Country	US
Kind code	B2
Filing date	Jun 18, 2024
Priority date	Oct 12, 2016
Publication date	Feb 24, 2026
Grant date	Feb 24, 2026

Abstract

Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.

First claim

The invention claimed is:

1 . A non-transitory computer-readable storage medium storing instructions that, when executed by a processor of a video transmission system, cause the system to perform a method for transmitting an omni-directional or spherical video representing a spatial scene, the method comprising:
obtaining a video bitstream having the omni-directional or spherical video encoded thereinto using a cubic projection which maps the spatial scene onto a set of pictures; obtaining one or more Supplemental Enhancement Information (SEI) messages comprising:
metadata signaling a plurality of recommended viewport sections associated with the spatial scene, the recommended viewport sections being identified based on statistical analysis of user viewing behavior, and organized in a list ranked by frequency of user selection; and
metadata indicating a temporal duration for which the recommended viewport sections remain valid;
transmitting the video bitstream over a transmission medium to a remote decoder system; and transmitting the SEI messages within the video bitstream to the remote decoder system; wherein the SEI messages enable the remote decoder system to automate viewport control or implement prefetching strategies for the video based on spatial and temporal variation in the recommended viewport sections.

2 . The non-transitory digital storage medium of claim 1 , wherein the signalization indicates a size and a position of the multiple recommended viewport sections in a manner differentiating between different ways of controlling a movement of the multiple recommended viewport sections.

3 . The non-transitory digital storage medium of claim 2 , wherein the different ways differentiate between at least two of view section control by head movement, eye movement and tablet movement.

Assignees

• Fraunhofer Ges Forschung

Inventors

• Skupin Robert
• Hellge Cornelius
• Schierl Thomas
• Sánchez De La Fuente Yago
• Wiegand Thomas
• Podborski Dimitri

Classifications

• H04N13/161

  Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) · CPC title

• H04N13/194

  Transmission of image signals · CPC title

• H04N13/117 Primary

  the virtual viewpoint locations being selected by the viewers or determined by viewer tracking · CPC title

• H04N13/383

  for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes · CPC title

• H04L65/70

  Media network packetisation · CPC title