Bitrate control in virtual reality (VR) environments using time-shifting and unicast delivery

Patent metadata

Field	Value
Publication number	US-10516908-B2
Application number	US-201715694180-A
Country	US
Kind code	B2
Filing date	Sep 1, 2017
Priority date	Sep 8, 2016
Publication date	Dec 24, 2019
Grant date	Dec 24, 2019

Abstract

A system and method for providing bitrate control for delivering media content to a plurality of virtual display (VD) screens presented in a virtual reality (VR) environment effectuated by a VR device of a subscriber based on detecting a movement in a point of view with respect the VD screens' placement within the VR environment, wherein each VD screen is configured to receive a media content channel. Responsive to detecting the movement, angular distance of each of the VD screens relative to a reference axis is computed. Weights to each of the media content channels may be assigned or updated based on the angular distance of the corresponding VD screens relative to the reference axis. Media content channels on the VD screens outside the subscriber's field of view may be time-shifted. Bandwidth of a managed bandwidth pipe may be (re)allocated based on the relative weights of the non-time-shifted media content channels for delivering the media content channels to the subscriber's VR environment responsive to selecting single bitrates for the media channels according to a channel bandwidth annealing mechanism.

First claim

The invention claimed is:

1. A method for facilitating delivery of a plurality of media content channels to a corresponding plurality of virtual display (VD) screens presented in a virtual reality (VR) environment effectuated by a VR device of a subscriber, the method comprising:
detecting a movement in a point of view of the subscriber in relation to a first reference axis with respect the VD screens' placement within the VR environment, the VR environment containing the plurality of VD screens, said movement resulting in a second reference axis within the VR environment, wherein each VD screen is configured to receive a respective media content channel as an adaptive bitrate (ABR) segment stream of a corresponding content program;
computing angular distance of each of the VD screens relative to the second reference axis;
determining that one or more VD screens are outside a field of view of the subscriber;
assigning weights to each of the media content channels based on the angular distance of the corresponding VD screens that are within the subscriber's field of view relative to the second reference axis;
assigning a null weight to each of the media content channels showing on the VD screens that are outside the subscriber's field of view;
indicating that the media content channels on the VD screens outside the subscriber's field of view are to be time-shifted as TS media content channels;
providing the assigned weights of the media content channels, including the null weights assigned to the TS media content channels, to a gateway node operating to serve a subscriber premises via a managed bandwidth pipe; and
receiving from the gateway node a manifest indicating single bitrate representations of each of the non-time-shifted media content channel segments, the respective single bitrate representations selected based on a channel bandwidth annealing mechanism using the assigned weights provided by the subscriber's VR device.

2. The method as recited in claim 1 , wherein the movement is detected by the subscriber's VR device responsive to the subscriber's head movement or ocular movement.

3. The method as recited in claim 1 , wherein the angular distance computed for each of the VD screens comprises at least one of an angular deviation along a horizontal plane, along a vertical plane, or both planes, the horizontal and vertical planes defined in the VR environment relative to the second reference axis.

4. The method as recited in claim 1 , wherein the angular distance is computed in at least one of radians, degrees, or both.

5. The method as recited in claim 1 , further comprising:
detecting that the subscriber has changed her point of view to a new field of view within the subscriber's VR environment;
responsive to the detecting that the subscriber has changed her point of view to a new field of view within the subscriber's VR environment, determining that one or more VD screens that were outside the subscriber's field of view previously are now within the new field of view and that one or more VD screens that were previously inside the subscriber's field of view are now outside the new field of view;
responsive to the determining, further updating weights to the media content channels on the VD screens within the new field of view, including assigning non-null weights to the previously time-shifted media content channels and assigning null weights to the media content channels on the VD screens that were previously inside the subscriber's field of view are now outside the new field of view; and
providing the further updated weights of the media content channels, including the null weights assigned to the TS media content channels, to the gateway node for allocating or reallocating the bandwidth of the managed bandwidth pipe serving the subscriber's premises.

6. The method as recited in claim 1 , wherein at least a portion of the plurality of VD screens are presented along a real world object in an augmented reality (AR) application.

7. A virtual reality (VR) apparatus, comprising:
a hardware platform including one or more processors for executing a media content application;
a head-mounted display (HMD) device operative with the hardware platform to effectuate a VR environment that includes a plurality of virtual display (VD) screens operative to display a corresponding plurality of media content channels respectively; and
one or more persistent memory modules having program instructions stored thereon which, when executed by the one or more processors, perform the following in association with the media content application;
detect a movement in a point of view of the subscriber in relation to a first reference axis with respect the VD screens' placement within the VR environment, the VR environment containing the plurality of VD screens, said movement resulting in a second reference axis within the VR environment, wherein each VD screen is configured to receive a respective media content channel as an adaptive bitrate (ABR) segment stream of a corresponding content program;
compute angular distance of each of the VD screens relative to the second reference axis;
determine that one or more VD screens are outside a field of view of the sub scriber;
assign weights to each of the media content channels based on the angular distance of the corresponding VD screens that are within the subscriber's field of view relative to the second reference axis;
assign a null weight to each of the media content channels showing on the VD screens that are outside the subscriber's field of view;
select one or more of the media content channels on the VD screens outside the subscriber's field of view to be time-shifted as TS media content channels;
provide the assigned weights of the media content channels, including the null weights assigned to the TS media content channels, to a gateway node operating to serve a subscriber premises via a managed bandwidth pipe; and
receive from the gateway node a manifest indicating single bitrate representations of each of the non-time-shifted media content channel segments stored in a segment cache of the gateway node, the respective single bitrate representations selected based on a channel bandwidth annealing mechanism using the assigned weights provided by the subscriber's VR device.

8. The VR apparatus as recited in claim 7 , wherein the movement is detected by the user's VR device responsive to the user's head movement or ocular movement.

9. The VR apparatus as recited in claim 7 , wherein the angular distance is computed along a horizontal plane in at least one of radians, degrees, or both.

10. The VR apparatus as recited in claim 7 , wherein the angular distance is computed along a vertical plane in at least one of radians, degrees, or both.

11. The VR apparatus as recited in claim 7 , wherein the VD screens comprise one or more virtualized TV screens, virtualized gaming monitors, virtualized tablets, virtualized phablets, virtualized computer monitors, and virtualized projector screens.

12. The VR apparatus as recited in claim 7 , wherein the HMD device is operative to effectuate an immersive VR environment in which the user can move her point of view in full 360° in one of a vertical plane, a horizontal plane, or both planes, defined in the VR environment.

13. The VR apparatus as recited in claim 7 , wherein the HMD device is operative to effectuate an immersive VR environment in which the user can move her point of view less than 360° in one of a vertical plane, a horizontal plane, or both planes, defined in the VR environment.

14. The VR apparatus as recited in claim 7 , wherein the hardw

Assignees

• Ericsson Telefon Ab L M

Inventors

• Phillips Chris
• Forsman Robert Hammond
• Reynolds Jennifer Ann
• Dasher Charles Hammett

Classifications

• H04N21/4728

  for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region · CPC title

• H04N21/6118

  involving cable transmission, e.g. using a cable modem · CPC title

• H04N21/6405

  Multicasting {(data broadcast and multicast in packet switching networks H04L12/18)} · CPC title

• H04N21/43615

  Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals (home Audio Video Interoperability [HAVI] data switching networks H04L12/2805) · CPC title

• H04N21/44218

  Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45) · CPC title