Quality of experience aware multimedia adaptive streaming

Patent metadata

Field	Value
Publication number	US-10117089-B2
Application number	US-201414768298-A
Country	US
Kind code	B2
Filing date	Mar 18, 2014
Priority date	Mar 29, 2013
Publication date	Oct 30, 2018
Grant date	Oct 30, 2018

Abstract

Technology to provide quality of experience aware multimedia streaming is disclosed. In an example, a server operable to provide hyper-text transfer protocol (HTTP) adaptive streaming, can include computer circuitry configured to: determine a bandwidth available to the server for transmitting HTTP adaptive streaming content to a plurality of clients; receive HTTP requests from the plurality of clients for representations offered by the server in a manifest file for the HTTP adaptive streaming; and calculate an availability of each representation that is offered in the manifest file for the server. The availability can be calculated, at least in part, based on the determined bandwidth. The availability of each representation can be communicated from the server to the plurality of clients.

First claim

The invention claimed is:

1. A server operable to provide hyper-text transfer protocol (HTTP) adaptive streaming, the server comprising:
memory; and a processor coupled to the memory, configured to:
determine a bandwidth available to the server for transmitting HTTP adaptive streaming content to a plurality of clients;
receive HTTP requests from the plurality of clients for representations offered by the server in a manifest file for the HTTP adaptive streaming stored in the memory;
calculate an availability of each representation that is offered in the manifest file for the server, wherein the availability is calculated, at least in part, based on the determined bandwidth; and
communicate the availability of each representation from the server to the plurality of clients as a maximum download rate to each of the plurality of clients, to configure each client to request the representations from the server having a bitrate less than the maximum download rate.

2. The server of claim 1 , wherein the processor coupled to the memory is further configured to communicate the availability of each representation as a representation access bit (RAB) for each representation in the manifest file.

3. The server of claim 2 , wherein the processor coupled to the memory is further configured to communicate the RAB for each representation as an available representation code (ARC), wherein the ARC is communicated in response to an HTTP request from a client for the representation.

4. The server of claim 2 , wherein the processor coupled to the memory is further configured to communicate the RAB for each representation as an available representation code (ARC), wherein the ARC is communicated via a separate radio channel than a radio channel used to communicate the HAS or in a custom HTTP header.

5. The server of claim 3 , wherein the ARC is communicated with a most significant bit corresponding to a representation with a lowest bitrate.

6. The server of claim 3 , wherein the ARC is communicated based on an agreement between the server and each client.

7. The server of claim 3 , wherein the ARC is embedded in the manifest file for each server to signal each available representation at that server, thereby allowing each server to store representations at different bitrates.

8. The server of claim 1 , wherein the processor coupled to the memory is further configured to:
receive quality of experience (QOE) information from each of the plurality of clients receiving HTTP adaptive streaming from the server; and
calculate the availability of each representation for each client based on the determined bandwidth and the QOE for each of the plurality of clients.

9. The server of claim 8 , wherein the processor coupled to the memory is further configured to:
enable all of the representations for each of the plurality of clients;
iteratively disable representations for selected clients based on the QOE received for each client, wherein representations are disabled for a client in the plurality of clients that will experience a lowest drop in QOE relative to other clients in the plurality of clients; and
continue the iterative disablement of representations until the available bandwidth is sufficient to transmit the HTTP adaptive streaming content to the plurality of clients with close qualities.

10. The server of claim 9 , wherein the processor coupled to the memory is further configured to:
calculate a credit score for each of the plurality of clients based, at least in part, on:
a number of rebuffering events for the received HTTP adaptive stream; and
a difference between each client's average quality and an average combined quality of the plurality of clients; and

perform the iterative disablement of representations in rounds, wherein when a client has credit points, the client is eliminated as a candidate for deactivation of a representation in a round and the client's credit score is reduced by a selected value.

11. The server of claim 9 , wherein the processor coupled to the memory is further configured to:
perform the iterative disablement of representations for a client in the plurality of clients that has a highest average quality of experience; and
continue to perform the iterative disablement of representations for each client with the highest average quality of experience until the available bandwidth is sufficient to transmit the HTTP adaptive streaming content to the plurality of clients.

12. The server of claim 9 , wherein the processor coupled to the memory is further configured to calculate the availability of each representation for each client based on the determined bandwidth and the QOE for each of the plurality of clients using a selected load balancing algorithm.

13. A mobile device operable to provide hyper-text transfer protocol (HTTP) adaptive streaming, the mobile device comprising:
memory; and a processor coupled to the memory configured to:
receive HTTP adaptive streaming content from a server;
determine a quality of experience (QOE) of the received HTTP adaptive streaming content;
transmit the QOE to the server;
receive an availability of a plurality of representations of the HTTP adaptive streaming content from the server, wherein the availability of the plurality of representations is based, at least in part, on the transmitted QOE; and
transmit an HTTP request to the server for at least one representation offered by the server as a maximum download rate to each of a plurality of clients, to configure each client to request the representations from the server having a bitrate less than the maximum download rate.

14. The mobile device of claim 13 , wherein the memory and processor are further configured to transmit the HTTP request to the server for the HTTP adaptive streaming content.

15. The mobile device of claim 14 , wherein the manifest file is a media presentation description for a dynamic adaptive streaming over HTTP (DASH) adaptation set.

16. The mobile device of claim 13 , wherein the memory and processor are further configured to receive the HTTP adaptive streaming content and the HTTP adaptive streaming content is formatted as a dynamic adaptive streaming over HTTP (DASH) format.

17. The mobile device of claim 13 , further configured to receive the availability of each representation of the HTTP adaptive streaming content as a representation access bit (RAB) for each representation.

18. The mobile device of claim 17 , wherein the ARC is received with a least significant bit corresponding to a representation with a highest bitrate and a most significant bit corresponding to a representation with a lowest bitrate.

19. The mobile device of claim 17 , wherein the ARC is received in a custom hyper-text transfer protocol (HTTP) header in an HTTP response packet for downloaded segments.

20. The mobile device of claim 17 , wherein the memory and processor are further configured to use the ARC in a bitrate adaptation algorithm when making subsequent HTTP requests for representations of the HTTP adaptive streaming content.

21. The server of claim 17 , wherein the memory and processor are further configured to receive the RAB for each representation as an available representation code (ARC), wherein the ARC is received in response to the transmitted HTTP request from the mobile device for the representation.

22. The mobile device of claim 13 , further configured to determine the QOE based, at least in part, on a number of rebuffering events that have

Assignees

• Intel Ip Corp

Inventors

• Rehan Mohamed
• Morsi Rana
• Oyman Ozgur

Classifications

• H04L5/0057

  Physical resource allocation for CQI · CPC title

• H04L47/803

  Application aware · CPC title

• H04L1/1864 Primary

  ARQ related signaling (H04L1/1607 takes precedence) · CPC title

• H04L5/0085

  when channel conditions change · CPC title

• H04W48/18

  Selecting a network or a communication service · CPC title