Quality optimization with buffer and horizon constraints in adaptive streaming

Patent metadata

Field	Value
Publication number	US-9386308-B2
Application number	US-201313943445-A
Country	US
Kind code	B2
Filing date	Jul 16, 2013
Priority date	Jul 16, 2013
Publication date	Jul 5, 2016
Grant date	Jul 5, 2016

Abstract

Techniques are provided for optimizing quality in adaptive streaming, where information is obtained relating to encoding bitrates and content quality scores for content segments of a content stream. The content segments of the content stream are provided by a content server and downloaded by a computing device. For each content segment, an encoding bitrate is determined for downloading the content segment from the content server, where determining the encoding bitrate for a current content segment is based upon an estimated current network bandwidth, constraints of a buffer into which downloaded content segments are stored, and also upon quality scores associated with content segments within a selected horizon extending from the current content segment to a future content segment in the content stream at an endpoint of the horizon. Each content segment with the determined bitrate for the content segment is downloaded from the content server.

First claim

What is claimed is:

1. A method comprising:
obtaining information relating to encoding bitrates and content quality scores for content segments of a content stream, wherein the content segments of the content stream are provided by a content server and downloaded by a computing device;
for each content segment, determining an encoding bitrate for the content segment to be downloaded from the content server, wherein determining the encoding bitrate for a current content segment is based upon an estimated current network bandwidth, constraints of a buffer into which downloaded content segments are stored, and also upon quality scores associated with content segments within a selected horizon extending from the current content segment to a future content segment in the content stream at an endpoint of the horizon, and the determining the encoding bitrate for the current content segment further comprises:
applying a dynamic programming algorithm that utilizes buffer constraint information and quality scores associated with content segments within the selected horizon to determine an optimized quality score value for the current content segment; and
applying an online algorithm that iteratively calculates the encoding bitrates of segments within the selected horizon and determines the encoding bitrate associated with the optimized quality score value for the current content segment; and

downloading each content segment with the determined bitrate for the content segment from the content server.

2. The method of claim 1 , wherein the applying the dynamic programming algorithm comprises maximizing an average score for the quality scores associated with content segments within the selected horizon.

3. The method of claim 1 , wherein the applying the dynamic programming algorithm comprises maximizing a worst-case quality score for the quality scores associated with content segments within the selected horizon.

4. The method of claim 1 , wherein the applying the dynamic programming algorithm further comprises adjusting the optimized quality score value for the current content segment to a modified quality score value based upon a difference between the optimized quality score value of the current content segment and an optimized quality score value of a previous content segment.

5. The method of claim 1 , wherein the applying the dynamic programming algorithm further comprises adjusting the optimized quality score value for the current content segment by a power function, where the optimized quality score value for the current content segment is modified by a power b, with b≧1.

6. The method of claim 1 , wherein the buffer constraint information associated with a current content segment comprises a lower buffer bound value, an upper buffer bound value, a buffer size associated with a content segment that is previous to the current content segment, and a network bandwidth value associated with the computing device.

7. The method of claim 1 , wherein the information relating to content quality scores further comprises a plurality of encoding bitrates, a plurality of segment durations, and a plurality of content quality scores corresponding with the encoding bitrates for each content segment.

8. The method of claim 1 , wherein the information relating to encoding bitrates and content quality scores for content segments of the content stream is obtained from a manifest provided by the content server.

9. An apparatus comprising:
one or more memories comprising a quality optimization engine that includes one or more applications to optimize quality of content segments for a content stream downloaded from a content server and a buffer to store downloaded content segments of the content stream;
a communication interface device configured to enable communications over the network; and
a processor configured to execute and control operations of the quality optimization engine so as to:
obtain information relating to bitrates and content quality scores for content segments of the content stream, wherein the content segments of the content stream are provided by a content server for use by a computing device;
for each content segment, determine an encoding bitrate for the content segment to be downloaded from the content server, wherein determining the encoding bitrate for a current content segment is based upon an estimated current network bandwidth, constraints of a buffer into which downloaded content segments are stored, and also upon quality scores associated with content segments within a selected horizon extending from the current content segment to a future content segment in the content stream at an endpoint of the horizon, and the processor is further configured to determine the encoding bitrate for the current content segment by:
applying a dynamic programming algorithm that utilizes buffer constraint information and quality scores associated with content segments within the selected horizon to determine an optimized quality score value for the current content segment; and
applying an online algorithm that iteratively calculates the encoding bitrates of segments within the selected horizon and determines the encoding bitrate associated with the optimized quality score value for the current content segment; and

download each content segment with the determined bitrate for the content segment from the content server.

10. The apparatus of claim 9 , wherein the processor is configured to apply the dynamic programming algorithm by maximizing an average score for the quality scores associated with content segments within the selected horizon.

11. The apparatus of claim 9 , wherein the processor is configured to apply the dynamic programming algorithm by maximizing a worst-case quality score for the quality scores associated with content segments within the selected horizon.

12. The apparatus of claim 9 , wherein the buffer constraint information associated with a current content segment comprises a lower buffer bound value, an upper buffer bound value, a buffer size associated with a content segment that is previous the current content segment, and a network bandwidth value associated with the computing device.

13. The apparatus of claim 9 , wherein the information relating to content quality scores further comprises a plurality of encoding bitrates and a plurality of content quality scores corresponding with the encoding bitrates for each content segment.

14. The apparatus of claim 9 , wherein the processor is configured to obtain information relating to encoding bitrates and content quality scores for content segments of the content stream from a manifest provided by the content server.

15. One or more computer readable memory storage devices encoded with software comprising computer executable instructions and when the software is executed operable to:
obtain information relating to encoding bitrates and content quality scores for content segments of a content stream, wherein the content segments of the content stream are provided by a content server and downloaded by a computing device;
for each content segment, determine an encoding bitrate for the content segment to be downloaded from the content server, wherein determining the encoding bitrate for a current content segment is based upon an estimated current network bandwidth, constraints of a buffer into which downloaded content segments are stored, and also upon quality scores associated with content segments within a selected horizon extending from the current content segment to a future content segment in the content stream at an endpoint of the horizon, wherein the instr

Assignees

• Cisco Tech Inc

Inventors

• Li Zhi
• Begen Ali C
• Gahm Joshua B
• Osler Bruce P
• Oran David R

Classifications

• H04L65/80

  Responding to QoS · CPC title

• H04N19/152

  by measuring the fullness of the transmission buffer · CPC title

• H04N19/00193

  Electricity · mapped topic

• H04N19/189 Primary

  characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding · CPC title

• H04N19/00345 Primary

  Electricity · mapped topic