Catching up to the live playhead in live streaming

Patent metadata

Field	Value
Publication number	US-10530825-B2
Application number	US-201615170164-A
Country	US
Kind code	B2
Filing date	Jun 1, 2016
Priority date	Jun 1, 2016
Publication date	Jan 7, 2020
Grant date	Jan 7, 2020

Abstract

Techniques are described for reducing the delay between the live playhead of live streaming content and the client playhead of a client device consuming the live stream. In one technique, an increased playback speed is used by the media player on the client device so that the delay is gradually reduced. In another technique, the media player jumps forward in the stream, skipping content identified as expendable.

First claim

What is claimed is:

1. A computer program product, comprising one or more non-transitory computer-readable media having computer program instructions stored therein, the computer program instructions being configured such that, when executed by one or more computing devices, the computer program instructions cause the one or more computing devices to:
acquire a stream of live video content for playback on a client device;
determine that a delay between a live playhead of the live video content and a client playhead associated with the playback of the live video content on the client device by a media player on the client device operating at a first number of frames per second exceeds a threshold;
increase a playback speed of the live video content on the client device without skipping frames of the live video content by configuring the media player to render the live content at a second number of frames per second, thereby reducing the delay, wherein the increase in the number of frames per second is less than approximately 15% and is achieved without modifying encoding of the live video content, and wherein the increase in the number of frames per second reduces the delay between the live playhead and the client playhead;
identify one or more expendable portions of the live video content;
skip playback of at least one of the one or more expendable portions of the live video content, thereby reducing the delay;
determine that the delay is below the threshold; and
decrease the playback speed of the live video content by the media player on the client device to the first number of frames per second.

2. The computer program product of claim 1 , wherein the one or more processors are configured to identify the one or more expendable portions of the live video content (1) using first content metadata associated with the live video content by a content provider in conjunction with generation of the live video content, (2) using second content metadata associated with the live video content by a human operator after generation of the live video content, or (3) by analyzing the live video content substantially in real time.

3. The computer program product of claim 1 , wherein the one or more processors are further configured to determine the delay between the live playhead and the client playhead by determining a cumulative time for recovering from rebuffering events occurring on the client device.

4. A client device, comprising:
memory;
an output device; and
one or more processors configured, in conjunction with the memory, to:
acquire a stream of content for playback on the output device;
determine that a delay between a live playhead of the content and a client playhead associated with the playback of the content exceeds a first threshold, the live playhead representing a latest content fragment of the content available; and
increase a playback speed of the content without skipping frames of the content by modifying operation of a media player on the client device to increase a number of frames per second of the content rendered by the media player and displayed on the output device, wherein the increase in the number of frames per second is less than approximately 15% and is achieved without modifying encoding of the content, and wherein the increase in the number of frames per second reduces the delay between the live playhead and the client playhead.

5. The client device of claim 4 , wherein the one or more processors are further configured to:
determine that the delay is below a second threshold, the second threshold being lower than the first threshold; and
decrease the playback speed of the content.

6. The client device of claim 4 , wherein the one or more processors are further configured to:
determine that the delay exceeds a second threshold, the second threshold being higher than the first threshold; and
further increase the playback speed of the content.

7. The client device of claim 4 , wherein the one or more processors are further configured to:
identify one or more expendable portions of the content; and
skip playback of at least one of the one or more expendable portions of the content.

8. The client device of claim 7 , wherein the one or more processors are further configured to determine that the delay exceeds a second threshold, the second threshold being different from the first threshold, and wherein the one or more processors are configured to skip playback of at least one of the one or more expendable portions of the content in response to determining that the delay exceeds the second threshold.

9. The client device of claim 4 , wherein the one or more processors are further configured to determine that there is sufficient available bandwidth for increasing the playback speed of the content.

10. The client device of claim 4 , wherein the one or more processors are further configured to:
determine that available bandwidth or a playback quality of the content has dropped below a corresponding threshold; and
decrease the playback speed of the content.

11. The client device of claim 4 , wherein the one or more processors are further configured to determine the delay based on a cumulative time for recovering from one or more rebuffering events.

12. A computer-implemented, comprising:
acquiring a stream of content for playback;
determining that a delay between a live playhead of the content and a client playhead associated with the playback of the content exceeds a delay threshold, the live playhead representing a latest content fragment of the content available; and
increasing a playback speed of the content without skipping frames of the content by modifying operation of a media player on a client device to increase a number of frames per second of the content rendered by the media player and displayed on an output device of the client device, wherein the increase in the number of frames per second is less than approximately 15% and is achieved without modifying encoding of the content, and wherein the increase in the number of frames per second reduces the delay between the live playhead and the client playhead.

13. The method of claim 12 , further comprising:
determining that the delay is below a second threshold, the second threshold being lower than the first threshold; and
decreasing the playback speed of the content.

14. The method of claim 12 , further comprising:
determining that the delay exceeds a second threshold, the second threshold being higher than the first threshold; and
further increasing the playback speed of the content.

15. The method of claim 12 , further comprising:
identifying one or more expendable portions of the content; and
skipping playback of at least one of the one or more expendable portions of the content.

16. The method of claim 15 , further comprising determining that the delay exceeds a second threshold, the second threshold being different from the first threshold, and wherein skipping playback of at least one of the one or more expendable portions of the content occurs in response to determining that the delay exceeds the second threshold.

17. The method of claim 12 , further comprising determining that there is sufficient available bandwidth for increasing the playback speed of the content.

18. The method of claim 12 , further comprising:
determining that available bandwidth or a playback quality of the content has dropped below a corresponding threshold; and
decreasing the playback speed of the content.

19. The method of claim 12 , further

Assignees

• Amazon Tech Inc

Inventors

• Mcleod Euan
• Joliveau Marc
• Richter Stefan Christian

Classifications

• H04L65/80 Primary

  Responding to QoS · CPC title

• H04L65/604 Primary

  Electricity · mapped topic

• H04L65/764 Primary

  at the destination  (reformatting of additional data in video clients H04N21/4355) · CPC title

• H04L65/612

  for unicast · CPC title