Systems and methods for implementing cross-fading, interstitials and other effects downstream

Patent metadata

Field	Value
Publication number	US-10152984-B2
Application number	US-201715714095-A
Country	US
Kind code	B2
Filing date	Sep 25, 2017
Priority date	Nov 18, 2011
Publication date	Dec 11, 2018
Grant date	Dec 11, 2018

Abstract

Systems and methods are presented for cross-fading (or other multiple clip processing) of information streams on a user or client device, such as a telephone, tablet, computer or MP3 player, or any consumer device with audio playback. Multiple clip processing can be accomplished at a client end according to directions sent from a service provider that specify a combination of (i) the clips involved; (ii) the device on which the cross-fade or other processing is to occur and its parameters; and (iii) the service provider system. For example, a consumer device with only one decoder, can utilize that decoder (typically hardware) to decompress one or more elements that are involved in a cross-fade at faster than real time, thus pre-fetching the next element(s) to be played in the cross-fade at the end of the currently being played element. The next elements(s) can, for example, be stored in an input buffer, then decoded and stored in a decoded sample buffer, all prior to the required presentation time of the multiple element effect. At the requisite time, a client device component can access the respective samples of the decoded audio clips as it performs the cross-fade, mix or other effect. Such exemplary embodiments use a single decoder and thus do not require synchronized simultaneous decodes.

First claim

What is claimed:

1. An audio playback device, comprising:
an input buffer for storing audio clips;
a decoder connected to the input buffer and configured to decode the audio clips stored in the input buffer;
a decoded audio buffer connected to the decoder and configured to store the audio clips decoded by the decoder;
a playout controller configured to:
download the audio clips to be stored by the input buffer; and
play back the decoded audio clips stored in the decoded audio buffer with at least one fade or transition effect at a boundary between successive audio clips; and

a device performance agent configured to:
determine network conditions and performance of hardware of the audio playback device; and
adjust timing of audio clip downloads by the playout controller based on the determined network conditions and the hardware performance.

2. The audio playback device as claimed in claim 1 , wherein the device performance agent is further configured to cause the playout controller to play back the decoded audio clips with the at least one fade or transition effect based on a device profile.

3. The audio playback device as claimed in claim 2 , wherein the device profile includes information regarding a type of the audio playback device.

4. The audio playback device as claimed in claim 2 , wherein the device profile includes information regarding a number of decoders included in the audio playback device.

5. The audio playback device as claimed in claim 2 , wherein the device profile includes information regarding a time required for the decoder to decode an audio frame.

6. The audio playback device as claimed in claim 1 , wherein the device performance agent is further configured to cause the playout controller to play back the decoded audio clips with the at least one fade or transition effect based on a user profile.

7. The audio playback device as claimed in claim 1 , wherein the device performance agent is further configured to cause the playout controller to play back the decoded audio clips with the at least one fade or transition effect based on a channel profile.

8. The audio playback device as claimed in claim 1 , wherein the device performance agent is further configured to cause the playout controller to play back the decoded audio clips with the at least one fade or transition effect based on a genre profile.

9. The audio playback device as claimed in claim 1 , wherein the device performance agent is further configured to adjust the timing of audio clip downloads by the playout controller based on a bandwidth restriction.

10. The audio playback device as claimed in claim 1 , wherein the device performance agent is further configured to adjust the timing of audio clip downloads by the playout controller based on a latency condition.

11. A method comprising:
playing back, by a playout controller of an audio playback device, a first audio clip;
during the playing back the first audio clip:
determining, by a device management agent of the audio playback device, network conditions and a performance of hardware of the audio playback device;
determining, by the device management agent, a start time for downloading a second audio clip based on the determined network conditions and the hardware performance, such that the second audio clip can be downloaded in time for at least one fade or transition effect to be performed on the first audio clip and the second audio clip;
downloading the second audio clip at the determined start time; and

playing back, by the playout controller, an outro portion of the first audio clip and an intro portion of the second audio clip with the at least one fade or transition effect.

12. The method as claimed in claim 11 , wherein the playing back the outro portion of the first audio clip and the intro portion of the second audio clip with the at least one fade or transition effect is performed based on a device profile.

13. The method as claimed in claim 12 , wherein the device profile includes information regarding a type of the audio playback device.

14. The method as claimed in claim 12 , wherein the device profile includes information regarding a number of decoders included in the audio playback device.

15. The method as claim in claim 12 , wherein the device profile includes information regarding a time required for a decoder of the audio playback device to decode an audio frame.

16. The method as claimed in claim 11 , wherein the playing back the outro portion of the first audio clip and the intro portion of the second audio clip with the at least one fade or transition effect is performed based on a user profile.

17. The method as claimed in claim 11 , wherein the playing back the outro portion of the first audio clip and the intro portion of the second audio clip with the at least one fade or transition effect is performed based on a channel profile.

18. The method as claimed in claim 11 , wherein the playing back the outro portion of the first audio clip and the intro portion of the second audio clip with the at least one fade or transition effect is performed based on a genre profile.

19. The method as claimed in claim 11 , wherein the determining the start time for downloading the second audio clip is based on a bandwidth restriction.

20. The method as claimed in claim 11 , wherein the determining the start time for downloading the second audio clip is based on a latency condition.

Assignees

• Sirius Xm Radio Inc

Inventors

• Lowe Raymond
• Ward Christopher
• Christine Charles W

Classifications

• H04H60/04

  Studio equipment; Interconnection of studios · CPC title

• G10L19/008

  Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing · CPC title

• G10L19/26

  Pre-filtering or post-filtering · CPC title

• G06F9/5044

  considering hardware capabilities · CPC title

• G11B27/038

  Cross-faders therefor · CPC title