Systems and methods for implementing cross-fading, interstitials and other effects downstream

Patent metadata

Field	Value
Publication number	US-9406303-B2
Application number	US-201214358919-A
Country	US
Kind code	B2
Filing date	Nov 19, 2012
Priority date	Nov 18, 2011
Publication date	Aug 2, 2016
Grant date	Aug 2, 2016

Abstract

Systems and methods are presented for cross-fading (or other multiple clip processing) of information streams on a user or client device, such as a telephone, tablet, computer or MP3 player, or any consumer device with audio playback. Multiple clip processing can be accomplished at a client end according to directions sent from a service provider that specify a combination of (i) the clips involved; (ii) the device on which the cross-fade or other processing is to occur and its parameters; and (iii) the service provider system. For example, a consumer device with only one decoder, can utilize that decoder (typically hardware) to decompress one or more elements that are involved in a cross-fade at faster than real time, thus pre-fetching the next element(s) to be played in the cross-fade at the end of the currently being played element. The next elements(s) can, for example, be stored in an input buffer, then decoded and stored in a decoded sample buffer, all prior to the required presentation time of the multiple element effect. At the requisite time, a client device component can access the respective samples of the decoded audio clips as it performs the cross-fade, mix or other effect. Such exemplary embodiments use a single decoder and thus do not require synchronized simultaneous decodes.

First claim

What is claimed is:

1. A method of directing inter-element effects on a client device, comprising:
receiving device data and user data from the device at a server;
generating instructions on the server for an inter-element effect between at least two audio clips, said instructions being a function of the device data, user data, intro data and outro data for the at least two audio clips; and
sending instructions to the device from the server detailing which clips to decode and when to decode them to perform the inter-element effects.

2. The method of claim 1 , further comprising:
receiving at the server at least one of network conditions, bandwidth restrictions and latency issues regarding the communications link between the server and the client device, and
generating said instructions as a function of the device data, user data, intro data and outro data for the at least two audio clips, and said at least one of said network conditions, bandwidth restrictions and latency issues.

3. The method of claim 1 , further comprising leveraging user profile data stored in a user profile database and playlist profile data when generating said instructions for said inter-element effect.

4. The method of claim 3 , wherein said instructions are further based on user preferences.

5. The method of claim 4 , wherein said user preferences are determined at one or more of the server and the client device by capturing and processing user interaction data.

6. The method of claim 1 , wherein said instructions are tailored to a given personalized channel used by a given user, on a given device.

7. The method of claim 6 , wherein said instructions include which of the audio clips is to be sent in compressed format and which in uncompressed format.

8. The method of claim 7 , wherein the decision to send one or more audio clips in uncompressed format is a function of one or more of available resources on the client device, decoder speed on the client device, network conditions, bandwidth restrictions and latency issues.

9. A system for delivering digital media to a client, comprising:
a service provider;
at least one communications channel; and
at least one client device,
wherein the service provider maintains device profile data, user preference data and clip data with respect to cross-fades and multi-element transitions, and
wherein the service provider supports messaging interactions so as to enable an enhanced user experience at the client device, said enhanced user experience including multiple clip cross-fades or other effects/transitions between successive audio clips.

10. The system of claim 9 , wherein the service provider has a software agent running on a server, said software agent including a content playlist database, a device profile database, a user profile database, a content scheduler and a client device management module.

11. The system of claim 10 , wherein said client device includes a software agent running on said client device, said software agent configured to characterize the performance of the hardware and network conditions in said communications channel, so as to adjust the download timing and characteristics of said cross-fades or other effects/transitions based on said client device profile and user preferences and profiles.

12. The system of claim 9 , wherein the service provider dynamically determines whether to control a cross-fade or multi-element transition on the server side or to pass control to the client device based on client device parameters.

13. The system of claim 12 , wherein said client device parameters include at least one of nominal processing power, nominal input buffer size, effective processing power, dynamic input buffer size, and number of hardware decoders.

14. The system of claim 9 , wherein at least one of:
(i) the service provider dynamically determines whether to, when to, and to what extent to, download future programming elements to the client device based on client device and network parameters, and
(ii) the service provider dynamically determines whether to, when to, and to what extent to, download future programming elements to the client device based on client device and network parameters, and said client device and network parameters include at least one of nominal processing power, nominal input buffer size, effective processing power, dynamic input buffer size, computed time available based on upcoming events and connection rate/compressed bit rate.

15. The system of claim 14 , further comprising using said client device and network parameters to dynamically decide the type and complexity of a cross-fade or other multiple clip process to be implemented on said client device.

16. The system of claim 15 , wherein outcomes of the decision process include at least one of:
use multi-layered cross fades;
use single layer cross-fades; and
no cross fades.

17. The system of claim 14 , wherein outcomes of the decision process include at least one of:
download all audio clips on the current recommendation list, and all programming elements, and preprocess content well ahead of time;
download next audio clips and a single cross-fade transition element and preprocess content well ahead of time; and
download only audio clips, but omit all interstitials and programming elements, and decode content just-in-time.

Assignees

• Sirius Xm Radio Inc

Inventors

• Lowe Raymond
• Ward Christopher
• Christine Charles W

Classifications

• G06F9/5044

  considering hardware capabilities · CPC title

• G10L19/008 Primary

  Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing · CPC title

• H04H60/04

  Studio equipment; Interconnection of studios · CPC title

• G11B27/038

  Cross-faders therefor · CPC title

• G10L19/167 Primary

  Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes · CPC title