Systems and methods for automatic mixing of media

Patent metadata

Field	Value
Publication number	US-9883284-B2
Application number	US-201414289438-A
Country	US
Kind code	B2
Filing date	May 28, 2014
Priority date	May 30, 2013
Publication date	Jan 30, 2018
Grant date	Jan 30, 2018

Abstract

Systems and methods for mixing music are disclosed. Audio mix information is received from a plurality of users. Mix rules are determined from the audio mix information from the plurality of users, wherein the mix rules include a first mix rule associated with a first audio item. The first mix rule relates to an overlap of the first audio item with another audio item. The first mix rule is made available to one or more clients. In some implementations, making the first mix rule available to the one or more clients includes transmitting, to the first client, information enabling the first client to playback a transition between the first audio item and the second audio item in accordance with the first mix rule.

First claim

What is claimed is:

1. A computer system, comprising:
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
receiving, via one or more networks, audio mix information for a first audio item from client devices for a plurality of users, wherein the audio mix information includes user-selected values for one or more playback parameters that were used by the plurality of users to generate transitions for the first audio item, wherein the transitions included overlap between the first audio item and other audio items, and wherein the user-selected values for the one or more playback parameters were specified by user inputs from the plurality of users;
determining a first mix rule using the user-selected values for the one or more playback parameters received from the client devices for the plurality of users, the first mix rule relating to determining overlap of the first audio item with audio items in respective transitions; and
making the first mix rule available via one or more networks to a plurality of client devices;
applying the first mix rule to generate transitions between the first audio item and other audio items for the plurality of client devices; and
transmitting the transitions generated by applying the first mix rule to respective client devices of the plurality of client devices to enable the respective client devices to play the transitions generated by applying the first mix rule.

2. The computer system of claim 1 , wherein the first mix rule specifies predefined values of the one or more playback parameters.

3. The computer system of claim 1 , the one or more programs further including instructions for:
receiving, from a first client device of the plurality of client devices, information indicating that the first audio item is to be mixed with a second audio item in accordance with the first mix rule;
wherein transmitting the transitions generated by applying the first mix rule to the respective client devices includes transmitting, to the first client device, information enabling the first client device to playback a transition between the first audio item and the second audio item in accordance with the first mix rule.

4. The computer system of claim 3 , wherein the second audio item is adjacent to the first audio item in a playlist associated with a user of the first client device.

5. The computer system of claim 4 , wherein the first audio item precedes the second audio item in the playlist.

6. The computer system of claim 4 , wherein the second audio item precedes the first audio item in the playlist.

7. The computer system of claim 3 , wherein the information indicating that the first audio item is to be mixed with the second audio item in accordance with the first mix rule specifies that an ending of the first audio item is to be mixed with a beginning of the second audio item.

8. The computer system of claim 3 , the one or more programs further including instructions for:
receiving, from a second client device of the plurality of client devices, information indicating that the first audio item is to be mixed with the second audio item in accordance with the first mix rule;
wherein-transmitting the transitions generated by applying the first mix rule to the respective client devices includes transmitting, to the second client device, information enabling the second client device to playback a transition between the first audio item and the second audio item in accordance with the first mix rule.

9. The computer system of claim 1 , wherein:
the first mix rule is a respective mix rule of a plurality of mix rules;
the first mix rule relates to determining an overlap of an ending of the first audio item with a beginning of a next audio item; and
the plurality of mix rules includes a second mix rule relating to determining an overlap of a beginning of the first audio item with an ending of a preceding audio item.

10. The computer system of claim 9 , the one or more programs further including instructions for:
receiving, from a first client device of the plurality of client devices, information indicating that the first audio item is to be mixed with a third audio item in accordance with the second mix rule, wherein the third audio item precedes the first audio item in a playlist associated with the first client device; and
transmitting, to the first client device, information enabling the first client device to playback a transition between the third audio item and the first audio item in accordance with the second mix rule.

11. The computer system of claim 1 , wherein the first mix rule is a respective mix rule of a plurality of mix rules that includes a second mix rule associated with a pair of audio items, the second mix rule relating to determining an overlap of the pair of audio items;
the one or more programs further including instructions for:
receiving, from a third client device of the plurality of client devices, information indicating that the pair of audio items are to be mixed in accordance with the second mix rule; and
transmitting, to the third client device, information enabling the third client device to playback a transition between the pair of audio items in accordance with the second mix rule.

12. The computer system of claim 1 , wherein the first mix rule includes an overlap starting position of the first audio item, indicating a playback time at which to begin overlapping the first audio item with a following audio item.

13. The computer system of claim 12 , wherein:
the user-selected values for the one or more playback parameters include overlap starting position values; and
the overlap starting position of the first audio item is a median of the overlap starting position values.

14. The computer system of claim 12 , wherein:
the user-selected values for the one or more playback parameters include overlap starting position values; and
the overlap starting position of the first audio item is a mean of the overlap starting position values.

15. The computer system of claim 1 , wherein the first mix rule includes an overlap ending position of the first audio item, indicating a playback time at which to end overlapping the first audio item with a preceding audio item.

16. The computer system of claim 1 , wherein the first mix rule specifies an effect to be applied to one or both of the first audio item and another audio item during the overlap of the first audio item and the other audio item.

17. The computer system of claim 1 , the one or more programs further including instructions for:
receiving, from a first client device of the plurality of client devices, information indicating that the first audio item is to be mixed with a second audio item in accordance with the first mix rule; and
wherein transmitting the transitions generated by applying the first mix rule to the respective client devices includes transmitting, to the first client device, an audio stream including a generated transition of the first audio item mixed with the second audio item in accordance with the first mix rule.

18. The computer system of claim 1 , wherein the first mix rule is a respective mix rule of a plurality of mix rules; and
the one or more programs further include instructions for organizing the plurality of mix rules into one or more mix styles.

19. The computer system of claim 18 , wherein respective ones of the mix styles include two or more of the mix rules

Assignees

• Spotify Ab

Inventors

• Bohrarper Par Mikael
• Garmark Sten
• Gustavsson Niklas Martin
• Noren John Fredrik Wilhelm
• Söderström Gustav
• Zafar Babar

Classifications

• H04N21/44016

  involving splicing one content stream with another content stream, e.g. for substituting a video clip · CPC title

• H04N21/4661

  Deriving a combined profile for a plurality of end-users of the same client, e.g. for family members within a home (user profiles in network data switching protocols H04L67/306) · CPC title

• G10H2220/116

  for graphical editing of sound parameters or waveforms, e.g. by graphical interactive control of timbre, partials or envelope · CPC title

• G10H2240/125

  Library distribution, i.e. distributing musical pieces from a central or master library · CPC title

• H04N21/26258

  for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list (retrieval of multimedia data based on playlists G06F16/40) · CPC title