Interactive, expressive music accompaniment system

Patent metadata

Field	Value
Publication number	US-10032443-B2
Application number	US-201515324970-A
Country	US
Kind code	B2
Filing date	Jul 10, 2015
Priority date	Jul 10, 2014
Publication date	Jul 24, 2018
Grant date	Jul 24, 2018

Abstract

Systems and methods capable of providing adaptive and responsive accompaniment to music with fixed chord progressions, such as jazz and pop, are provided. A system can include one or more sound-capturing devices, a signal analyzer to analyze captured sound signals, and an electronic sound-producing component that produces electronic sounds as an accompaniment.

First claim

What is claimed is:

1. A system for accompanying music, comprising:
a sound-signal-capturing device;
a signal analyzer configured to analyze sound signals captured by the sound-signal-capturing device; and
an electronic sound-producing component that produces a rhythm section accompaniment,
wherein the system is configured such that the rhythm section accompaniment produced by the electronic sound-producing component is modified based on output of the signal analyzer;
wherein the signal analyzer is configured to measure parameters, of music performed by at least one human performer, from the captured sound signals, and
wherein the parameters include at least one of loudness, information rate, and roughness, and tension of the music;
wherein the system is configured to make a change, based on the measured parameter, at one or more strategic points in a chord progression of the rhythm section accompaniment produced by the electronic sound-producing component,
wherein the change includes at least one of: switching to double time if the information rate of the exceeds an upper threshold; switching to half time if the information rate is lower than a lower threshold: switching to normal time if the information rate returns to a level in between the upper threshold and the lower threshold; adapting the loudness of the rhythm section accompaniment instruments to the loudness and tension curve of the at least one performer; playing outside a predetermined chord structure if the system detects that the at least one performer is performing outside the predetermined chord structure; pausing instruments of the rhythm section accompaniment if the tension or loudness decreases by a predetermined amount and performing 4×4 between the captured music and an instrument of the rhythm section by analyzing a temporal structure of the tension, and
wherein the strategic points in the chord progression include at least one of: at the end of a chord structure; or at the end of a number of bars.

2. The system according to claim 1 , wherein the system is configured to produce a rhythm section accompaniment to accompany music having fixed or varied chord progressions.

3. The system according to claim 1 , wherein the sound-signal-capturing device is a microphone,
wherein the signal analyzer is a processor or a computing device, and
wherein the electronic sound-producing component is an electronic device having at least one speaker.

4. The system according to claim 1 , further comprising a music synthesizer to perform sonification on the rhythm section accompaniment produced by the electronic sound-producing component.

5. A method of providing musical accompaniment, comprising:
playing music within functional range of the sound-signal-capturing device of the system of claim 1 ; and
using the system to provide a rhythm section accompaniment to the played music.

6. The system according to claim 1 , wherein the system is configured to recognize a human voice counting in a song and start the rhythm section accompaniment in the right measure and tempo based on the counting of the human voice,
wherein the sound-signal-capturing device captures the counting of the human voice,
wherein the signal analyzer analyzes the captured counting, and
wherein the system further comprises:
a word recognition component to recognize the captured counting; and
a count-in algorithm that tags timing and identified digits of the captured counting and uses this combined information to predict, measure, starting point, and tempo for the rhythm section accompaniment based on predetermined count-in styles.

7. The system according to claim 6 , wherein the system further comprises either:
a) a first computer-readable medium having computer-executable instructions for performing the count-in algorithm, and a second computer-readable medium having the word recognition component stored thereon; or
b) a computer-readable medium having the word recognition component stored thereon, and also having computer-executable instructions for performing the count-in algorithm.

8. The system according to claim 6 , wherein the system uses an envelope follower and threshold detector to mark onset of the captured counting to count in the rhythm section accompaniment, and
wherein the system uses Boolean Algebra based on different count-in style templates to predict measure, starting point, and tempo for the rhythm section accompaniment.

9. A system for analyzing timing and semantic structure of a verbal count-in of a song, the system comprising:
a sound-signal-capturing device;
a signal analyzer configured to analyze sound signals of a human voice counting in a song captured by the sound-signal-capturing device;
a word recognition system; and
a count-in algorithm that tags timing and identified digits of the captured counting and uses this combined information to predict measure, starting point, and tempo for the song based on predetermined count-in styles.

10. The system according to claim 9 , wherein the system further comprises either:
a) a first computer-readable medium having computer-executable instructions for performing the count-in algorithm, and a second computer-readable medium having the word recognition component stored thereon; or
b) a computer-readable medium having the word recognition component stored thereon, and also having computer-executable instructions for performing the count-in algorithm.

11. The system according to claim 9 , wherein the system uses an envelope follower and threshold detector to mark onset of the captured counting to count in the song, and
wherein the system uses Boolean Algebra based on different count-in style templates to predict measure, starting point, and tempo for the song.

12. The system according to claim 9 , further comprising a plurality of sound-signal-capturing devices and an electronic sound-producing component that plays the song,
wherein each signal-capturing device is a microphone, and
wherein the electronic sound-producing component is an electronic device having at least one speaker.

13. A method of analyzing timing and semantic structure of a verbal count-in of a song, comprising:
counting in a song within functional range of the sound-signal-capturing device of the system of claim 9 ; and
using the system to analyze timing and semantic structure of the count-in of the song and then being playing the song.

14. A system for accompanying music, comprising:
a sound-signal-capturing device;
a signal analyzer configured to analyze sound signals captured by the sound-signal-capturing device; and
an electronic sound-producing component that produces a rhythm section accompaniment,
wherein the system is configured such that the rhythm section accompaniment produced by the electronic sound-producing component is modified based on output of the signal analyzer;
wherein the system is configured to make a change, based on a stochastic process, at one or more strategic points in a chord progression of the rhythm section accompaniment produced by the electronic sound-producing component,
wherein the change includes at least one of: switching to double time; switching to half time; switching to normal time; changing the loudness of the rhythm section accompaniment instruments; playing outside a predetermined chord structure: pausing instruments of the rhythm section accompaniment; and performing 4×4 between the captured music and an instrument of the rhythm section accompaniment,
wherein the stochastic process uses a random generator,
wherein, for a given event a threshold of likelihood is adjusted and, if an inte

Assignees

• Rensselaer Polytech Inst

Inventors

• Braasch Jonas
• Deshpande Nikhil
• Oliveros Pauline
• Bringsjord Selmer

Classifications

• G10H1/42 Primary

  comprising tone forming circuits · CPC title

• G10H2250/131

  Mathematical functions for musical analysis, processing, synthesis or composition · CPC title

• G10H2210/356

  Random process used to build a rhythm pattern · CPC title

• G10H2210/051

  for extraction or detection of onsets of musical sounds or notes, i.e. note attack timings · CPC title

• G10H2210/576

  Chord progression · CPC title