Dynamically adapted pitch correction based on audio input

Patent metadata

Field	Value
Publication number	US-9747918-B2
Application number	US-201514819854-A
Country	US
Kind code	B2
Filing date	Aug 6, 2015
Priority date	Dec 21, 2012
Publication date	Aug 29, 2017
Grant date	Aug 29, 2017

Abstract

Systems and methods for adjusting pitch of an audio signal include detecting input notes in the audio signal, mapping the input notes to corresponding output notes, each output note having an associated upper note boundary and lower note boundary, and modifying at least one of the upper note boundary and the lower note boundary of at least one output note in response to previously received input notes. Pitch of the input notes may be shifted to match an associated pitch of corresponding output notes. Delay of the pitch shifting process may be dynamically adjusted based on detected stability of the input notes.

First claim

What is claimed is:

1. A method for processing a vocal signal and a non-vocal signal, comprising:
detecting vocal input notes in the vocal signal;
determining that a pitch of a vocal input note is stable based on a detected vibrato;

mapping the vocal input notes to corresponding vocal output notes based on associated upper and lower note boundaries;
shifting pitch of the vocal input notes to a pitch associated with the corresponding vocal output notes; and
adjusting delay of pitch shifting based on whether the pitch of the vocal input note is stable.

2. The method of claim 1 wherein adjusting the delay of pitch shifting further comprises performing one of increasing the delay of pitch shifting in response to detecting a stable pitch of the vocal input note, and decreasing the delay of pitch shifting in response to detecting an unstable pitch of the vocal input note.

3. The method of claim 1 , further comprising:
generating a vocal input note likelihood of occurrence based on a number of occurrences of each detected vocal input note;
detecting non-vocal input notes in the non-vocal signal;
generating a non-vocal note likelihood of occurrence based on a number of occurrences of each detected non-vocal input note; and
combining the vocal note likelihood of occurrence and the non-vocal note likelihood of occurrence to generate a combined note likelihood of occurrence.

4. The method of claim 3 wherein the vocal note and non-vocal note likelihoods of occurrence are represented by respective note histograms.

5. The method of claim 3 wherein adjusting the delay of pitch shifting comprises resetting the delay of pitch shifting to a minimum value in response to detecting that the vocal signal is independent of a voice input.

6. The method of claim 1 further comprising:
receiving an input designating a key/scale, wherein adjusting the upper and lower note boundaries includes adjusting the upper and lower note boundaries based on the key/scale.

7. A system for adjusting pitch of an audio signal, comprising:
a first input configured to receive a first signal;
a second input configured to receive a second signal;
an output configured to provide a pitch-adjusted first signal; and
a processor in communication with the first and second inputs and the output, the processor detecting input first notes in the first signal and input second notes in the second signal, generating a second note likelihood of occurrence based on number of occurrences of each detected second input note, mapping the input first notes to output first notes, each output first note having an associated upper note boundary and lower note boundary, modifying at least one of the upper note boundary and the lower note boundary of at least one output note in response to a combined note likelihood of occurrence including the combination of a first note likelihood of occurrence and the second note likelihood of occurrence, shifting pitch of the first signal to substantially match an output note pitch of the corresponding output first note, and generating a signal on the output corresponding to the shifted pitch first signal.

8. The system of claim 7 wherein the processor is further configured to dynamically modify a delay for shifting the pitch in response to stability of an input first note.

9. The system of claim 7 wherein the processor is configured to modify at least one of the upper note boundary and the lower note boundary in response to a designated key/scale.

10. The system of claim 9 wherein the designated key/scale is detected based on the input second notes.

11. The system of claim 9 wherein the designated key/scale is received via a user interface in communication with the processor.

12. A method for adjusting pitch of an audio signal, comprising:
detecting input notes in the audio signal;
mapping the input notes to corresponding output notes, each output note having an associated upper note boundary and lower note boundary;
shifting pitch of the input notes to match an associated pitch of corresponding output notes;
dynamically adjusting delay associated with shifting the pitch of the input notes in response to a detected stability of the input notes, wherein dynamically adjusting the delay comprises decreasing a delay of pitch shifting in response to detecting an unstable pitch.

13. The method of claim 12 wherein dynamically adjusting the delay comprises increasing the delay when a stable input note is detected.

14. The method of claim 13 wherein dynamically adjusting the delay comprises increasing the delay when an input note having vibrato is detected.

15. The method of claim 12 wherein the audio signal includes a vocal signal and a non-vocal signal, and wherein detecting the input notes includes detecting vocal input notes and non-vocal input notes, the method further comprising:
modifying at least one of the upper note boundaries and the lower note boundaries for the output notes based on a number of occurrences of the vocal input notes and the non-vocal input notes.

16. The method of claim 12 further comprising:
detecting a key/scale in response to the input notes in the audio signal, wherein modifying at least one of the upper and lower note boundaries comprises modifying at least one of the upper note boundary and lower note boundary in response to the key/scale.

Assignees

• Harman Int Ind
• Harman Int Ind

Inventors

• Lupini Peter R
• Rutledge Glen A
• Campbell Norm

Classifications

• G10H2210/021

  Background music, e.g. for video sequences or elevator music · CPC title

• G10L25/90

  Pitch determination of speech signals · CPC title

• G10H2210/331

  Note pitch correction, i.e. modifying a note pitch or replacing it by the closest one in a given scale · CPC title

• G10L2025/906

  Pitch tracking · CPC title

• G10H1/383

  Chord detection and/or recognition, e.g. for correction, or automatic bass generation · CPC title