Visually-assisted mixing of audio using a spectral analyzer

Patent metadata

Field	Value
Publication number	US-9530396-B2
Application number	US-201414219155-A
Country	US
Kind code	B2
Filing date	Mar 19, 2014
Priority date	Jan 15, 2010
Publication date	Dec 27, 2016
Grant date	Dec 27, 2016

Abstract

Processor-implemented methods and systems for visually-assisted mixing of audio using a spectral analyzer are disclosed. The system calculates and displays a spectral view for each track in an arrangement in a multi-track view. A user can then request modification of the spectral view. In response to this request for modification, the system automatically adjusts associated mixing parameters for the modified track so that the spectral output of the track substantially matches the user-requested modified spectral view. This allows a user to visually mix an arrangement by imputing a desired spectral result and having the program make the changes necessary to achieve it.

First claim

I claim:

1. A method for visually-assisted mixing of audio using a spectral analyzer, the method comprising, in a processor:
receiving a first audio stream from a first audio track that has associated equalization parameters;
calculating and displaying, on a graphical user interface shown on a device display, a first spectral view of the first audio stream;
receiving, through an input/output device, a user input for modifying the first spectral view, wherein the user input includes an interaction with a displayed portion of the first spectral view;
in response to the user input:
calculating a modified spectral view of the first audio stream, and
automatically adjusting one or more equalization parameters associated with the first audio track such that the first spectral view and the modified spectral view substantially match; and

displaying the modified spectral view with the adjusted equalization parameters on the graphical user interface.

2. The method of claim 1 , further comprising:
receiving a second audio stream from a second audio track that has associated equalization parameters; and
calculating and displaying a second spectral view of the second audio stream on the graphical user interface.

3. The method of claim 2 , further comprising:
analyzing the modified spectral view of the first audio stream and the second spectral view of the second audio stream;
based on the analyzing, identifying one or more mix problems associated with the modified spectral view and the second spectral view; and
adjusting parameters associated with at least one of the first audio track or the second audio track to resolve the identified mix problems.

4. The method of claim 3 , wherein the mix problems include one of: excessive spectral overlapping between the first and second audio tracks, or unwanted steady resonances.

5. The method of claim 1 , wherein displaying the first spectral view or the modified spectral view comprises:
smoothing the first spectral view or the modified spectral view using an enveloping technique in which relevant characteristics of the respective spectral view is preserved.

6. The method of claim 1 , wherein automatically adjusting at least one of the equalization parameters includes increasing gain of a peak in the first spectral view by activating an equalization band with a center frequency equal to the peak and increasing the gain of the equalization band.

7. The method of claim 6 , further comprising:
examining equalization bands associated with previous user actions; and
in response to the examining, identifying the equalization band with the center frequency equal to the peak from the equalization bands associated with previous user actions.

8. The method of claim 1 , wherein automatically adjusting at least one of the equalization parameters includes adjusting center frequency of a peak in the first spectral view by activating an equalization band with the center frequency and a negative gain and activating an equalization band with a new center frequency and a positive gain.

9. The method of claim 8 , further comprising:
examining equalization bands associated with previous user actions; and
in response to the examining, identifying at least one of the equalization band with the center frequency and the negative gain, or the equalization band with the new center frequency and the positive gain, from the equalization bands associated with previous user actions.

10. The method of claim 1 , wherein automatically adjusting at least one of the equalization parameters includes adjusting a q-factor by activating a suitable equalization band with a corresponding q-value and gain, thereby changing the q-factor.

11. The method of claim 1 , wherein displaying the first spectral view corresponding to the first audio stream further comprises:
suggesting to the user one or more adjustments to equalization parameters associated with the first audio track based on the first spectral view displayed on the graphical user interface.

12. The method of claim 11 , further comprising:
in response to suggesting one or more adjustments to the user, receiving a user input for implementing a percentage of a suggested adjustment to an equalization parameter associated with the first audio track.

13. The method of claim 1 , wherein displaying the first spectral view corresponding to the first audio stream comprises:
receiving user inputs selecting one or more tracks for enabling spectral views of associated audio streams, wherein the one or more tracks include the first audio track; and
calculating and displaying the first spectral view of the first audio stream corresponding to the first audio track in response to receiving the user inputs.

14. A system for visually-assisted mixing of audio using a spectral analyzer comprising:
a processor coupled to a display and an input device, the processor adapted to:
receive a first audio stream from a first audio track that has associated equalization parameters;
calculate and display, on a graphical user interface shown on a device display, first spectral view of the first audio stream;
receive, through an input/output device, a user input for modifying the first spectral view , wherein the user input includes an interaction with a displayed portion of the first spectral view;
in response to the user input:
calculate modified spectral view of the first audio stream, and
automatically adjust one or more equalization parameters associated with the first audio track such that the first spectral view and the modified spectral view substantially match; and
display the modified spectral view with the adjusted equalization parameters on the graphical user interface.

15. The system of claim 14 , wherein the processor is further adapted to:
receive a second audio stream from a second audio track that has associated equalization parameters; and
calculate and display a second spectral view of the second audio stream on the graphical user interface.

16. The system of claim 14 , wherein the display of the first spectral view or the modified spectral view comprises the processor adapted to:
smooth the first spectral view or the modified spectral view using an enveloping technique in which relevant characteristics of the respective spectral view is preserved.

17. The system of claim 14 , wherein the processor is further adapted to adjust one or more of the equalization parameters to increase a gain of a peak in the first spectral view by activating an equalization band with a center frequency equal to the peak and an increased gain.

18. The system of claim 14 , wherein the processor is adapted to adjust at least one or more of the equalization parameters by adjusting a center frequency of a peak in the first spectral view by activating an equalization band with the center frequency and a negative gain and activating an equalization band with a new center frequency and a positive gain.

19. The system of claim 14 , wherein the processor is adapted to adjust one or more of the equalization parameters by adjusting a q-factor by activating a suitable equalization band with a corresponding q-value and gain, thereby changing the q-factor.

20. A computer program product for visually-assisted mixing of audio using a spectral analyzer, the computer program product comprising instructions stored in a computer-readable medium that, when executed by a processing module, are configured to cause the processing module to:
receive a first audio stream from a first

Assignees

• Apple Inc

Inventors

• Gehring Steffen

Classifications

• G10H7/008 Primary

  Means for controlling the transition from one tone waveform to another · CPC title

• H03G5/005

  of digital signals · CPC title

• H03G5/165

  Equalizers; Volume or gain control in limited frequency bands · CPC title

• H04S7/00 Primary

  Indicating arrangements; Control arrangements, e.g. balance control · CPC title