Multi-dimensional audio transformations and crossfading

Patent metadata

Field	Value
Publication number	US-9264840-B2
Application number	US-201213479900-A
Country	US
Kind code	B2
Filing date	May 24, 2012
Priority date	May 24, 2012
Publication date	Feb 16, 2016
Grant date	Feb 16, 2016

Abstract

A system for generating mixed audio output using a multi-dimensional audio map includes a computer processor and a multi-dimensional crossfader configured to implement a method. A first audio file is read. A multi-dimensional audio map includes a plurality of audio attribute layers, each including a first dimension representing an audio attribute value for a location defined by at least two other dimensions within a multi-dimensional space. A path is determined to transition between two points in the multi-dimensional audio map. A transition is performed between the two points in the multi-dimensional audio map by selecting corresponding values from each of the plurality of audio attribute layers between the two points. A mixed output is generated by applying the corresponding values from each of the plurality of audio attribute layers between the two points to a portion of the first audio file.

First claim

What is claimed:

1. A system for crossfading by a multi-dimensional crossfader to generate mixed audio output, the system comprising:
a computer processor; and
the multi-dimensional crossfader executable by the computer processor, the multi-dimensional crossfader configured to implement a method, the method including:
reading a first audio file;
reading a second audio file;
accessing a multi-dimensional audio map, the multi-dimensional audio map comprising a plurality of audio attribute layers that are overlaid upon each other as separate planes normalized according to coordinates in a Euclidean plane, each of the audio attribute layers is uncorrelated with respect to time and comprises a first dimension representing an audio attribute value for a location defined by at least two other dimensions within a multi-dimensional space, wherein one of the audio attribute layers comprises a tempo audio attribute layer and another of the audio attribute layers comprises a volume audio attribute layer;
analyzing an ending portion of the first audio file to identify a first tempo;
analyzing a beginning portion of the second audio file to identify a second tempo;
determining a path to transition between two points comprising a first point and a second point in the multi-dimensional audio map, wherein the first point aligns with the first tempo in the tempo audio attribute layer and has an associated first volume in the volume audio attribute layer, and the second point aligns with the second tempo in the tempo audio attribute layer and has an associated second volume in the volume audio attribute layer;
transitioning between the two points in the multi-dimensional audio map by selecting corresponding values from each of the plurality of audio attribute layers between the two points; and
generating a mixed output by applying the corresponding values from each of the plurality of audio attribute layers between the two points to the ending portion of the first audio file with respect to time and to the beginning portion of the second audio file with respect to time, the mixed output comprising both a change in tempo and volume between the ending portion of the first audio file and the beginning portion of the second audio file.

2. The system of claim 1 , wherein the multi-dimensional crossfader is configured to implement the method comprising:
determining a first plurality of audio attributes of the first audio file corresponding to the plurality of audio attribute layers in the multi-dimensional audio map;
determining a second plurality of audio attributes of the second audio file corresponding to the plurality of audio attribute layers in the multi-dimensional audio map; and
applying audio attribute values from each the plurality of audio attribute layers to corresponding audio attributes in the first plurality of audio attributes and in the second plurality of audio attributes to generate the mixed output.

3. The system of claim 1 , wherein the multi-dimensional crossfader is configured to implement the method comprising:
receiving user input from an indicator to denote a coordinate in at least two dimensions;
receiving user input from an area to sense the coordinate; and
looking up one or more audio attributes associated with the sensed coordinate from the multi-dimensional map to generate the mixed output.

4. The system of claim 1 , further comprising:
an audio authoring tool executable by the computer processor, the audio authoring tool configured to implement a method, the method including:
assigning a first audio attribute to the multi-dimensional space comprising at least three dimensions;
creating a first audio attribute layer within the multi-dimensional space, including a first dimension representing an audio attribute value of the first audio attribute for a location defined by at least two other dimensions;
assigning one or more additional audio attributes to the multi-dimensional space comprising at least three dimensions;
creating one or more additional audio attribute layers within the multi-dimensional space, each of the one or more additional audio attribute layers including a first dimension representing an audio attribute value of each additional audio attribute for a location defined by at least two other dimensions;
stacking the one or more additional audio attribute layers relative to the first audio attribute layer to form the multi-dimensional audio map that overlays the one or more additional audio attribute layers upon the first audio attribute layer as separate planes normalized according to coordinates in a Euclidean plane, and each of the first audio attribute layer and the one or more additional audio attribute layers is uncorrelated with respect to time; and
storing the multi-dimensional audio map in non-transitory computer readable memory.

5. The system of claim 4 , wherein the audio authoring tool further comprises a terrain map control, the terrain map control configured to display and navigate each of the audio attribute layers as audio contour maps.

6. A computer program product for crossfading by a multi-dimensional crossfader to generate mixed audio output, the computer program product comprising a non-transitory storage medium having computer-readable program code embodied thereon, which when executed by a computer processor of the multi-dimensional crossfader, causes the computer processor to implement a method, the method comprising:
reading a first audio file;
reading a second audio file;
accessing a multi-dimensional audio map, the multi-dimensional audio map comprising a plurality of audio attribute layers that are overlaid upon each other as separate planes normalized according to coordinates in a Euclidean plane, each of the audio attribute layers is uncorrelated with respect to time and comprises a first dimension representing an audio attribute value for a location defined by at least two other dimensions within a multi-dimensional space, wherein one of the audio attribute layers comprises a tempo audio attribute layer and another of the audio attribute layers comprises a volume audio attribute layer;
analyzing an ending portion of the first audio file to identify a first tempo;
analyzing a beginning portion of the second audio file to identify a second tempo;
determining a path to transition between two points comprising a first point and a second point in the multi-dimensional audio map, wherein the first point aligns with the first tempo in the tempo audio attribute layer and has an associated first volume in the volume audio attribute layer, and the second point aligns with the second tempo in the tempo audio attribute layer and has an associated second volume in the volume audio attribute layer;
transitioning between the two points in the multi-dimensional audio map by selecting corresponding values from each of the plurality of audio attribute layers between the two points; and
generating a mixed output by applying the corresponding values from each of the plurality of audio attribute layers between the two points to the ending portion of the first audio file with respect to time and to the beginning portion of the second audio file with respect to time, the mixed output comprising both a change in tempo and volume between the ending portion of the first audio file and the beginning portion of the second audio file.

7. The computer program product of claim 6 , further comprising:
determining a first plurality of audio attributes of the first audio file corresponding to the plurality of audio attribute layers in the multi-dimensional audio map;
determining a second plurality of audio attributes of the second audio file corresponding to the plurality of audio attribute layers in the multi-dimensional audi

Assignees

• Lection David B
• Pagan William G
• IBM

Inventors

• Lection David B
• Pagan William G

Classifications

• H04S1/002

  Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution (control circuits for electronic adaptation of the sound field H04S7/30) · CPC title

• H04H60/04

  Studio equipment; Interconnection of studios · CPC title

• H04R2420/01

  Input selection or mixing for amplifiers or loudspeakers · CPC title

• H04S7/307

  Frequency adjustment, e.g. tone control (H04S7/301 takes precedence) · CPC title

• H04S7/40 Primary

  Visual indication of stereophonic sound image · CPC title