Modular audio control surface

Patent metadata

Field	Value
Publication number	US-10191607-B2
Application number	US-201313836456-A
Country	US
Kind code	B2
Filing date	Mar 15, 2013
Priority date	Mar 15, 2013
Publication date	Jan 29, 2019
Grant date	Jan 29, 2019

Abstract

A user-configurable modular audio control surface comprises master modules for controlling global surface properties and channel modules for controlling one or more individual audio channels. The modules are disposed in a two-dimensional spatial arrangement such that any module can occupy a location within the control surface not occupied by another module. The modules are connected to each other and to external platforms hosting media applications and plug-ins via a network. Control surface users can interact with external applications via remote graphical user interfaces displayed on modules within the surface, and can automate multiple external applications using an automation system built into the surface. Automation line graphs and metadata for both internal and external applications are displayed over the corresponding waveform displays that can include audio ahead of a current playback location.

First claim

What is claimed is:

1. An audio control surface comprising:
a plurality of modules, wherein each module comprises at least one of:
a physical user control comprising one of a switch, knob, and fader;
a touch user control; and
an output display for displaying one or more properties of a media application;

wherein the plurality of modules are disposed in a two-dimensional spatial arrangement of discrete locations, and wherein each of the modules is adapted to occupy one of a set of discrete locations within the control surface not occupied by another module, and wherein each module includes a CPU, random access memory, and a network interface that connects the module to a network; and
wherein a user is able to specify a discrete spatial location for a given module of the plurality of modules within the two-dimensional spatial arrangement of discrete locations by:
on a display of a designated module of the audio control surface, positioning an icon representing the given module on a two-dimensional graphical representation of the audio control surface in accordance with the spatial location of the given module within the two dimensional spatial arrangement of discrete locations; and
in response to a request output by the designated module, adjusting on the given module a physical control comprising one of a switch, a fader, and a knob, thereby causing the given module to output a signal over the network, and wherein the designated module receives the signal from the given module over the network and uses the received signal to tie a network address of the given module to the discrete spatial location of the given module within the two-dimensional spatial arrangement of modules.

2. The audio control surface of claim 1 , wherein at least a part of the spatial arrangement conforms to a two-dimensional rectangular grid of discrete locations.

3. The audio control surface of claim 1 , wherein at least a part of the spatial arrangement comprises modules disposed along a curved grid of discrete locations.

4. The audio control surface of claim 1 , wherein at least one of the plurality of modules comprises a touch screen, and wherein the user controls of the given module comprise a set of virtual controls implemented on the touch screen.

5. The audio control surface of claim 1 wherein one of the plurality of modules comprises a touchscreen interface configured with an expandable touch control for controlling a given functional category, and wherein expanding the touch control with a user-input touch gesture causes a set of virtual touch controls to be displayed, wherein each of the set of virtual controls is assigned to a function related to the given functional category.

6. The audio control surface of claim 1 , wherein the given module is assigned to control functionality provided by one of a plurality of media applications, and wherein each of the plurality of media applications is hosted by a different computer-based platform connected to the audio control surface via the network.

7. The audio control surface of claim 1 , wherein a user interface of a plug-in operating with a media application hosted on a platform external to the control surface and in communication with the audio control surface via the network is displayed on a display of a second designated module of the control surface.

8. The audio control surface of claim 7 , wherein one or more physical controls in physical proximity to the display of the second designated module are assigned to control functions of the plug-in.

9. The audio control surface of claim 1 , wherein the audio control surface receives a graphical audio waveform representation of an audio track from a media application external to the audio control surface and in communication with the audio control surface via the network, and displays the graphical audio waveform on a display of a second designated module of the control surface.

10. The audio control surface of claim 9 , wherein during playing of the audio track by the media application, the audio control surface receives the graphical audio waveform representation of the audio track corresponding to temporal locations in the audio track in advance of a current playback temporal location in the audio track, and wherein the audio control surface displays the graphical audio waveform corresponding to temporal locations before and after the current playback time of the audio track.

11. The audio control surface of claim 9 , wherein the audio control surface receives automation information from the media application and displays a graphical representation of the automation on the display of the designated module of the control surface such that the displayed automation information is temporally aligned with the displayed graphical audio waveform representation of the audio track.

12. The audio control surface of claim 9 , wherein the audio control surface receives metadata pertaining to a clip of an audio track that is represented by the graphical audio waveform, and wherein the audio control surface displays the metadata in association with the graphical audio waveform.

13. The audio control surface of claim 12 , wherein during playback of the clip, the metadata pertaining to the clip is received by the audio control surface in advance of a current playback time of the clip, and wherein the audio control surface displays the graphical representation of the waveform and its metadata for a temporal interval spanning times before and after the current playback time of the clip.

14. The audio control surface of claim 1 , wherein the control surface receives automation information from a media application hosted on a platform external to the control surface, and displays a graphical representation of the automation on the display of a second designated module of the control surface.

15. The audio control surface of claim 14 , wherein the automation information pertains to an audio clip, and wherein during playback of the clip by the media application, the graphical representation of the automation information spans temporal locations within the clip before and after a current playback time.

16. The audio control surface of claim 1 , wherein the control surface receives metadata pertaining to a clip of an audio track from a media application hosted on a platform external to the control surface, and displays at least one of a graphical and textual representation of the metadata.

17. The audio control surface of claim 16 , wherein during playback of the clip by the media application, the displayed representation of the metadata pertains to temporal locations within the clip spanning a current playback time.

18. The audio control surface of claim 1 , further comprising an internal automation system, wherein the automation system is capable of automating a media application hosted on a platform external to the audio control surface.

19. The audio control surface of claim 1 , further comprising an internal automation system, wherein the automation system is capable of automating a plurality of media applications hosted on one or more platforms external to the audio control surface.

20. The audio control surface of claim 19 , wherein a user is able to record and play back automation of a selected function of one of the plurality of media applications, wherein the selected function is assigned to a control of one of the modules of the audio control surface.

21. A module of an audio control surface comprising:
a CPU;
a random access memory c

Assignees

• Avid Tech Inc

Inventors

• Milne Steven H
• Kloiber Martin
• Vercellotti Paul A
• Tremblay David M
• Jones Edward
• Mueller Karl M
• Boyer Robert

Classifications

• G06T11/26

  Drawing of charts or graphs · CPC title

• G06F3/165 Primary

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• G06F3/048 Primary

  Interaction techniques based on graphical user interfaces [GUI] · CPC title

• G06F3/162

  Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs · CPC title

• G06T11/206

  Physics · mapped topic