Realtime audio effects control

Patent metadata

Field	Value
Publication number	US-2017206055-A1
Application number	US-201615001107-A
Country	US
Kind code	A1
Filing date	Jan 19, 2016
Priority date	Jan 19, 2016
Publication date	Jul 20, 2017
Grant date	—

Abstract

In some implementations, a computing device can be configured to present a graphical user interface that enables the dynamic authoring of music by a user of the computing device. The computing device can present a grid of cells, where each cell represents a music segment. The cells can be configured to playback the music segment once or playback the music segment in a repeating loop. The user can select (e.g., touch) one or more cells in the grid to cause the corresponding music segment to play. While playing selected cells, the user can provide input selecting various musical effects to apply to the playing music. The user can record a dynamically selected sequence of cells and musical effects to create an original musical product.

First claim

What is claimed is:

1 . A method comprising:
playing, by a computing device, an audio stream; presenting, by the computing device, a first audio effects control and a second audio effects control, where the first audio effects control is configured to control a first type of audio effect and the second audio effects control is configured to control a second type of audio effect; receiving, by the computing device, a first user input to the first audio effects control indicating at least one first parameter for the first audio effect type; adjusting, by the computing device, the audio stream based on the first parameter of the first audio effect type to generate a first modified audio stream; receiving, by the computing device, a second user input to the second audio effects control indicating at least one second parameter for the second audio effect type; adjusting, by the computing device, the first modified audio stream based on the second parameter of the second audio effect type; detecting, by the computing device, that the first user input with respect to the first audio effects control has ceased; and while continuing to receive the second user input, continuing to adjust, by the computing device, the first modified audio stream based on the second parameter of the second audio effect type.

2 . The method of claim 1 , wherein receiving, by the computing device, a first user input to the first audio effects control indicating at least one first parameter for the first audio effect type comprises:
enabling, by the computing device, motion control for the first audio effects control; hiding, by the computing device, the first audio effects control; and receiving, by the computing device, a first motion input to the first audio effects control indicating at least one first parameter for the first audio effect type.

3 . The method of claim 1 , further comprising:
enabling, by the computing device, motion control for the second audio effects control, wherein the second user input to the second audio effects control is motion input and the first user input to the first audio effects control is touch input.

4 . The method of claim 1 , further comprising:
receiving, by the computing device, a user selection of a third type of audio effect for the first audio effect control; associating, by the computing device, the third type of audio effect with the first audio effects control; receiving, by the computing device, a fourth user input to the first audio effects control indicating at least one third parameter for the third audio effect type; and adjusting, by the computing device, the first modified audio stream based on the second parameter of the second audio effect type and the third parameter of the third audio effect type.

5 . The method of claim 1 , further comprising:
generating, by the computing device, an audio effect recording including the first user input with respect to the first audio effect control, wherein the audio effect recording includes user-selected values for the at least one first parameter and does not include the audio stream.

6 . The method of claim 1 , wherein the second audio effects control is a two-dimensional control for adjusting at least two parameters of the second audio effect type, and further comprising:
receiving, by the computing device, a fifth user input for minimizing the second audio effects control; and transforming, by the computing device, the second audio effects control into a one-dimensional control for adjusting one of the at least two parameters of the second audio effect type.

7 . The method of claim 1 , further comprising:
detecting, by the computing device, a threshold amount of pressure applied to the second audio effects control; and in response to detecting the threshold amount of pressure, adjusting, by the computing device, the audio stream base on a fourth type of audio effect.

8 . A non-transitory computer-readable medium including one or more sequences of instructions that, when executed by one or more processors, causes:
playing, by a computing device, an audio stream; presenting, by the computing device, a first audio effects control and a second audio effects control, where the first audio effects control is configured to control a first type of audio effect and the second audio effects control is configured to control a second type of audio effect; receiving, by the computing device, a first user input to the first audio effects control indicating at least one first parameter for the first audio effect type; adjusting, by the computing device, the audio stream based on the first parameter of the first audio effect type to generate a first modified audio stream; receiving, by the computing device, a second user input to the second audio effects control indicating at least one second parameter for the second audio effect type; adjusting, by the computing device, the first modified audio stream based on the second parameter of the second audio effect type; detecting, by the computing device, that the first user input with respect to the first audio effects control has ceased; and while continuing to receive the second user input, continuing to adjust, by the computing device, the first modified audio stream based on the second parameter of the second audio effect type.

9 . The non-transitory computer-readable medium of claim 8 , wherein the instructions that cause receiving, by the computing device, a first user input to the first audio effects control indicating at least one first parameter for the first audio effect type include instructions that cause:
enabling, by the computing device, motion control for the first audio effects control; hiding, by the computing device, the first audio effects control; and receiving, by the computing device, a first motion input to the first audio effects control indicating at least one first parameter for the first audio effect type.

10 . The non-transitory computer-readable medium of claim 8 , wherein the instructions cause:
enabling, by the computing device, motion control for the second audio effects control, wherein the second user input to the second audio effects control is motion input and the first user input to the first audio effects control is touch input.

11 . The non-transitory computer-readable medium of claim 8 , wherein the instructions cause:
receiving, by the computing device, a user selection of a third type of audio effect for the first audio effect control; associating, by the computing device, the third type of audio effect with the first audio effects control; receiving, by the computing device, a fourth user input to the first audio effects control indicating at least one third parameter for the third audio effect type; and adjusting, by the computing device, the first modified audio stream based on the second parameter of the second audio effect type and the third parameter of the third audio effect type.

12 . The non-transitory computer-readable medium of claim 8 , wherein the instructions cause:
generating, by the computing device, an audio effect recording including the first user input with respect to the first audio effect control, wherein the audio effect recording includes user-selected values for the at least one first parameter and does not include the audio stream.

13 . The non-transitory computer-readable medium of claim 8 , wherein the second audio effects control is a two-dimensional control for adjusting at least two parameters of the second audio effect type, and wherein the instructions cause:
receiving, by the computing device, a fifth use

Assignees

• Apple Inc

Inventors

• Baker Robert
• Lengeling Gerhard
• Diedrichsen Steffan
• Helms Jan-Hinnerk
• Jensen Thomas
• Lange Manfred
• Reuter Vincent
• Schulz Carsten
• Hene Raphael

Classifications

• G06F3/165 Primary

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06F3/0414

  using force sensing means to determine a position · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/04817

  using icons (graphical or visual programming using iconic symbols G06F8/34) · CPC title