Dynamic music authoring

Patent metadata

Field	Value
Publication number	US-10224012-B2
Application number	US-201815939115-A
Country	US
Kind code	B2
Filing date	Mar 28, 2018
Priority date	Jan 19, 2016
Publication date	Mar 5, 2019
Grant date	Mar 5, 2019

Abstract

A method to author music. The method includes presenting, on a display by a computing device, an audio effect menu, receiving, by the computing device, a first user input selecting a first audio effect from the audio effect menu, generating, in response to receiving the first user input, a first modified audio stream based on a particular audio stream and the first audio effect, receiving, by the computing device while receiving the first user input, a second user input selecting a second audio effect from the audio effect menu, generating, in response to receiving the second user input, a second modified audio stream based on the first modified audio stream and the second audio effect, detecting cessation of the first user input, and continuing, in response to detecting the cessation, generating the second modified audio stream based on the first modified audio stream and the second audio effect.

First claim

What is claimed is:

1. A method comprising:
presenting, by a computing device, an audio effect menu on a display of the computing device, wherein the audio effect menu comprises a plurality of audio effect that define how to modify an audio stream;
receiving, by the computing device, a particular audio stream;
receiving, by the computing device, a first user input selecting a first audio effect from the audio effect menu;
generating, in response to receiving the first user input, a first modified audio stream based on the particular audio stream and the first audio effect;
receiving, by the computing device while receiving the first user input, a second user input selecting a second audio effect from the audio effect menu;
generating, in response to receiving the second user input, a second modified audio stream based on the first modified audio stream and the second audio effect;
detecting cessation of the first user input; and
continuing, in response to detecting the cessation, generating the second modified audio stream based on the first modified audio stream and the second audio effect.

2. The method of claim 1 ,
wherein the first user input is received via a first two-dimensional (2D) graphical element of the audio effect menu, and
wherein the first user input comprises a first attribute and a second attribute of the first audio effect that correspond to a first x-axis and a first y-axis of the first 2D graphical element.

3. The method of claim 2 ,
wherein the first user input further comprises a third attribute of the first audio effect that is received via a pressure sensor associated with the first 2D graphical element.

4. The method of claim 2 ,
wherein the second user input is received via a second 2D graphical element of the audio effect menu,
wherein the second user input comprises a third attribute and a fourth attribute of the second audio effect that correspond to a second x-axis and a second y-axis of the second 2D graphical element.

5. The method of claim 1 , further comprising:
detecting, by the computing device, a motion of the computing device, wherein the first user input comprises the detected motion; and
adjusting at least one of a first attribute and a second attribute of the first audio effect.

6. The method of claim 5 , further comprising:
receiving, by the computing device, a third user input to enable motion control,
wherein the adjusting is in response to enabling the motion control.

7. The method of claim 5 ,
wherein the second user input comprises a touch input.

8. A non-transitory computer-readable medium including one or more sequences of instructions that, when executed by one or more processors, causes:
presenting, by a computing device, an audio effect menu on a display of the computing device, wherein the audio effect menu comprises a plurality of audio effect that define how to modify an audio stream;
receiving, by the computing device, a particular audio stream;
receiving, by the computing device, a first user input selecting a first audio effect from the audio effect menu;
generating, in response to receiving the first user input, a first modified audio stream based on the particular audio stream and the first audio effect;
receiving, by the computing device while receiving the first user input, a second user input selecting a second audio effect from the audio effect menu;
generating, in response to receiving the second user input, a second modified audio stream based on the first modified audio stream and the second audio effect;
detecting cessation of the first user input; and
continuing, in response to detecting the cessation, generating the second modified audio stream based on the first modified audio stream and the second audio effect.

9. The non-transitory computer-readable medium of claim 8 ,
wherein the first user input is received via a first two-dimensional (2D) graphical element of the audio effect menu, and
wherein the first user input comprises a first attribute and a second attribute of the first audio effect that correspond to a first x-axis and a first y-axis of the first 2D graphical element.

10. The non-transitory computer-readable medium of claim 9 ,
wherein the first user input further comprises a third attribute of the first audio effect that is received via a pressure sensor associated with the first 2D graphical element.

11. The non-transitory computer-readable medium of claim 9 ,
wherein the second user input is received via a second 2D graphical element of the audio effect menu,
wherein the second user input comprises a third attribute and a fourth attribute of the second audio effect that correspond to a second x-axis and a second y-axis of the second 2D graphical element.

12. The non-transitory computer-readable medium of claim 8 , the one or more sequences of instructions, when executed by the one or more processors, further causing
detecting, by the computing device, a motion of the computing device, wherein the first user input comprises the detected motion; and
adjusting at least one of a first attribute and a second attribute of the first audio effect.

13. The non-transitory computer-readable medium of claim 12 , the one or more sequences of instructions, when executed by the one or more processors, further causing receiving, by the computing device, a third user input to enable motion control, wherein the adjusting is in response to enabling the motion control.

14. The non-transitory computer-readable medium of claim 12 ,
wherein the second user input comprises a touch input.

15. A computing device comprising:
one or more processors;
a display; and
a computer-readable medium including one or more sequences of instructions that, when executed by the one or more processors, causes:
presenting, by the computing device, an audio effect menu on the display, wherein the audio effect menu comprises a plurality of audio effect that define how to modify an audio stream;
receiving, by the computing device, a particular audio stream;
receiving, by the computing device, a first user input selecting a first audio effect from the audio effect menu;
generating, in response to receiving the first user input, a first modified audio stream based on the particular audio stream and the first audio effect;
receiving, by the computing device while receiving the first user input, a second user input selecting a second audio effect from the audio effect menu;
generating, in response to receiving the second user input, a second modified audio stream based on the first modified audio stream and the second audio effect;
detecting cessation of the first user input; and
continuing, in response to detecting the cessation, generating the second modified audio stream based on the first modified audio stream and the second audio effect.

16. The computing device of claim 15 ,
wherein the first user input is received via a first two-dimensional (2D) graphical element of the audio effect menu, and
wherein the first user input comprises a first attribute and a second attribute of the first audio effect that correspond to a first x-axis and a first y-axis of the first 2D graphical element.

17. The computing device of claim 16 ,
wherein the first user input further comprises a third attribute of the first audio effect that is received via a pressure sensor associated with the first 2D graphical element.

18. The computing device of claim 16 ,
wherein the second user input is received via a second 2D graphical element of the audio effect men

Assignees

• Apple Inc

Inventors

• Baker Robert
• Lengeling Gerhard
• Little Alec
• Beard Patrick
• Lagemann Ole
• Patterson Danny
• Hermann Tobias

Classifications

• G10H2240/145

  Sound library, i.e. involving the specific use of a musical database as a sound bank or wavetable; indexing, interfacing, protocols or processing therefor · CPC title

• G10H2210/155

  Musical effects · CPC title

• G10H2220/126

  for graphical editing of individual notes, parts or phrases represented as variable length segments on a 2D or 3D representation, e.g. graphical edition of musical collage, remix files or pianoroll representations of MIDI-like files · CPC title

• G10H2220/116

  for graphical editing of sound parameters or waveforms, e.g. by graphical interactive control of timbre, partials or envelope · CPC title

• G10H2220/106

  using icons, e.g. selecting, moving or linking icons, on-screen symbols, screen regions or segments representing musical elements or parameters · CPC title