Visual representation of audio data

Patent metadata

Field	Value
Publication number	US-9241229-B2
Application number	US-201213419768-A
Country	US
Kind code	B2
Filing date	Mar 14, 2012
Priority date	Oct 20, 2006
Publication date	Jan 19, 2016
Grant date	Jan 19, 2016

Abstract

Systems, methods, and computer program products for displaying audio data are provided. In some implementations, a computer-implemented method is provided. The method includes receiving audio data and displaying a composite image representing the audio data. The composite image combines a first representation and a distinct second representation of the audio data. Each representation is visible in the composite image and the representations appear in the composite image as if laid one over the other.

First claim

What is claimed is:

1. A method implemented by one or more computing devices, the method comprising:
receiving audio data by the one or more computing devices;
displaying a composite image by the one or more computing devices representing the audio data, the composite image combining a first representation of a first feature of the audio data having a type that is different than a type of a distinct second representation of a different second feature of the audio data, the first and distinct second representations visible in the composite image as sharing a time axis and as laid one over the other such that at least a portion of the first representation covers a portion of the distinct second representation;
detecting a user selection, for editing the audio data, of one or more time points along the shared time axis of the composite image of the first representation and the distinct second representation; and
displaying editing points in the first representation and the distinct second representation based upon the user selected one or more time points.

2. The method of claim 1 , where the first representation is a frequency spectrogram.

3. The method of claim 1 , where the distinct second representation represents an amplitude waveform.

4. The method of claim 3 , where the amplitude waveform is represented with a line defining an outer shape of the amplitude waveform.

5. The method of claim 1 , where the composite image highlights a region composed of the first and distinct second representations.

6. The method of claim 1 , further comprising editing the audio data based on at least the displayed editing points.

7. The method of claim 6 , where editing the audio data comprises:
receiving an input specifying an editing operation on the audio data; and
performing the editing operation and updating the first and distinct second representations to reflect a result of the editing operation.

8. The method of claim 7 , wherein an effect of specifying an editing operation on the first or distinct second representations is shown on the respective other representation in the composite image.

9. The method of claim 1 , where the distinct second representation represents a pan position or phase display.

10. A non-transitory computer readable medium operable to cause data processing apparatus to perform operations comprising:
receiving audio data;
displaying a composite image by the one or more computing devices representing the audio data, the composite image combining a first representation of a first feature of the audio data having a type that is different than a type of a distinct second representation of a different second feature of the audio data, the first and distinct second representations visible in the composite image as sharing a time axis and as laid one over the other such that at least a portion of the first representation covers a portion of the distinct second representation;
detecting a user selection, for editing the audio data, of one or more time points along the shared time axis of the composite image of the first representation and the distinct second representation; and
displaying editing points in the first representation and the distinct second representation based upon the user selected one or more time points.

11. The non-transitory computer readable medium of claim 10 , where the first representation is a frequency spectrogram.

12. The non-transitory computer readable medium of claim 10 , where the distinct second representation represents an amplitude waveform.

13. The non-transitory computer readable medium of claim 12 , where the amplitude waveform is represented with a line defining an outer shape of the amplitude waveform.

14. The non-transitory computer readable medium of claim 10 , wherein the composite image highlights a region composed of the first and distinct second representations.

15. The non-transitory computer readable medium of claim 10 , further comprising editing the audio data based on at least the identified editing points.

16. The non-transitory computer readable medium of claim 15 , where editing the audio data comprises:
receiving an input to perform an editing operation on the audio data; and
performing the editing operation and updating the first and distinct second representations to reflect a result of the editing operation.

17. The non-transitory computer readable medium of claim 16 , wherein an effect of specifying an editing operation on the first or distinct second representations is shown on the respective other representation in the composite image.

18. The non-transitory computer readable medium of claim 10 , where the distinct second representation represents a pan position or phase display.

19. A system comprising:
a user interface device; and
one or more computers operable to interact with the user interface device and to perform operations including:
receiving audio data;
displaying a composite image by the one or more computing devices representing the audio data, the composite image combining a first representation of a first feature of the audio data having a type that is different than a type of a distinct second representation of a different second feature of the audio data, the first and distinct second representations visible in the composite image as sharing a time axis and as laid one over the other such that at least a portion of the first representation covers a portion of the distinct second representation;
detecting a user selection, for editing the audio data, of one or more time points along the shared time axis of the composite image of the first representation and the distinct second representation; and
displaying editing points in the first representation and the distinct second representation based upon the user selected one or more time points.

20. The system of claim 19 , wherein the one or more computers comprise a server operable to interact with the user interface device through a data communication network, and the user interface device is operable to interact with the server as a client.

21. The system of claim 20 , wherein the user interface device comprises a personal computer running a web browser or a mobile telephone running a WAP browser.

22. The system of claim 19 , wherein the one or more computers comprises one personal computer, and the personal computer comprises the user interface device.

23. The system of claim 19 , where the first representation is a frequency spectrogram.

24. The system of claim 19 , where the distinct second representation represents an amplitude waveform.

25. The system of claim 24 , where the amplitude waveform is represented with a line defining an outer shape of the amplitude waveform.

26. The system of claim 19 , where the composite image highlights a region composed of the first and distinct second representations.

27. The system of claim 19 , further operable to:
edit the audio data based on at least the identified editing points.

28. The system of claim 27 , where editing the audio data comprises:
receiving an input to perform an editing operation on the audio data; and
performing the editing operation and updating the first and distinct second representations to reflect a result of the editing operation.

29. The system of claim 28 , wherein an effect of specifying an editing operation on

Assignees

• Ramirez Daniel
• Adobe Systems Inc

Inventors

• Ramirez Daniel

Classifications

• H04R29/008 Primary

  Visual indication of individual signal levels (visual indication of stereophonic sound image H04S7/40) · CPC title

• G09B21/006

  using audible presentation of the information · CPC title

• G10H1/366

  with means for modifying or correcting the external signal, e.g. pitch correction, reverberation, changing a singer's voice · CPC title

• G10H1/30

  to reiteratively sound two tones · CPC title

• H04N5/44543

  Electricity · mapped topic