Particle-based spatial audio visualization

Patent metadata

Field	Value
Publication number	US-10791412-B2
Application number	US-202016790469-A
Country	US
Kind code	B2
Filing date	Feb 13, 2020
Priority date	Nov 15, 2017
Publication date	Sep 29, 2020
Grant date	Sep 29, 2020

Abstract

Methods and systems are provided for visualizing spatial audio using determined properties for time segments of the spatial audio. Such properties include the position sound is coming from, intensity of the sound, focus of the sound, and color of the sound at a time segment of the spatial audio. These properties can be determined by analyzing the time segment of the spatial audio. Upon determining these properties, the properties are used in rendering a visualization of the sound with attributes based on the properties of the sound(s) at the time segment of the spatial audio.

First claim

What is claimed is:

1. A computer-implemented method, the method comprising:
accessing audio content corresponding to a time segment; and
generating a visualization for the time segment of the audio content using a particle at a position that corresponds to an originating location of the audio content within a three-dimensional environment, the particle having a first attribute visually representative of spatial concentration of the audio content at the originating location within the three-dimensional environment.

2. The computer-implemented method of claim 1 , wherein the first attribute visually representative of the spatial concentration of the audio content is displayed using a size of the particle.

3. The computer-implemented method of claim 1 , the particle further having a second attribute visually representative of a pitch of the audio content.

4. The computer-implemented method of claim 3 , wherein the second attribute visually representative of the pitch of the audio content is displayed using a color of the particle.

5. The computer-implemented method of claim 1 , the particle further having a third attribute visually representative of a level of loudness of the audio content.

6. The computer-implemented method of claim 5 , wherein the third attribute visually representative of the level of loudness of the audio content is displayed using opacity of the particle.

7. The computer-implemented method of claim 1 , wherein the position is based on a left/right audio component, an up/down audio component, and a forward/backward audio component corresponding to an omnidirectional audio component.

8. The computer-implemented method of claim 1 , wherein the audio content corresponding to the time segment is accessed based on a selection of the audio content for viewing using a user interface.

9. The computer-implemented method of claim 1 , wherein the visualization for the time segment of the audio content is automatically initiated upon receiving the audio content.

10. One or more non-transitory computer-readable media having a plurality of executable instructions embodied thereon, which, when executed by one or more processors, cause the one or more processors to perform operations comprising:
receiving a selection indicating a time segment of audio content to visualize; and
causing a display of a visualization of the audio content using a particle at a position that corresponds to an originating location of the audio content within a three-dimensional environment, the particle having a first attribute visually representative of spatial concentration of the audio content at the originating location within the three-dimensional environment.

11. The media of claim 10 , wherein the first attribute visually representative of the spatial concentration of the audio content is displayed using a size of the particle.

12. The media of claim 10 , the particle further having a second attribute visually representative of a pitch of the audio content.

13. The media of claim 12 , wherein the second attribute visually representative of the pitch of the audio content is displayed using a color of the particle.

14. The media of claim 10 , the particle further having a third attribute visually representative of a level of loudness of the audio content.

15. The media of claim 14 , wherein the third attribute visually representative of the level of loudness of the audio content is displayed using opacity of the particle.

16. The media of claim 10 , wherein the position is based on a left/right audio component, an up/down audio component, and a forward/backward audio component corresponding to an omnidirectional audio component.

17. The media of claim 10 , the visualization of the audio content further using a second particle at a second position that corresponds to a second originating location of the audio content within the three-dimensional environment, the second particle having an attribute visually representative of spatial concentration of the audio content at the second originating location within the three-dimensional environment.

18. A computing system comprising:
means for accessing audio content corresponding to a time segment; and
means for generating a visualization for the time segment of the audio content using a particle at a position that corresponds to an originating location of the audio content within a three-dimensional environment, the particle having a first attribute visually representative of spatial concentration of the audio content at the originating location within the three-dimensional environment.

19. The system of claim 18 , further comprising:
means for receiving a selection of the audio content for viewing.

20. The system of claim 18 , further comprising:
means for displaying the visualization for the time segment of the audio content.

Assignees

• Adobe Inc

Inventors

• Diverdi Stephen Joseph
• De Ridder Yaniv

Classifications

• H04S2420/11

  Application of ambisonics in stereophonic audio systems · CPC title

• H04S2400/11

  Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) · CPC title

• H04S7/40 Primary

  Visual indication of stereophonic sound image · CPC title

• H04S2400/15

  Aspects of sound capture and related signal processing for recording or reproduction · CPC title