Multiple concurrent audio modes

Patent metadata

Field	Value
Publication number	US-9519708-B2
Application number	US-201313904436-A
Country	US
Kind code	B2
Filing date	May 29, 2013
Priority date	May 29, 2013
Publication date	Dec 13, 2016
Grant date	Dec 13, 2016

Abstract

Embodiments described herein include devices and processes for concurrently processing different audio streams with different hardware-based audio processing modes. A computing device for such embodiments may have multiple hardware audio signal processing modes capable of parallel execution. An operating system or audio stack thereof may manage audio paths or streams for audio sources producing respective types of audio signals. Which of the audio paths or streams will be connected with which of the hardware audio signal processing modes may be determined according to the types of the audio signals. A first hardware audio signal processing mode may be processing a first type of audio signal of a first audio path or stream while concurrently a second hardware audio signal processing mode processes a second type of audio signal of a second audio path or stream.

First claim

The invention claimed is:

1. A method of managing audio data in a computing device, the computing device comprising a processor chip, storage, and an audio processor chip, the audio processor chip providing a plurality of signal processing effects, each signal processing effect respectively implementing a different type of audio signal processing algorithm, the method performed by an operating system and/or a kernel-mode component of the computing device, the method comprising:
accessing association information associating audio types and the signal processing effects, respectively, wherein each audio type is associated with a corresponding one of the signal processing effects;
providing and managing audio streams that concurrently pass through the audio processor chip for respective applications executing on the computing device;
receiving from the applications requests to initiate the audio streams, each request having associated therewith an indication indicating a respective audio type provided by the corresponding requesting application, wherein the audio types are associated with the audio streams on a stream-by-stream basis such that different concurrent audio streams of a same application are able to have different respective audio types associated therewith; and
each time one of the requests is received from one of the applications, initiating the corresponding audio stream by selecting one of the signal processing effects for the audio stream, wherein the signal processing effect is selected according to the audio type indicated by the indication and according to the association information, wherein a first request to initiate a first audio stream is received from a first application, and while the first audio stream is streaming from the first application, a second request to initiate a second audio stream is received from the first application, the first request having associated therewith a first indication indicating a first audio type, the second request having associated therewith a second indication indicating a second audio type, the first audio stream being processed by a first signal processing effect while the second audio stream is being processed by a second signal processing effect.

2. A method according to claim 1 , wherein the method enables the audio processing chip to concurrently perform two different types of signal processing for two different applications.

3. A method according to claim 1 , further comprising providing a raw signal processing mode that, when requested by an application, causes a corresponding audio stream to have substantially no audio signal processing applied thereto by the audio processing chip.

4. A method according to claim 1 , further comprising providing an application programming interface (API) that is used by the applications to initiate and manage the audio streams, the API allowing an application to specify an audio type of a corresponding audio stream.

5. A computing device comprising:
an audio signal processing device configured to implement a plurality of audio effects by respective audio effect hardware modules; and
a processor executing applications and providing audio streams for the applications, the processor enabling concurrent processing of the audio streams concurrently flowing through the audio effect hardware modules, the concurrent processing enabled by, for a given application and corresponding first and second audio streams of the given application:
based on requests from the given application respectively identifying the first and second audio streams, accessing association information associating the audio effects with audio types;
determining a first audio type for the first audio stream and a second audio type for the second audio stream, and based on the determined first and second audio types and the association information, selecting a first audio effect for the first audio stream and selecting a second audio effect for the second audio stream; and
based on the first and second selected audio effects, configuring and/or selecting, for the first audio stream, a first audio pathway that includes a first audio effect hardware module corresponding to the selected first audio effect and configuring and/or selecting, for the second audio stream, a second audio pathway that includes a second audio effect hardware module corresponding to the selected second audio effect.

6. A computing device according to claim 5 , wherein the applications tag the respective audio streams to allow matching of the audio streams with the audio effect hardware modules.

7. A computing device according to claim 6 , wherein audio streams tagged with a same audio type are mixed to form a mixed signal and the mixed signal is passed to an audio effect hardware module that corresponds to the same audio type.

8. A computing device according to claim 5 , wherein when the processor determines that an audio stream is a raw type the audio stream is not passed through any of the audio effect hardware modules.

9. A computing device according to claim 8 , wherein the audio signal processing device further comprises a signal processing component that processes all of the audio streams including the raw type audio streams, the signal processing preventing audio signals from having a characteristic that will damage the audio signal processing device.

10. A computing device according to claim 5 , wherein the processor is configured with logic to prioritize audio effects associated with a given audio type.

11. One or more computer readable storage devices storing information to enable a computing device to perform a process, the computing device comprising a plurality of hardware audio signal processing modes, the process comprising:
executing an operating system that manages audio paths for audio sources producing respective audio streams having respective audio types;
receiving first and second requests from an application through an application programming interface (API) of the operating system, the first request indication an association between a first audio stream and a first audio type, and the second request indicating an association between a second audio stream and a second audio type;
determining which of the audio paths will be connected with which of the hardware audio signal processing modes according to information associating the audio types with the hardware audio signal processing modes; and
the determining causing a first hardware audio signal processing mode, configured to process audio signals having a first audio type, to be connected to a first audio path, and the determining causing a second hardware audio signal processing mode, configured to process audio signals having a second audio type, to be connected to a second audio path, wherein, based on the first request the first audio stream is assigned to the first audio path and based on the second request the second audio stream is assigned to the second audio path, wherein the first audio path processes the audio streams having the first audio type concurrent with the second audio path processes the audio streams having the second audio type.

12. One or more computer readable storage devices according to claim 11 , wherein the audio types include at least two of: voice, music, movie, game, sound effect, and speech.

13. One or more computer readable storage devices according to claim 11 , the process further comprising providing a software-based audio processing mode performed by software executing on the processor, and connecting audio streams of a given type of audio type with the software-based audio processing mode for signal processing thereby.

Assignees

• Microsoft Corp
• Microsoft Technology Licensing Llc

Inventors

• Yerrace Frank
• Kotteri Kishore
• Chung Rian

Classifications

• G06F3/165 Primary

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• G06F16/60 Primary

  of audio data · CPC title

• G06F17/3074 Primary

  Physics · mapped topic

• G06F16/63 Primary

  Querying · CPC title