Encoding and rendering of object based audio indicative of game audio content

Patent metadata

Field	Value
Publication number	US-9489954-B2
Application number	US-201314414877-A
Country	US
Kind code	B2
Filing date	Aug 6, 2013
Priority date	Aug 7, 2012
Publication date	Nov 8, 2016
Grant date	Nov 8, 2016

Abstract

In some embodiments, a method (typically performed by a game console) for generating an object based audio program indicative of game audio content (audio content pertaining to play of or events in a game, and optionally also other information regarding the game), and including at least one audio object channel and at least one speaker channel. In other embodiments, a game console configured to generate such an object based audio program. Some embodiments implement object clustering in which audio content of input objects is mixed to generate at least one clustered audio object, or audio content of at least one input object is mixed with speaker channel audio. In response to the program, a spatial rendering system (e.g., external to the game console) may operate with knowledge of playback speaker configuration to generate speaker feeds indicative of a spatial mix of the program's speaker and object channel content.

First claim

The invention claimed is:

1. A method for generating an object based audio program indicative of game audio content, said method including steps of:
(a) determining at least one audio object channel, wherein each said audio object channel is indicative of at least one audio object, and at least one said audio object channel is indicative of game audio content;
(b) determining at least one speaker channel, said at least one speaker channel being associated with a first speaker configuration, wherein at least one said speaker channel is indicative of additional game audio content; and
(c) generating the object based audio program, including by encoding data indicative of each said audio object channel and each said speaker channel,
wherein step (a) includes steps of:
(d) identifying a set of input audio objects which are indicative of game audio content, where the set consists of N audio objects and N is a positive integer; and
(e) replacing the set of input audio objects with a reduced set of audio objects, where the reduced set consists of M audio objects, M is a positive integer less than N and said at least one audio object channel is indicative of the reduced set of audio objects,
and wherein step (c) includes the step of:
generating the object based audio program such that said object based audio program is indicative of the reduced set of audio objects, and includes M object channels and at least one speaker channel associated with a second speaker configuration, the second speaker configuration being different from the first speaker configuration.

2. The method of claim 1 , also including a step of operating a game console to play a game, including by accessing data indicative of at least one said audio objects, and wherein steps (a), (b), and (c) are performed by the game console during play of the game.

3. The method of claim 2 , also including a step of:
asserting configuration data to the game console, and wherein said step of performing object clustering is in response to the configuration data to determine a limited number of audio object channels to be included in the object based audio program.

4. The method of claim 2 , wherein object-related metadata associated with an input object channel indicates that the input object channel is indicative of reverberating sound and/or sound emitting from a large source, wherein step (b) includes said step of performing object clustering, and wherein said step of object clustering is performed in response to the object-related metadata to mix audio content of said input object channel with audio content of at least one input speaker channel to determine at least one said speaker channel.

5. The method of claim 2 , wherein object-related metadata associated with an input object channel indicates that the input object channel is indicative of reverberating sound, and wherein steps (a) and (b) includes steps of:
in response to the object-related metadata, determining a dry version of the reverberating sound, and generating audio content indicative of reverberations of the dry version of the reverberating sound;
determining one said audio object channel which is indicative of the dry version of the reverberating sound; and
determining at least one said speaker channel which is indicative of reverberations of the dry version of the reverberating sound.

6. The method of claim 1 , also including the step of:
in response to the object based audio program, operating a spatial rendering system to generate speaker feeds indicative of a mix of audio content of each said speaker channel and each said audio object channel.

7. The method of claim 1 , wherein step (e) includes the step of:
mixing audio content of at least two of the input audio objects to generate at least one clustered audio object.

8. The method of claim 1 , wherein step (e) includes the step of:
mixing audio content of at least one of the input audio objects with audio content of a speaker channel to generate at least one mixed speaker channel.

9. The method of claim 1 , wherein step (e) includes steps of:
defining an error threshold for at least one parameter indicated by metadata associated with each of the set of input audio objects; and
identifying as one of the reduced set of audio objects each of the input audio objects which is associated with metadata for which the at least one parameter exceeds the error threshold.

10. The method of claim 1 , also including a step of:
generating an additional object based audio program in response to the object based audio program and additional audio content indicative of at least one additional object, including by including the additional audio content in the additional object based audio program, as at least one additional object channel of said additional object based audio program, without performing a full decode, mix, and re-encode of the object based audio program.

11. A game console configured to generate an object based audio program indicative of game audio content, said game console including:
a first subsystem configured to determine at least one audio object channel and at least one speaker channel, wherein each said audio object channel is indicative of at least one audio object, at least one said audio object channel is indicative of game audio content, said at least one speaker channel is associated with a first speaker configuration and said at least one said speaker channel is indicative of additional game audio content; and
an encoding subsystem coupled to the first subsystem and configured to generate the object based audio program, including by encoding data indicative of each said audio object channel and each said speaker channel,
wherein the first subsystem is configured to:
identify a set of input audio objects which are indicative of game audio content, where the set consists of N audio objects and N is a positive integer; and
replace the set of input audio objects with a reduced set of audio objects, where the reduced set consists of M audio objects, M is a positive integer less than N, and said at least one audio object channel is indicative of the reduced set of audio objects,
and wherein the encoding subsystem is configured to generate the object based audio program such that said object based audio program is indicative of the reduced set of audio objects, and includes M object channels and at least one speaker channel associated with a second speaker configuration, the second speaker configuration being different from the first speaker configuration.

12. The game console of claim 11 , wherein said game console is configured to play a game, including by accessing data indicative of at least one said audio object, and wherein the first subsystem is configured to determine each said audio object channel and each said speaker channel during play of the game, and the encoding subsystem is configured to generate the object based audio program during play of said game.

13. The console of claim 11 , wherein the first subsystem is configured to perform said object clustering to determine, in response to configuration data asserted to the console, a limited number of audio object channels to be included in the object based audio program.

14. The console of claim 11 , wherein object-related metadata associated with an input object channel indicates that the input object channel is indicative of reverberating sound and/or sound emitting from a large source, and wherein the first subsystem is configured to perform said object clustering, in response to the object-related metadata, to mix audio content of said input object channel with audio co

Assignees

• Dolby Laboratories Licensing Corp

Inventors

• Hooks S Spencer
• Tsingos Nicolas R

Classifications

• G10L19/008 Primary

  Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing · CPC title

• H04S2400/01

  Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved · CPC title

• H04S7/00

  Indicating arrangements; Control arrangements, e.g. balance control · CPC title