Methods and systems for interactive rendering of object based audio

Patent metadata

Field	Value
Publication number	US-11081118-B2
Application number	US-201916718053-A
Country	US
Kind code	B2
Filing date	Dec 17, 2019
Priority date	Apr 3, 2013
Publication date	Aug 3, 2021
Grant date	Aug 3, 2021

Abstract

Methods for generating an object based audio program which is renderable in a personalizable manner, e.g., to provide an immersive, perception of audio content of the program. Other embodiments include steps of delivering (e.g., broadcasting), decoding, and/or rendering such a program. Rendering of audio objects indicated by the program may provide an immersive experience. The audio content of the program may be indicative of multiple object channels (e.g., object channels indicative of user-selectable and user-configurable objects, and typically also a default set of objects which will be rendered in the absence of a selection by a user) and a bed of speaker channels. Another aspect is an audio processing unit (e.g., encoder or decoder) configured to perform, or which includes a buffer memory which stores at least one frame (or other segment) of an object based audio program (or bitstream thereof) generated in accordance with, any embodiment of the method.

First claim

What is claimed is:

1. A method of rendering audio content determined by an object based audio program, wherein the program includes at least one bed of speaker channels, a set of object channels, and object related metadata, said method comprising:
(a) determining a selected subset of the set of object channels;
(b) providing a menu of selectable mixes of audio content, each of the selectable mixes being indicative of a different mix of audio content of one said bed of speaker channels and audio content of a subset of the set of object channels, wherein at least a part of the object related metadata is indicative of at least one constraint or condition on which of the selectable mixes are included in the menu;
(c) selecting one of the selectable mixes from the menu, thereby determining the selected subset of the set of object channels; and
(d) rendering audio content determined by the object based audio program based on the object related metadata, and determining a mix of first audio content based on the bed of speaker channels and the selected subset of the set of object channels.

2. The method of claim 1 , wherein at least a part of the object related metadata is indicative of identification of and relationship between each of the object channels, and said at least a part of the object related metadata determines the least one constraint or condition on which of the selectable mixes are included in the menu.

3. A system for rendering audio content determined by an object based audio program, wherein the program includes at least one bed of speaker channels, a set of object channels, and object related metadata, said system comprising:
a first subsystem configured to determine a selected subset of the set of object channels;
a second subsystem configured to provide a menu of selectable mixes of audio content, each of the selectable mixes being indicative of a different mix of audio content of one said bed of speaker channels and audio content of a subset of the set of object channels, wherein at least a part of the object related metadata is indicative of at least one constraint or condition on which of the selectable mixes are included in the menu;
a third subsystem configured to select one of the selectable mixes from the menu, thereby determining the selected subset of the set of object channels; and
a fourth subsystem configured to render audio content determined by the object based audio program based on the object related metadata, and determine a mix of first audio content based on the bed of speaker channels and the selected subset of the set of object channels.

Assignees

• Dolby Int Ab
• Dolby Laboratories Licensing Corp

Inventors

• France Robert Andrew
• Ziegler Thomas
• Mehta Sripal S
• Dowell Andrew Jonathan
• Saungsomboon Prinyar
• Dwyer Michael David
• Farahani Farhad
• Tsingos Nicolas R
• Sanchez Freddie

Classifications

• H04S7/30

  Control circuits for electronic adaptation of the sound field · CPC title

• G10L19/20

  using sound class specific coding, hybrid encoders or object based coding · CPC title

• H04S2420/03

  Application of parametric coding in stereophonic audio systems · CPC title

• G10L19/167

  Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes · CPC title

• H04S2400/15

  Aspects of sound capture and related signal processing for recording or reproduction · CPC title