Grouping and transport of audio objects

Patent metadata

Field	Value
Publication number	US-2020275230-A1
Application number	US-201816753698-A
Country	US
Kind code	A1
Filing date	Sep 24, 2018
Priority date	Oct 4, 2017
Publication date	Aug 27, 2020
Grant date	—

Abstract

An apparatus for audio signal processing audio objects within at least one audio scene, the apparatus comprising at least one processor configured to:define for at least one time period at least one contextual grouping comprising at least two of a plurality of audio objects and at least one further audio object of the plurality of audio objects outside of the at least one contextual grouping, the plurality of audio objects within at least one audio scene; anddefine with respect to the at least one contextual grouping at least one first parameter and/or parameter rule type which is configured to be applied with respect to a common element associated with the at least two of the plurality of audio objects and wherein the at least one first parameter and/or parameter rule type is configured to be applied with respect to individual element associatedwith the at least one further audio object outside of the at least one contextual grouping, the at least one first parameter and/or parameter rule type being applied in audio rendering of both the at least two of the plurality of audio objects and the at least one further audio object.

First claim

1 .- 25 (canceled)

26 . A method comprising:
defining for at least one time period at least one contextual grouping comprising at least two of a plurality of audio objects and at least one further audio object of the plurality of audio objects outside of the at least one contextual grouping, the plurality of audio objects within at least one audio scene; and defining with respect to the at least one contextual grouping at least one first parameter and/or parameter rule type which is configured to be applied with respect to a common element associated with the at least two of the plurality of audio objects and wherein the at least one first parameter and/or parameter rule type is configured to be applied with respect to individual element associated with the at least one further audio object outside of the at least one contextual grouping, the at least one first parameter and/or parameter rule type being applied in audio rendering of both the at least two of the plurality of audio objects and the at least one further audio object.

27 . The method as claimed in claim 26 , further comprising:
defining with respect to the at least one contextual grouping at least one second parameter and/or parameter rule type configured to be applied with respect to individual elements associated with the at least two of the plurality of audio objects in audio rendering of the at least two of the plurality of audio objects; and defining the at least one second parameter and/or parameter rule type is configured to be applied with respect to individual elements associated with the at least one further audio object of the plurality of audio objects outside of the at least one contextual grouping.

28 . The method as claimed in claim 26 , further comprising:
defining for at least one further time period at least one further contextual grouping comprising a further at least two of the plurality of audio objects; and defining with respect to the at least one further contextual grouping at least one further first parameter and/or parameter rule type which is configured to be applied with respect to a further common element associated with the further at least two of the plurality of audio objects in audio rendering of the further at least two of the plurality of audio objects.

29 . The method as claimed in claim 28 , wherein the at least two of the plurality of audio objects and the further at least two of the plurality of audio objects comprises at least one audio object in common.

30 . The method as claimed in claim 29 , further comprising selecting for the at least one object in common one of:
the at least one parameter and/or parameter rule type, to be applied with respect to the common element associated with the at least two of the plurality of audio objects; or the at least one further parameter and/or parameter rule type, to be applied with respect to the further common element associated with the further at least two of the plurality of audio objects, based on at least one of: a volume determination; and a prior contextual grouping of the at least one additional contextual grouping and the at least one contextual grouping.

31 . The method as claimed in claim 26 , further comprising defining with respect to the at least one contextual grouping the common element as at least one common position or area.

32 . The method as claimed in claim 26 , further comprising encoding a downmix of audio signals associated with the at least one contextual grouping based on at least one of:
a distance within an audio scene relative to a rendering location; and a orientation of the at least one contextual grouping relative to a rendering location.

33 . The method as claimed in claim 26 , further comprising:
defining the common element with respect to the at least one contextual grouping; and transmitting and/or storing the defined common element and audio signals associated with the at least two of the plurality of audio objects.

34 . A method for rendering audio signals associated with a plurality of audio objects within at least one audio scene, the method comprising:
determining for at least one time period at least one contextual grouping comprising at least two of the plurality of audio objects and at least one further audio object of the plurality of audio objects outside of the at least one contextual grouping; and determining with respect to the at least one contextual grouping at least one first parameter and/or parameter rule type; determining at least one common element with respect to the at least one contextual grouping; determining an individual element with respect to the at least one further audio object of the plurality of audio objects outside of the at least one contextual grouping; rendering audio signals associated with the at least two of the plurality of audio objects by applying the at least one first parameter and/or parameter rule type with respect to the common element to audio signals associated with the at least two of the plurality of audio objects; rendering audio signals associated with the at least one further audio object of the plurality of audio objects outside of the at least one contextual grouping by applying the at least one first parameter and/or parameter rule type with respect to the individual element to audio signals associated with the at least one further audio object; and combining the rendering of audio signals associated with the at least two of the plurality of audio objects with the rendering of audio signals associated with the at least one further audio object of the plurality of audio objects outside of the at least one contextual grouping.

35 . The method as claimed in claim 34 , further comprising:
determining at least one second parameter and/or parameter rule type; rendering audio signals associated with the at least two of the plurality of audio objects and the at least one further audio object of the plurality of audio objects outside of the at least one contextual grouping by applying the at least one second parameter and/or parameter rule type with respect to individual elements associated with each audio object to audio signals associated with each audio object; and combining rendering audio signals associated with the at least two of the plurality of audio objects and the at least one further audio object of the plurality of audio objects outside of the at least one contextual grouping with the combined rendering.

36 . The method as claimed in claim 34 , further comprising determining the common element as at least one common position or area.

37 . The method as claimed in claim 34 , further comprising determining a downmix of audio signals associated with the at least one contextual grouping, wherein applying the at least one first parameter and/or parameter rule type with respect to the common element to audio signals associated with the at least two of the plurality of audio objects comprises applying the at least one first parameter and/or parameter rule type with respect to the common element to the downmix of audio signals associated with the at least two of the plurality of audio objects.

38 . An apparatus for audio signal processing audio objects within at least one audio scene, the apparatus comprising at least one processor and a memory storing program code, the at least one processor is configured, upon execution of the program code, to:
define for at least one time period at least one contextual grouping comprising at least two of a plurality of audio objects and at least one further audio object of the plurality of audio objects outside of the at least one conte

Assignees

• Nokia Technologies Oy

Inventors

• Laaksonen Lasse
• Tammi Mikko
• Vilermo Miikka
• Lehtiniemi Arto

Classifications

• G10L19/022

  Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/165 Primary

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• H04S7/30 Primary

  Control circuits for electronic adaptation of the sound field · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title