Binaural dialogue enhancement

Patent metadata

Field	Value
Publication number	US-2024406650-A1
Application number	US-202418606040-A
Country	US
Kind code	A1
Filing date	Mar 15, 2024
Priority date	Jan 29, 2016
Publication date	Dec 5, 2024
Grant date	—

Abstract

Methods for dialogue enhancing audio content, comprising providing a first audio signal presentation of the audio components, providing a second audio signal presentation, receiving a set of dialogue estimation parameters configured to enable estimation of dialogue components from the first audio signal presentation, applying said set of dialogue estimation parameters to said first audio signal presentation, to form a dialogue presentation of the dialogue components; and combining the dialogue presentation with said second audio signal presentation to form a dialogue enhanced audio signal presentation for reproduction on the second audio reproduction system, wherein at least one of said first and second audio signal presentation is a binaural audio signal presentation.

First claim

1 . A method for processing immersive audio content having one or more audio components for dialogue enhancement, wherein each audio component is associated with a spatial location, the method comprising:
obtaining a first audio signal presentation of the audio components intended for reproduction on a first audio reproduction system; obtaining a set of presentation transform parameters configured to enable transformation of said first audio signal presentation into said second audio signal presentation intended for reproduction on a second audio reproduction system; obtaining a set of dialogue estimation parameters configured to enable estimation of dialogue components from the first audio signal presentation; transforming the first audio signal presentation to form the second audio signal presentation based on the set of presentation transform parameters; forming an acoustic environment simulation input signal based on the first audio signal presentation; applying an acoustic environment simulation to the acoustic environment simulation input signal to generate an acoustic environment simulation output signal; applying the set of dialogue estimation parameters to the first audio signal presentation to form a dialogue presentation of the dialogue components; and summing the dialogue presentation with the second audio signal presentation and the acoustic environment simulation output signal to form a dialogue enhanced audio signal presentation for reproduction on the second audio reproduction system; wherein the second audio signal presentation is a binaural audio signal presentation.

2 . The method according to claim 1 , wherein the first audio signal presentation is a multi-channel stereo or surround audio signal presentation.

3 . The method according to claim 1 , wherein the second audio signal presentation is an anechoic or echoic binaural audio signal presentation.

4 . The method according to claim 1 , wherein the set of presentation transform parameters include parameters to enable transformation of said first audio signal presentation into an acoustic environment simulation input signal.

5 . The method according to claim 1 , wherein the simulation of the acoustic environment includes simulation of reverberation.

6 . The method according to claim 1 , wherein the acoustic environment simulation input signal corresponds to the first audio signal presentation.

7 . The method according to claim 1 , further comprising receiving a set of dialogue transform parameters and applying the set of dialogue transform parameters before or after application of said set of dialogue estimation parameters to form a transformed dialogue presentation corresponding to the second audio signal presentation.

8 . The method according to claim 1 , wherein said dialogue estimation parameters are configured to also perform a presentation transform, so that the dialogue presentation corresponds to the second audio signal presentation.

9 . The method according to claim 1 , further comprising applying a level modification by a factor G to the dialogue presentation.

10 . The method according to claim 9 , wherein a first processing is applied when G is less than a given threshold, and a second processing is applied when G is greater than said threshold.

11 . The method according to claim 10 , wherein the threshold is equal to zero, wherein G<0 represents attenuation of dialogue and G>0 represents enhancement of dialogue.

12 . The method according to claim 1 , wherein the dialogue presentation is a mono presentation, and further comprising:
receiving positional data related to said dialogue components, rendering the mono dialogue presentation using the positional data before combining with the second audio signal presentation.

13 . The method according to claim 12 , wherein the rendering includes either:
selecting head related transfer functions (HRTFs) from a library based on the positional data, and applying the selected HRTFs to the mono dialogue presentation; or amplitude panning.

14 . A non-transitory computer-readable storage medium comprising a set of instructions, wherein, when executed by one or more processors of an audio signal processing device, the instructions cause the one or more processors to perform the method of claim 1 .

Assignees

• Dolby Laboratories Licensing Corp
• Dolby Int Ab

Inventors

• Samuelsson Leif Jonas
• Breebaart Dirk Jeroen
• Cooper David Matthew
• Koppens Jeroen

Classifications

• H04S7/303

  Tracking of listener position or orientation · CPC title

• H04R5/04

  Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)} · CPC title

• H04S2420/03

  Application of parametric coding in stereophonic audio systems · CPC title

• H04S2420/01

  Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD] · CPC title

• H04S3/02

  of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other · CPC title