Binaural rendering method and apparatus for decoding multi channel audio

Patent metadata

Field	Value
Publication number	US-10614820-B2
Application number	US-201916245024-A
Country	US
Kind code	B2
Filing date	Jan 10, 2019
Priority date	Jul 25, 2013
Publication date	Apr 7, 2020
Grant date	Apr 7, 2020

Abstract

Disclosed is a binaural rendering method and apparatus for decoding a multichannel audio signal. The binaural rendering method may include: extracting an early reflection component and a late reverberation component from a binaural filter; generating a stereo audio signal by performing binaural rendering of a multichannel audio signal base on the early reflection component; and applying the late reverberation component to the generated stereo audio signal.

First claim

What is claimed is:

1. A binaural renderer in time domain, comprising:
one or more processor configured to:
identify a loudspeaker signal; and
perform binaural rendering by converting the loudspeaker signal into the stereo audio signal based on a binaural parameter for each loudspeaker location, using a binaural filter in time domain,
wherein the binaural filter applies early reflection and a late reverberation for a binaural rendering;
wherein a transition from the early reflection to the late reverberation is related to number of QMF bands.

2. The binaural renderer of claim 1 , wherein the binaural rendering is performed by applying the late reverberating after applying the early reflection into the multichannel signal.

3. The binaural renderer of claim 1 , wherein the late reverberation is extracted based on a binaural room impulse response (BRIR) for binaural rendering.

4. A binaural renderer in frequency domain, comprising:
one or more processor configured to:
determine an early reflection and a late reverberation for a binaural rendering;
convert a multichannel audio signal to a stereo audio signal by performing binaural rendering for the multichannel audio signal using a binaural render in frequency domain,
wherein the binaural rendering is performed based on early reflection and late reverberation,
wherein the binaural render consists of a variable order filtering in frequency domain (VOFF), a sparse frequency reverberator (SFR), and a QMF domain Tapped-Delay Line (QTDL).

5. The binaural renderer of claim 4 , wherein the early reflection is processed based on bandwise partitioned convolution for binaural rendering.

6. The binaural renderer of claim 4 , wherein the early reflection is determined based on a binaural room impulse responses (BRIR) in the frequency domain.

7. The method of claim 4 , wherein the late reverberation is scaled based on a result of the analyzing the multichannel audio signal.

8. A binaural rendering in frequency domain, comprising:
determining an early reflection and a late reverberation for a binaural rendering;
converting a multichannel audio signal to a stereo audio signal by performing binaural rendering for the multichannel audio signal using a binaural render in frequency domain,
wherein the binaural rendering is performed based on early reflection and late reverberation,
wherein the binaural render consists of a variable order filtering in frequency domain (VOFF), a sparse frequency reverberator (SFR), and a QMF domain Tapped-Delay Line (QTDL).

9. The binaural rendering method of claim 8 , wherein the early reflection is processed based on bandwise partitioned convolution for binaural rendering.

10. The binaural rendering method of claim 8 , wherein the early reflection is determined based on a binaural room impulse responses (BRIR) in the frequency domain.

11. The binaural rendering method of claim 8 , wherein the late reverberation is scaled based on a result of the analyzing the multichannel audio signal.

Assignees

• Electronics & Telecommunications Res Inst

Inventors

• Lee Yong Ju
• Seo Jeong Il
• Yoo Jae Hyoun
• Beack Seung Kwon
• Sung Jong Mo
• Lee Tae Jin
• Kang Kyeong Ok
• Kim Jin Woong
• Park Tae Jin
• Jang Dae Young
• Choi Keun Woo

Classifications

• G10L19/008 Primary

  Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing · CPC title

• H04S7/00

  Indicating arrangements; Control arrangements, e.g. balance control · CPC title

• H04S2400/01

  Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved · CPC title

• H04S2400/03

  Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1 (H04S2400/01 takes precedence) · CPC title

• H04S7/30

  Control circuits for electronic adaptation of the sound field · CPC title