Binaural rendering method and apparatus for decoding multi channel audio

Patent metadata

Field	Value
Publication number	US-10950248-B2
Application number	US-202016841428-A
Country	US
Kind code	B2
Filing date	Apr 6, 2020
Priority date	Jul 25, 2013
Publication date	Mar 16, 2021
Grant date	Mar 16, 2021

Abstract

Disclosed is a binaural rendering method and apparatus for decoding a multichannel audio signal. The binaural rendering method may include: extracting an early reflection component and a late reverberation component from a binaural filter; generating a stereo audio signal by performing binaural rendering of a multichannel audio signal base on the early reflection component; and applying the late reverberation component to the generated stereo audio signal.

First claim

What is claimed is:

1. A binaural rendering method in time domain, comprising:
identifying an early reflection and a late reverberation for a binaural rendering;
performing binaural rendering to convert a loudspeaker signal to a stereo signal based on based on a binaural parameter for each loudspeaker location, using a binaural filter in time domain,
wherein the binaural filter uses the early reflection and the late reverberation for a binaural rendering.

2. The binaural rendering method of claim 1 , wherein the binaural rendering is performed based on binaural parameter with respect to each loudspeaker location of the loudspeaker signal.

3. The binaural rendering method of claim 1 , wherein the binaural rendering is performed by applying the late reverberating after applying the early reflection into the loudspeaker signal.

4. The binaural rendering method of claim 1 , wherein the late reverberation is extracted based on a binaural room impulse response (BRIR) for binaural rendering.

5. A binaural rendering method in frequency domain, comprising:
identifying a loudspeaker signal;
identifying an early reflection and a late reverberation for a binaural rendering;
converting the loudspeaker signal to a stereo audio signal using a binaural render based on the early reflection and the late reverberation,
wherein the binaural render consists of a variable order filtering in frequency domain (VOFF), a sparse frequency reverberator (SFR), and a QMF domain Tapped-Delay Line (QTDL).

6. The binaural rendering method of claim 5 , wherein the early reflection is processed based on bandwise partitioned convolution for binaural rendering.

7. The binaural rendering method of claim 5 , wherein the early reflection is determined based on a binaural room impulse responses (BRIR) in the frequency domain.

8. The binaural rendering method of claim 5 , wherein the late reverberation is scaled based on a result of the analyzing the loudspeaker signal.

9. A binaural renderer in frequency domain, comprising:
one or more processor configured to:
identify an early reflection and a late reverberation for a binaural rendering;
convert a loudspeaker signal to a stereo audio signal by performing binaural rendering,
wherein the binaural rendering is performed based on early reflection and late reverberation,
wherein the binaural rendering is performed by a binaural render including a variable order filtering in frequency domain (VOFF), a sparse frequency reverberator (SFR), and a QMF domain Tapped-Delay Line (QTDL).

10. The binaural renderer of claim 9 , wherein the early reflection is processed based on bandwise partitioned convolution for binaural rendering.

11. The binaural renderer of claim 9 , wherein the early reflection is determined based on a binaural room impulse responses (BRIR) in the frequency domain.

12. The method of claim 9 , wherein the late reverberation is scaled based on a result of the analyzing the loudspeaker signal.

Assignees

• Electronics & Telecommunications Res Inst

Inventors

• Lee Yong Ju
• Seo Jeong Il
• Yoo Jae Hyoun
• Beack Seung Kwon
• Sung Jong Mo
• Lee Tae Jin
• Kang Kyeong Ok
• Kim Jin Woong
• Park Tae Jin
• Jang Dae Young
• Choi Keun Woo

Classifications

• G10L19/008 Primary

  Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing · CPC title

• H04S7/00

  Indicating arrangements; Control arrangements, e.g. balance control · CPC title

• H04S2400/01

  Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved · CPC title

• H04S2400/03

  Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1 (H04S2400/01 takes precedence) · CPC title

• H04S7/30

  Control circuits for electronic adaptation of the sound field · CPC title