Binaural rendering method and apparatus for decoding multi channel audio

Patent metadata

Field	Value
Publication number	US-11682402-B2
Application number	US-202117201943-A
Country	US
Kind code	B2
Filing date	Mar 15, 2021
Priority date	Jul 25, 2013
Publication date	Jun 20, 2023
Grant date	Jun 20, 2023

Abstract

Disclosed is a binaural rendering method and apparatus for decoding a multichannel audio signal. The binaural rendering method may include: extracting an early reflection component and a late reverberation component from a binaural filter; generating a stereo audio signal by performing binaural rendering of a multichannel audio signal base on the early reflection component; and applying the late reverberation component to the generated stereo audio signal.

First claim

What is claimed is:

1. A binaural rendering method for multichannel audio signal in time domain, comprising:
identifying an early reflection and a late reverberation for a binaural rendering; and
performing binaural rendering to convert a multichannel signal to a stereo signal based on the early reflection and the late reverberation, and
wherein the multichannel audio signal corresponds to a QMF domain, and
wherein an audio signal of the QMF domain and a direct sound and an early reflection sound of the QMF domain are processed according to a bandwise partitioned fast convolution for the binaural rendering.

2. The binaural rendering method of claim 1 ,
wherein the binaural rendering is performed based on binaural parameter with respect to each loudspeaker location of the multichannel signal.

3. The binaural rendering method of claim 1 ,
wherein the binaural rendering is performed by applying the late reverberating after applying the early reflection into the multichannel signal.

4. The binaural rendering method of claim 1 ,
wherein the late reverberation is extracted based on a binaural room impulse response (BRIR) for binaural rendering.

5. A binaural rendering method in frequency domain, comprising:
determining an early reflection and a late reverberation for a binaural rendering;
converting a multichannel audio signal to a stereo audio signal by performing binaural rendering for the multichannel audio signal,
wherein the binaural rendering is performed based on early reflection and late reverberation,
wherein the multichannel audio signal corresponds to a QMF domain, and
wherein an audio signal of the QMF domain and a direct sound and an early reflection sound of the QMF domain are processed according to a bandwise partitioned fast convolution for the binaural rendering.

6. The binaural rendering method of claim 5 ,
wherein the early reflection is determined based on a binaural room impulse responses (BRIR) in the frequency domain.

7. The binaural rendering method of claim 5 ,
wherein the late reverberation is scaled based on a result of the analyzing the multichannel audio signal.

8. A binaural renderer in frequency domain, comprising:
one or more processor configured to:
determine an early reflection and a late reverberation for a binaural rendering;
convert a multichannel audio signal to a stereo audio signal by performing binaural rendering for the multichannel audio signal,
wherein the binaural rendering is performed based on early reflection and late reverberation, and
wherein the multichannel audio signal corresponds to a QMF domain, and
wherein an audio signal of the QMF domain and a direct sound and an early reflection sound of the QMF domain are processed according to a bandwise partitioned fast convolution for the binaural rendering.

9. The binaural renderer of claim 8 ,
wherein the early reflection is determined based on a binaural room impulse responses (BRIR) in the frequency domain.

10. The method of claim 8 ,
wherein the late reverberation is scaled based on a result of the analyzing the multichannel audio signal.

Assignees

• Electronics & Telecommunications Res Inst

Inventors

• Lee Yong Ju
• Seo Jeong Il
• Yoo Jae Hyoun
• Beack Seung Kwon
• Sung Jong Mo
• Lee Tae Jin
• Kang Kyeong Ok
• Kim Jin Woong
• Park Tae Jin
• Jang Dae Young
• Choi Keun Woo

Classifications

• H04S2400/01

  Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved · CPC title

• G10L19/008 Primary

  Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing · CPC title

• H04S2400/03

  Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1 (H04S2400/01 takes precedence) · CPC title

• H04S7/00

  Indicating arrangements; Control arrangements, e.g. balance control · CPC title

• H04S7/30

  Control circuits for electronic adaptation of the sound field · CPC title