Binaural rendering method and apparatus for decoding multi channel audio

Patent metadata

Field	Value
Publication number	US-9319819-B2
Application number	US-201414341554-A
Country	US
Kind code	B2
Filing date	Jul 25, 2014
Priority date	Jul 25, 2013
Publication date	Apr 19, 2016
Grant date	Apr 19, 2016

Abstract

Disclosed is a binaural rendering method and apparatus for decoding a multichannel audio signal. The binaural rendering method may include: extracting an early reflection component and a late reverberation component from a binaural filter; generating a stereo audio signal by performing binaural rendering of a multichannel audio signal base on the early reflection component; and applying the late reverberation component to the generated stereo audio signal.

First claim

What is claimed is:

1. A binaural rendering method, comprising:
extracting an early reflection component and a late reverberation component from a binaural filter;
generating a stereo audio signal by performing binaural rendering of a multichannel audio signal base on the early reflection component; and
applying the late reverberation component to the generated stereo audio signal.

2. The method of claim 1 , wherein the generating of the stereo audio signal comprises generating the stereo audio signal by performing binaural rendering of a multichannel audio signal of M channels down-mixed from a multichannel audio signal of N channels.

3. The method of claim 1 , wherein the generating of the stereo audio signal comprises performing binaural rendering of the multichannel audio signal by applying the early reflection component for each channel of the multichannel audio signal.

4. The method of claim 1 , wherein the generating of the stereo audio signal comprises independently performing binaural rendering on each of a plurality of monotype audio signals constituting the multichannel audio signal.

5. The method of claim 1 , wherein the extracting of the early reflection component and the late reverberation component comprises extracting the early reflection component and the late reverberation component from the binaural filter by analyzing a binaural room impulse response (BRIR) for binaural rendering.

6. The method of claim 1 , wherein the extracting of the early reflection component and the late reverberation component comprises extracting the early reflection component and the late reverberation component frequency-dependently transited by analyzing a late reverberation time based on a BRIR of the stereo audio signal generated from the multichannel audio signal.

7. A binaural rendering method, comprising:
extracting an early reflection component and a late reverberation component from a binaural filter;
down-mixing a multichannel audio signal of N channels to a multichannel audio signal of M channels;
generating a stereo audio signal by applying the early reflection component for each of M channels of the down-mixed multichannel audio signal and thereby performing binaural rendering; and
applying the late reverberation component to the generated stereo audio signal.

8. The method of claim 7 , wherein the generating of the stereo audio signal comprises independently performing binaural rendering on each of a plurality of monotype audio signals constituting the multichannel audio signal of M channels.

9. The method of claim 7 , wherein the extracting of the early reflection component and the late reverberation component comprises extracting the early reflection component and the late reverberation component from the binaural filter by analyzing a binaural room impulse response (BRIR) for binaural rendering.

10. The method of claim 7 , wherein the extracting of the early reflection component and the late reverberation component comprises extracting the early reflection component and the late reverberation component frequency-dependently transited by analyzing a late reverberation time based on a BRIR of the stereo audio signal generated from the multichannel audio signal.

11. A binaural rendering apparatus, comprising:
a binaural filter converter configured to extract an early reflection component and a late reverberation component from a binaural filter;
a binaural renderer configured to generate a stereo audio signal by performing binaural rendering of a multichannel audio signal base on the early reflection component; and
a late reverberation applier configured to apply the late reverberation component to the generated stereo audio signal.

12. The binaural rendering apparatus of claim 11 , wherein the binaural renderer is configured to generate the stereo audio signal by performing binaural rendering of a multichannel audio signal of M channels down-mixed from a multichannel audio signal of N channels.

13. The binaural rendering apparatus of claim 11 , wherein the binaural renderer is configured to perform binaural rendering of the multichannel audio signal by applying the early reflection component for each channel of the multichannel audio signal.

14. The binaural rendering apparatus of claim 11 , wherein the binaural renderer is configured to independently perform binaural rendering on each of a plurality of monotype audio signals constituting the multichannel audio signal.

15. The binaural rendering apparatus of claim 11 , wherein the binaural filter converter is configured to extract the early reflection component and the late reverberation component from the binaural filter by analyzing a binaural room impulse response (BRIR) for binaural rendering.

16. The binaural rendering apparatus of claim 11 , wherein the binaural filter converter is configured to extract the early reflection component and the late reverberation component frequency-dependently transited by analyzing a late reverberation time based on a BRIR of the stereo audio signal generated from the multichannel audio signal.

17. The binaural rendering apparatus of claim 11 , further comprising:
a binaural filter storage configured to store the binaural filter for binaural rendering.

Assignees

• Korea Electronics Telecomm
• Elect & Telecomm Research Inst

Inventors

• Lee Yong Ju
• Seo Jeong Il
• Yoo Jae Hyoun
• Beack Seung Kwon
• Sung Jong Mo
• Lee Tae Jin
• Kang Kyeong Ok
• Kim Jin Woong
• Park Tae Jin
• Jang Dae Young
• Choi Keun Woo

Classifications

• H04S7/00 Primary

  Indicating arrangements; Control arrangements, e.g. balance control · CPC title

• H04S7/30

  Control circuits for electronic adaptation of the sound field · CPC title

• H04S2400/03

  Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1 (H04S2400/01 takes precedence) · CPC title

• H04S2400/01

  Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved · CPC title

• G10L19/008 Primary

  Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing · CPC title