Binaural rendering method and apparatus for decoding multi channel audio

Patent metadata

Field	Value
Publication number	US-2016232902-A1
Application number	US-201615131623-A
Country	US
Kind code	A1
Filing date	Apr 18, 2016
Priority date	Jul 25, 2013
Publication date	Aug 11, 2016
Grant date	—

Abstract

Disclosed is a binaural rendering method and apparatus for decoding a multichannel audio signal. The binaural rendering method may include: extracting an early reflection component and a late reverberation component from a binaural filter; generating a stereo audio signal by performing binaural rendering of a multichannel audio signal base on the early reflection component; and applying the late reverberation component to the generated stereo audio signal.

First claim

What is claimed is:

1 . A binaural rendering method, comprising:
extracting an early reflection and a late reverberation for a binaural rendering; applying the early reflection into each of multichannel audio signal of M channels; and applying the late reverberation to the multichannel audio signal of M channels.

2 . The method of claim 1 , wherein the multichannel audio signal of M channels is determined by down-mixing multichannel audio signal of N channels.

3 . The method of claim 1 , wherein the multichannel audio signal of M channels is performed binaural rendering by applying the early reflection for each channel of the multichannel audio signal of M channels.

4 . The method of claim 1 , wherein the early reflection and the late reverberation transited frequency-dependently is extracted by analyzing a late reverberation time based on a BRIR of the stereo audio signal generated from the multichannel audio signal of M channels.

5 . The method of claim 1 , wherein the extracting of the early reflection and the late reverberation is extracted based on a binaural room impulse response (BRIR) for binaural rendering.

6 . The method of claim 1 , wherein the binaural rendering is performed in a QMF domain or time domain.

7 . A binaural rendering method, comprising:
extracting an early reflection and a late reverberation; down-mixing a multichannel audio signal of N channels to a multichannel audio signal of M channels; applying the early reflection into each of M channels; and applying the late reverberation into a mixing result of the each of M channel.

8 . The method of claim 7 , further comprising:
independently performing binaural rendering on each of a plurality of monotype audio signals constituting the multichannel audio signal of M channels.

9 . The method of claim 7 , wherein the early reflection and the late reverberation is extracted by analyzing a binaural room impulse response (BRIR) for binaural rendering.

10 . The method of claim 7 , wherein the early reflection and the late reverberation transited frequency-dependently is extracted by analyzing a late reverberation time based on a BRIR of the stereo audio signal generated from the multichannel audio signal of M channels.

11 . A binaural rendering apparatus, comprising:
a processor configured to: extract an early reflection and a late reverberation for a binaural rendering; apply the early reflection into each of multichannel audio signal of M channels; and apply the late reverberation to the multichannel audio signal of M channels.

12 . The binaural rendering apparatus of claim 11 , wherein the multichannel audio signal of M channels is determined by down-mixing multichannel audio signal of N channels.

13 . The binaural rendering apparatus of claim 11 , wherein the processor is configured to perform binaural rendering of the multichannel audio signal of M channelsby applying the early reflection for each channel of the multichannel audio signal of M channels.

14 . The binaural rendering apparatus of claim 11 , wherein the processor is configured to independently perform binaural rendering on each of a plurality of monotype audio signals constituting the multichannel audio signal of M channels.

15 . The binaural rendering apparatus of claim 11 , wherein the processor is configured to extract the early reflection and the late reverberation from the binaural filter by analyzing a binaural room impulse response (BRIR) for binaural rendering.

16 . The binaural rendering apparatus of claim 11 , wherein the binaural filter converter is configured to extract the early reflection and the late reverberation frequency-dependently transited by analyzing a late reverberation time based on a BRIR of the stereo audio signal generated from the multichannel audio signal of M channels.

17 . The binaural rendering apparatus of claim 11 , wherein the processor is configured to store a binaural filter for binaural rendering.

Assignees

• Electronics & Telecommunications Res Inst

Inventors

• Lee Yong Ju
• Seo Jeong Il
• Yoo Jae Hyoun
• Beack Seung Kwon
• Sung Jong Mo
• Lee Tae Jin
• Kang Kyeong Ok
• Kim Jin Woong
• Park Tae Jin
• Jang Dae Young
• Choi Keun Woo

Classifications

• H04S7/30

  Control circuits for electronic adaptation of the sound field · CPC title

• H04S2400/01

  Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved · CPC title

• H04S2400/03

  Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1 (H04S2400/01 takes precedence) · CPC title

• G10L19/008 Primary

  Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing · CPC title

• H04S7/00

  Indicating arrangements; Control arrangements, e.g. balance control · CPC title