Method, terminal, system for audio encoding/decoding/codec

Patent metadata

Field	Value
Publication number	US-9812139-B2
Application number	US-201514596753-A
Country	US
Kind code	B2
Filing date	Jan 14, 2015
Priority date	Aug 20, 2013
Publication date	Nov 7, 2017
Grant date	Nov 7, 2017

Abstract

Audio encoding methods/terminals, audio decoding methods/terminals, and audio codec systems are provided. A plurality of audio signals that are continuous is obtained. It is determined whether each audio signal of the plurality of audio signals includes a designated signal type, according to an audio parameter of each audio signal. A marked audio encoding stream is obtained by performing a marking to each audio signal as having or not having the designated signal type. The marking is used, at a decoding terminal, to perform an enhancement-process to one or more audio signals having the designated signal type. The enhancement-process is not performed to audio signals that do not have the designated signal type.

First claim

What is claimed is:

1. An audio encoding method, comprising:
obtaining a plurality of audio signals that are continuous;
determining a type of each audio signal of the plurality of audio signals, according to an audio parameter of each audio signal, wherein the type of each audio signal is one of a designated signal type, a voice signal type, and a mute signal type; and
obtaining a marked audio encoding stream by performing a marking to each audio signal as having or not having the designated signal type, wherein the marking is used at a decoding terminal to perform an enhancement-process to one or more audio signals having the designated signal type, wherein the enhancement-process is not performed to audio signals that do not have the designated signal type,
wherein the designated signal type is an analogous audio signal, and the step of determining the type of each audio signal comprises:
obtaining the audio parameter of each audio signal, wherein the audio parameter comprises logarithmic energy, a high-zero-crossing-rate-ratio (HZCRR), and a spectral flux (SF);
determining that an audio signal is the mute signal type, when the logarithmic energy of the audio signal is less than a first threshold value;
determining that an audio signal is the voice signal type, when the logarithmic energy of the audio signal is no less than the first threshold value, and the HZCRR is more than a second threshold value; and
determining that an audio signal is the designated signal type, when the logarithmic energy of the audio signal is no less than the first threshold value, the HZCRR is no more than the second threshold value, and the spectral flux is more than a third threshold value.

2. The method according to claim 1 , wherein the designated signal type is an analogous audio signal.

3. The method according to claim 1 , further comprising:
obtaining the marked audio encoding stream;
obtaining the plurality of audio signals from the marked audio encoding stream and obtaining the marking of at least a portion of the plurality of audio signals;
performing the enhancement-process to one or more audio signals having the designated signal type according to the marking, to obtain an enhanced audio signal; and
adding the enhanced audio signal into a decoding stream of the plurality of audio signals to obtain an audio decoding signal.

4. The method according to claim 3 , wherein the designated signal type is an analogous audio signal, and wherein the step of performing the enhancement-process comprises:
performing a frequency-spectrum enhancement and an acoustic-image extension to the analogous audio signal.

5. The method according to claim 4 , wherein the step of processing the frequency-spectrum enhancement to the analogous audio signal comprises:
obtaining a frequency of each audio signal;
determining a frequency-spectrum enhancement coefficient of each audio signal, according to the frequency of each audio signal; and
performing the frequency-spectrum enhancement to each audio signal, according to the frequency-spectrum enhancement coefficient of each audio signal.

6. The method according to claim 4 , wherein performing the acoustic-image extension to the analogous audio signal comprises:
using a delaying parameter to perform the acoustic-image extension to the analogous audio signal.

7. An audio decoding method, comprising:
obtaining an audio encoding stream to be decoded;
obtaining a plurality of audio signals that are continuous and an audio parameter of each audio signal, from the audio encoding stream;
determining whether each audio signal includes a designated signal type, including:
when the audio encoding stream includes a marking for each audio signal representing a type of the audio signal, determining whether each audio signal includes the designated signal type according to the marking; and
when the audio encoding stream does not include the marking for each audio signal representing the type of the audio signal, determining whether each audio signal includes the designated signal type according to the audio parameter of each audio signal;

performing an enhancement-process to one or more audio signals having the designated signal type to obtain one or more enhanced audio signals; and
adding the one or more enhanced audio signals into a decoding stream of the plurality of audio signals to obtain an audio decoding signal,
wherein:
performing the enhancement-process to the one or more audio signals having the designated signal type comprises: performing a frequency-spectrum enhancement and an acoustic-image extension to the analogous audio signal, and
the method further comprises:
for audio signals not having the designated signal type, directly performing a high frequency recovery and a stereo recovery; and
for the one or more audio signals having the designated signal type, performing the high frequency recovery after the frequency spectrum enhancement, and performing the stereo recovery after the acoustic-image extension.

8. The method according to claim 7 , wherein the designated signal type is an analogous audio signal, wherein the audio parameter of each audio signal comprises total frequency-spectrum energy, a spectral flatness measure (SFM), and a spectral flux (SF), and wherein the step of determining whether each audio signal includes the designated signal type comprises:
determining that an audio signal is the analogous audio signal, when the total frequency-spectrum energy of the audio signal is more than a first threshold value, the spectral flatness measure (SFM) is less than a second threshold value, and the spectral flux (SF) is more than a third threshold value.

9. The method according to claim 7 , wherein the step of processing the frequency-spectrum enhancement to the analogous audio signal comprises:
obtaining a frequency of each audio signal;
determining a frequency-spectrum enhancement coefficient of each audio signal, according to the frequency of each audio signal; and
performing the frequency-spectrum enhancement to each audio signal, according to the frequency-spectrum enhancement coefficient of each audio signal.

10. The method according to claim 7 , wherein performing the acoustic-image extension to the analogous audio signal comprises:
using a delaying parameter to perform the acoustic-image extension to the analogous audio signal.

11. The method according to claim 7 , wherein:
one bit is used to encode the marking representing the type for each audio signal in the audio encoding stream;
audio signals having the designated signal type is marked as 1, and
audio signals not having the designated signal type is marked as 0.

12. An audio encoding apparatus, comprising at least one processor configured to:
obtain a plurality of audio signals that are continuous;
determine a type of each audio signal of the plurality of audio signals, according to an audio parameter of each audio signal, wherein the type of each audio signal is one of a designated signal type, a voice signal type, and a mute signal type; and
perform a marking to each audio signal as having or not having the designated signal type to obtain a marked audio encoding stream, wherein the marking is used, when decoding, to perform an enhancement-process to one or more audio signals having the designated signal type,
wherein the designated signal type is an analogous audio signal, and the at least one processor is further configured to:
obtain the audio parameter of each audio signal, wherein the audio parameter comprises logarithmic energy, a high-zero-crossing-rate-ratio (HZCRR), and a spectral flux (SF);
determine that an audio signal i

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Chen Guoming
• Peng Yuanjiang
• Ou Wenjun
• Liu Hong

Classifications

• G10L25/21

  the extracted parameters being power information · CPC title

• G10L19/02 Primary

  using spectral analysis, e.g. transform vocoders or subband vocoders · CPC title

• G10L19/032

  Quantisation or dequantisation of spectral components · CPC title

• G10L25/09

  the extracted parameters being zero crossing rates · CPC title