Processing method of audio signal using spectral envelope signal and excitation signal and electronic device including a plurality of microphones supporting the same

Patent metadata

Field	Value
Publication number	US-11308977-B2
Application number	US-202016733735-A
Country	US
Kind code	B2
Filing date	Jan 3, 2020
Priority date	Jan 4, 2019
Publication date	Apr 19, 2022
Grant date	Apr 19, 2022

Abstract

According to an embodiment, the above-described specification discloses an electronic device comprises at least one processor configured to: receive a first audio signal and a second audio signal; detect a spectral envelope signal from the first audio signal and extract a feature point from the second audio signal; extend a high-band of the second audio signal based on the spectral envelope signal from the first audio signal and the feature point from the second audio signal to generate a high-band extension signal; and mix the high-band extension signal and the first audio signal, thereby resulting in a synthesized signal.

First claim

What is claimed is:

1. An electronic device including a plurality of microphones comprising:
at least one processor configured to:
receive a first audio signal from a first microphone among a plurality of microphones and a second audio signal from a second microphone among a plurality of microphones;
detect a wide-band spectral envelope signal from the first audio signal and extract a narrow-band excitation signal from the second audio signal;
extend a high-band of the second audio signal based on the wide-band spectral envelope signal from the first audio signal and the narrow-band excitation signal from the second audio signal to generate a high-band extension signal; and
mix the high-band extension signal and the first audio signal, thereby resulting in a synthesized signal.

2. The electronic device of claim 1 , wherein the first microphone and the second microphone are operatively connected to the at least one processor, and
wherein the first microphone includes an external microphone disposed on one side of an earphone or a headset and the second microphone disposed on one side of a housing configured to be mounted in an ear.

3. The electronic device of claim 2 , wherein the second microphone includes at least one of an in-ear microphone or a bone conduction microphone.

4. The electronic device of claim 1 , wherein the first audio signal includes a signal in a band wider than the second audio signal.

5. The electronic device of claim 1 , wherein the second audio signal includes greater energy in a low-band than the first audio signal.

6. The electronic device of claim 1 , wherein the at least one processor is configured to:
identify a noise level included in the first audio signal;
when the noise level exceeds a specified value, perform pre-processing on the first audio signal; and
perform linear prediction analysis on the pre-processed signal and detect the wide-band spectral envelope signal.

7. The electronic device of claim 6 , wherein the at least one processor is configured to:
when the noise level included in the first audio signal is less than the specified value, perform the linear prediction analysis on the first audio signal and detect the wide-band spectral envelope signal.

8. The electronic device of claim 1 , wherein the at least one processor is configured to:
store the synthesized signal in a memory;
output the synthesized signal through a speaker; or
transmit the synthesized signal to an external electronic device connected with a communication circuit.

9. The electronic device of claim 2 , wherein the at least one processor is configured to:
when one of a call function execution request, a recording function execution request, or a video shooting function execution request is requested, automatically control activation of the first microphone and the second microphone; and
perform mixing of the high-band extension signal and the first audio signal.

10. An audio signal processing method of an electronic device including a plurality of microphones, the method comprising:
receiving a first audio signal from a first microphone among a plurality of microphones and obtaining a second audio signal through a second microphone among the plurality of microphones;
detecting a wide-band spectral envelope signal from the first audio signal and extracting a narrow-band excitation signal from the second audio signal;
extending a high-band signal of the second audio signal based on the wide-band spectral envelope signal from the first audio signal and the narrow-band excitation signal from the second audio signal to generate a high-band extension signal; and
mixing the high-band extension signal and the first audio signal.

11. The method of claim 10 , wherein the first microphone includes an external microphone disposed on one side of an earphone or a headset and the second microphone is disposed on one side of a housing configured to be mounted in an ear.

12. The method of claim 10 , wherein the second microphone includes at least one of an in-ear microphone or a bone conduction microphone.

13. The method of claim 10 , wherein the first audio signal includes a signal in a band wider than the second audio signal.

14. The method of claim 10 , wherein the second audio signal hear greater energy in a low-band than the first audio signal.

15. The method of claim 10 , further comprising:
identifying a noise level included in the first audio signal,
wherein mixing includes:
when the noise level exceeds a specified value, pre-processing the first audio signal;
performing linear prediction analysis on the pre-processed signal and detecting the wide-band spectral envelope signal; and
mixing the detected wide-band spectral envelope signal and the high-band extension signal.

16. The method of claim 15 , wherein the detecting of the wide-band spectral envelope signal includes:
when the noise level included in the first audio signal is less than the specified value, performing the linear prediction analysis on the first audio signal and detecting the wide-band spectral envelope signal.

17. The method of claim 10 , further comprising one of:
storing the mixed signal in a memory;
outputting the mixed signal through a speaker; or
transmitting the mixed signal to an external electronic device connected based on a communication circuit.

18. The method of claim 10 , further comprising:
receiving one of a call function execution request, a recording function execution request, or a video shooting function execution request; and
automatically activating the first microphone and the second microphone.

19. An electronic device including a plurality of microphones comprising:
a first microphone, a communication circuit and at least one processor operatively connected to the first microphone and the communication circuit,
wherein the at least one processor is configured to:
when activating the first microphone, obtain a first audio signal through the first microphone;
identify a noise level of the first audio signal obtained by the activated first microphone;
when the noise level exceeds a specified value, activating a second microphone configured to generate a second audio signal through the communication circuit;
when obtaining the second audio signal, extract a narrow-band excitation signal from the second audio signal;
extend a high-band portion of the second audio signal based on the narrow-band excitation signal from the second audio signal and a wide-band spectral envelope signal extracted from the first audio signal, thereby resulting in a high-band extension signal; and
mixing the high-band extension signal and the first audio signal.

20. The electronic device of claim 19 , wherein the at least one processor is configured to:
when the noise level of the first audio signal is less than the specified value, support deactivation of the second microphone and support execution of a specified function based on the first audio signal through the activated first microphone, and
when the noise level of the first audio signal exceeds the specified value, support activation of the second microphone and support execution of a specified function based on the first audio signal through the activated first microphone and the second audio signal through the activated second microphone.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Moon Hangil
• Cha Aran
• Shim Hwan
• Lee Gunwoo
• Kim Kyuhan

Classifications

• H04R3/005 Primary

  for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407) · CPC title

• G10L19/08

  Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters · CPC title

• H04R1/1016

  Earpieces of the intra-aural type · CPC title

• H04R1/265

  of microphones · CPC title

• G10L21/038 Primary

  using band spreading techniques · CPC title