Surround sound recording for mobile devices

Patent metadata

Field	Value
Publication number	US-10154345-B2
Application number	US-201715626962-A
Country	US
Kind code	B2
Filing date	Jun 19, 2017
Priority date	Dec 18, 2014
Publication date	Dec 11, 2018
Grant date	Dec 11, 2018

Abstract

A microphone arrangement and a method using the microphone arrangement for recording surround sound in a mobile device, where the microphone arrangement comprises a first and a second microphone and arranged at a first distance to each other and configured to obtain a stereo signal, and comprises a third microphone configured to obtain a steering signal together with at least one of the first and second microphone or with a fourth microphone. The microphone arrangement also comprises a processor configured to separate the stereo signal into a front stereo signal and a back stereo signal based on the steering signal.

First claim

What is claimed is:

1. A microphone arrangement for recording surround sound in a mobile device, comprising:
a first microphone arranged to obtain a first audio signal of a stereo signal;
a second microphone arranged to obtain a second audio signal of the stereo signal;
a third microphone configured to obtain a third audio signal, the third microphone comprising an omnidirectional sound pressure microphone; and
a processor coupled to the first microphone, the second microphone, and the third microphone and configured to:
obtain a steering signal based on the third audio signal and another audio signal obtained by another microphone of the microphone arrangement, the steering signal comprising direction-of-arrival (DOA) information, and the another microphone comprising another omnidirectional sound pressure microphone;
separate the stereo signal into a front stereo signal and a back stereo signal based on the steering signal;
combine the DOA information with at least a part of the stereo signal to obtain the front stereo signal and the back stereo signal;
determine the DOA information based on a first inter-channel-level-difference (ICLD) between the third audio signal and the another audio signal, the first ICLD based on a difference between time or frequency representations in particular power spectra of the third audio signal and the another audio signal;
process the third audio signal and the another audio signal such that two virtual sound pressure gradient microphones directed to opposite directions are formed; and
obtain the first ICLD on a basis of output signals of the two virtual sound pressure gradient microphones.

2. The microphone arrangement of claim 1 , wherein the microphone arrangement comprises a fourth microphone arranged to obtain a fourth audio signal, and the processor is further configured to obtain the steering signal based on the third audio signal and at least one of the first audio signal, the second audio signal, and the fourth audio signal.

3. The microphone arrangement of claim 1 , wherein the processor is further configured to:
determine a direct-sound component and a diffuse-sound component of the stereo signal; and
combine the DOA information only with the direct-sound component of the stereo signal to obtain the front stereo signal and the back stereo signal.

4. The microphone arrangement of claim 1 , wherein the processor is further configured to determine the DOA information additionally based on a second ICLD between the third audio signal and the another audio signal, the second ICLD based on a difference between time or frequency representations in particular power spectra between the third audio signal and the another audio signal, and the difference being caused by a shadowing effect of a housing of the microphone arrangement disposed at least partly between the third microphone and the another microphone.

5. The microphone arrangement of claim 4 , wherein the processor is further configured to:
set the first ICLD to determine the DOA information for frequencies of the stereo signal at or below a determined frequency threshold value; and
set the second ICLD to determine the DOA information for frequencies of the stereo signal above the determined frequency threshold value.

6. The microphone arrangement of claim 5 , wherein the determined frequency threshold value depends on a second distance between the third microphone and one of the first, second, and a fourth microphone.

7. The microphone arrangement of claim 1 , wherein the processor is further configured to bias the first ICLD or a second ICLD towards the third microphone or the another microphone.

8. The microphone arrangement of claim 1 , wherein the processor is further configured to bias the DOA information towards one of the third microphone or the another microphone.

9. The microphone arrangement of claim 1 , wherein the third microphone and the another microphone are directional microphones and are directed to opposite directions, or the first microphone and the second microphone are directional microphones and are directed towards the opposite directions.

10. The microphone arrangement of claim 1 , wherein the processor is further configured to determine a center signal from the stereo signal.

11. The microphone arrangement of claim 1 , wherein a fourth microphone of the microphone arrangement is configured to obtain a center signal.

12. A method of surround sound recording in a mobile device, comprising:
obtaining a first audio signal of a stereo signal with a first microphone;
obtaining a second audio signal of the stereo signal with a second microphone;
obtaining a third audio signal with a third microphone, the third microphone comprising an omnidirectional sound pressure microphone;
obtaining a steering signal based on either the third audio signal and the first audio signal or the second audio signal or based on a fourth audio signal obtained by a fourth microphone, the steering signal comprising direction-of-arrival (DOA) information;
separating the stereo signal into a front stereo signal and a back stereo signal based on the steering signal;
combining the DOA information with at least a part of the stereo signal to obtain the front stereo signal and the back stereo signal;
determine the DOA information based on a first inter-channel-level-difference (ICLD) between the third audio signal and another audio signal of another microphone, the another microphone comprising another omnidirectional sound pressure microphone, and the first ICLD based on a difference between time or frequency representations in particular power spectra of the third audio signal and the another audio signal;
process the third audio signal and the another audio signal such that two virtual sound pressure gradient microphones directed to opposite directions are formed; and
obtain the first ICLD on a basis of output signals of the two virtual sound pressure gradient microphones.

13. A mobile device for recording surround sound, comprising:
a non-transitory memory comprising instructions; and
one or more processors in communication with the memory, the one or more processors executing the instructions to perform a method comprising the following operations:
obtaining a first audio signal of a stereo signal with a first microphone;
obtaining a second audio signal of the stereo signal with a second microphone;
obtaining a third audio signal with a third microphone, the third microphone comprising an omnidirectional sound pressure microphone;
obtaining a fourth audio signal with a fourth microphone;
obtaining a steering signal based on the third audio signal and one of the first audio signal, the second audio signal, or the fourth audio signal, the steering signal comprising direction-of-arrival (DOA) information;
separating the stereo signal into a front stereo signal and a back stereo signal based on the steering signal;
combining the DOA information with at least a part of the stereo signal to obtain the front stereo signal and the back stereo signal;
determining the DOA information based on a first inter-channel-level-difference (ICLD) between the third audio signal and another audio signal of another microphone, the another microphone comprising another omnidirectional sound pressure microphone, and the first ICLD based on a difference between time or frequency representations in particular power spectra of the third audio signal and the another audio signal;
processing the third audio signal and the another audio signal such that two virtual sound pressure gradient microphones directed to opposite directions are formed; and
obtaining

Assignees

• Huawei Tech Co Ltd

Inventors

• Faller Christof
• Favrot Alexis
• Grosche Peter
• Lang Yue

Classifications

• H04R2499/11

  Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's · CPC title

• H04S2400/15

  Aspects of sound capture and related signal processing for recording or reproduction · CPC title

• H04R1/326

  for microphones (H04R1/34 and H04R1/40 take precedence) · CPC title

• H04R5/04

  Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)} · CPC title

• H04R1/406 Primary

  microphones · CPC title