Processing method for sound effect of recording and mobile terminal

Patent metadata

Field	Value
Publication number	US-10891938-B2
Application number	US-201916678712-A
Country	US
Kind code	B2
Filing date	Nov 8, 2019
Priority date	Nov 27, 2018
Publication date	Jan 12, 2021
Grant date	Jan 12, 2021

Abstract

A method of processing for sound effect of recording and a mobile terminal are disclosed in embodiments of the present disclosure. The method includes recording N audio signals generated from N sound sources, N being an integer greater than or equal to 2; obtaining location relationships of the N sound sources, determining a scene where the N sound sources are located in, and determining a reverberation algorithm according to the location relationships of the N sound sources and the scene where the N sound sources are located in; and performing a sound effect processing for the N audio signals according to the reverberation algorithm to obtain a reverbed sound effect.

First claim

What is claimed is:

1. A method of processing for sound effect of recording, comprising:
recording N audio signals generated from N sound sources, N being an integer greater than or equal to 2;
obtaining location relationships of the N sound sources, determining a scene where the N sound sources are located in, and determining a reverberation algorithm according to the location relationships of the N sound sources and the scene where the N sound sources are located in; and
performing a sound effect processing for the N audio signals according to the reverberation algorithm to obtain a reverbed sound effect;
wherein the scene where the N sound sources are located in comprises an indoor scene;
and the determining the reverberation algorithm according to the location relationships of the N sound sources and the scene where the N sound sources are located in comprises:
determining indoor parameters of the indoor scene, wherein the indoor parameters comprise a parameter of indoor area, a parameter of indoor volume, a parameter of indoor material, and a parameter of indoor air medium;
determining reverberation parameters according to the indoor parameters and the location relationships of the N sound sources, wherein the reverberation parameters comprise a ratio of direct sounds, attenuation coefficients corresponding to the direct sounds, a radio of echoes, attenuation coefficients corresponding to the echoes, and a reverberation frequency range; and
determining the reverberation algorithm according to the reverberation parameters.

2. The method of claim 1 , wherein recording the N audio signals generated from the N sound sources comprises:
recording the N audio signals generated from the N sound sources through N microphones, each of which is arranged adjacent to a respective one of the N sound sources.

3. The method of claim 2 , wherein obtaining the location relationships of the N sound sources comprises:
measuring a distance and a relative orientation between any two of the N microphones through a measuring device.

4. The method of claim 3 , wherein determining the reverberation algorithm according to the location relationships of the N sound sources and the scene where the N sound sources are located in comprises:
determining the reverberation algorithm according to the distance and relative orientation between any two of the N microphones and the scene where the N sound sources are located in.

5. The method of claim 1 , wherein the method is applied to a video call terminal; and
obtaining the location relationships of the N sound sources comprises:
obtaining a first location of each of the N sound sources with respect to the video call terminal.

6. The method of claim 5 , wherein determining the reverberation algorithm according to the location relationships of the N sound sources and the scene where the N sound sources are located in comprises:
determining the reverberation algorithm according to the first location of the each of the N sound sources with respect to the video call terminal and the scene where the N sound sources are located in.

7. The method of claim 1 , wherein performing the sound effect processing for the N audio signals according to the reverberation algorithm to obtain the reverbed sound effect comprises:
performing a denoising processing for the N audio signals to obtain the denoised N audio signals through a multi-noise filtering engine; and
performing the sound effect processing for the denoised N audio signals according to the reverberation algorithm to obtain the reverbed sound effect.

8. The method of claim 1 , further comprising:
transmitting the reverbed sound effect to a video call terminal to play the reverbed sound effect.

9. A mobile terminal, comprising a processor and a non-transitory memory storing one or more programs, wherein the one or more programs are configured to be executed by the processor to perform a method, and the method comprises:
recording N audio signals generated from N sound sources, N being an integer greater than or equal to 2;
obtaining location relationships of the N sound sources, determining a scene where the N sound sources are located in, and determining a reverberation algorithm according to the location relationships of the N sound sources and the scene where the N sound sources are located in; and
performing a sound effect processing for the N audio signals according to the reverberation algorithm to obtain a reverbed sound effect;
wherein the scene where the N sound sources are located in comprises an indoor scene; and the reverberation algorithm is determined according to reverberation parameters, wherein the reverberation parameters are determined according to indoor parameters of the indoor scene and the location relationships of the N sound sources and comprise a ratio of direct sounds, attenuation coefficients corresponding to the direct sounds, a radio of echoes, attenuation coefficients corresponding to the echoes, and a reverberation frequency range, and the indoor parameters comprise a parameter of indoor area, a parameter of indoor volume, a parameter of indoor material, and a parameter of indoor air medium.

10. The mobile terminal of claim 9 , wherein each of the N audio signals are recorded through a respective one of N microphones, and each of the N microphones is arranged adjacent to a respective one of the N sound sources.

11. The mobile terminal of claim 10 , wherein the location relationships of the N sound sources comprise a distance and a relative orientation between any two of the N microphones.

12. The mobile terminal of claim 11 , wherein the reverberation algorithm is determined according to the distance and the relative orientation between any two of the N microphones and the scene where the N sound sources are located in.

13. The mobile terminal of claim 9 , wherein the location relationships of the N sound sources comprise a first location of each of the N sound sources with respect to the mobile terminal.

14. The mobile terminal of claim 13 , wherein the reverberation algorithm is determined according to the first location of the each of the N sound sources with respect to the mobile terminal and the scene where the N sound sources are located in.

15. A non-transitory storage medium storing one or more programs, when executed, causing a processor to perform a processing method, wherein the processing method comprises:
recording N audio signals generated from N sound sources, N being an integer greater than or equal to 2;
obtaining location relationships of the N sound sources, determining a scene where the N sound sources are located in, and determining a reverberation algorithm according to the location relationships of the N sound sources and the scene where the N sound sources are located in; and
performing a sound effect processing for the N audio signals according to the reverberation algorithm to obtain a reverbed sound effect;
wherein the scene where the N sound sources are located in comprises an indoor scene; and the reverberation algorithm is determined according to reverberation parameters, wherein the reverberation parameters are determined according to indoor parameters of the indoor scene and the location relationships of the N sound sources and comprise a ratio of direct sounds, attenuation coefficients corresponding to the direct sounds, a radio of echoes, attenuation coefficients corresponding to the echoes, and a reverberation frequency range, and the indoor parameters comprise a parameter of indoor area, a parameter of indoor volume, a parameter of indoor material, and a paramet

Assignees

• Guangdong Oppo Mobile Telecommunications Corp Ltd
• Guangdong Oppo Mobile Telecommunications And Corp Ltd

Inventors

• Zhu Kezhi
• Wang Jian
• Yan Fenggui

Classifications

• H04R1/265 Primary

  of microphones · CPC title

• G06F3/165 Primary

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• H04R29/005

  Microphone arrays · CPC title

• G10L21/0232

  Processing in the frequency domain · CPC title

• H04R1/406

  microphones · CPC title