Beam rejection in multi-beam microphone systems

Patent metadata

Field	Value
Publication number	US-9689960-B1
Application number	US-201313857040-A
Country	US
Kind code	B1
Filing date	Apr 4, 2013
Priority date	Apr 4, 2013
Publication date	Jun 27, 2017
Grant date	Jun 27, 2017

Abstract

The systems, devices, and processes described herein may identify a beam of a voice-controlled device that is directed toward a reflective surface, such as a wall. The beams may be created by a beamformer. An acoustic echo canceller (AEC) may create filter coefficients for a reference sound. The filter coefficients may be analyzed to identify beams that include multiple peaks. The multiple peaks may indicate presence of one or more reflective surfaces. Using the amplitude and the time delay between the peaks, the device may determine that it is close to a reflective surface in a direction of the beam.

First claim

What is claimed is:

1. A computing device comprising:
memory;
one or more processors;
an audio player module stored in the memory and executable by the one or more processors to cause a speaker to generate a reference sound based on a reference signal;
a plurality of microphones that receive the reference sound and generate a plurality of audio signals;
a beamforming module stored in the memory and executable by the one or more processors to receive the audio signals and to generate a plurality of beamformed signals;
an acoustic echo cancellation module stored in the memory and executable by the one or more processors to use the reference signal to perform echo cancellation on each beamformed signal of the plurality of beamformed signals, wherein the acoustic echo cancellation module outputs filter coefficients for each beamformed signal; and
a beam rejection module stored in the memory and executable by the one or more processors to:
determine, using the filter coefficients, that a first beamformed signal of the plurality of beamformed signals comprises a reflection of the reference sound, wherein the reflection is associated with a first time delay;
determine that the computing device is proximate to a reflective surface in a direction of the first beamformed signal when the first time delay is less than or equal to a threshold; and
exclude from further processing, at least temporarily, a beamformed signal having a direction that is at least substantially the same as the direction of the first beamformed signal.

2. The computing device as recited in claim 1 , wherein the threshold corresponds to a predetermined acceptable distance of the computing device to the reflective surface.

3. The computing device as recited in claim 1 , wherein the plurality of microphones comprise a circular microphone array and wherein the beamforming module comprises a fixed beamformer.

4. A computer-implemented method comprising:
under control of one or more processors of a computing device,
generating, by a speaker, audio using an audio signal;
receiving, from a microphone array, a plurality of received audio signals generated by the microphone array from the audio;
creating a first beamformed signal using at least one of (i) the plurality of received audio signals or (ii) a plurality of processed signals derived from the plurality of received audio signals;
generating a plurality of filter coefficients by performing acoustic echo cancellation (AEC) on at least one of (i) the first beamformed signal, (ii) a first received audio signal of the plurality of received audio signals, or (iii) a processed signal derived from at least one of the plurality of received audio signals;
determining, based at least in part on the plurality of filter coefficients, at least one of an amplitude or a time delay corresponding to a reflection of the audio;
determining that the computing device is proximate to a reflective surface in a direction of the first beamformed signal using at least one of the amplitude or the time delay; and
excluding from further processing, at least temporarily, a beamformed signal having a direction that is at least substantially the same as the direction of the first beamformed signal.

5. The computer-implemented method as recited in claim 4 , wherein creating the first beamformed signal comprises using a fixed beamformer.

6. The computer-implemented method as recited in claim 4 , wherein the audio signal comprises music.

7. The computer-implemented method as recited in claim 4 , wherein determining, based at least in part on the filter coefficients, at least one of an amplitude or a time delay corresponding to the reflection of the audio comprises:
analyzing the filter coefficients to determine a first peak corresponding to a direct path of the audio and a second peak corresponding to a reflection of the audio.

8. The computer-implemented method as recited in claim 4 , further comprising performing preprocessing on the plurality of received audio signals, wherein the preprocessing occurs prior to creating the first beamformed signal and prior to generating the plurality of filter coefficients.

9. The computer-implemented method as recited in claim 4 , wherein the first beamformed signals is created prior to generating the plurality of filter coefficients, and wherein generating the plurality of filter coefficients comprises using the first beamformed signal.

10. The computer-implemented method as recited in claim 4 , wherein the plurality of filter coefficients is generated prior to creating the first beamformed signal and wherein generating the plurality of filter coefficients comprises using the received audio signals.

11. The computer-implemented method as recited in claim 4 , wherein the creating the first beamformed signal includes a front-end process occurring prior to generating the plurality of filter coefficients and a back-end process occurring after generating the plurality of filter coefficients.

12. The computer-implemented method as recited in claim 4 , further comprising determining that the amplitude is greater than a threshold amplitude.

13. The computer-implemented method as recited in claim 12 , further comprising determining that the time delay is greater than a threshold time delay, and wherein the threshold time delay corresponds to a predetermined acceptable distance of the computing device to the reflective surface.

14. One or more non-transitory computer-readable media storing compute-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
causing a speaker to generate audio from an audio signal;
receiving, from a microphone array, a plurality of received audio signals;
creating a plurality of filter coefficients by acoustic echo cancellation (AEC) of the received audio signals;
creating a first beamformed signal using the plurality of received audio signals;
associating the plurality of filter coefficients with the first beamformed signal;
analyzing the filter coefficients to identify a time delay corresponding to a reflection of the audio;
determining that the time delay is less than or equal to a threshold; and
excluding from further processing, at least temporarily, a beamformed signal having a direction that is at least substantially the same as the first beamformed signal.

15. The one or more non-transitory computer-readable media as recited in claim 14 , wherein the first beamformed signal is created prior to performing the AEC.

16. The one or more non-transitory computer-readable media as recited in claim 14 , wherein the threshold corresponds to a predetermined acceptable distance of a computing device to a reflective surface that causes the reflection.

17. The one or more non-transitory computer-readable media as recited in claim 14 , wherein the audio signal is a portion of a longer audio clip.

18. The one or more non-transitory computer-readable media as recited in claim 14 , wherein the analyzing the filter coefficients comprises determining that the reflection of the audio includes an amplitude greater than or equal to a threshold amplitude or includes a difference in amplitude that is less than or equal to a threshold difference.

19. The one or more non-transitory computer-readable media as recited in claim 14 , wherein creating a first beamformed signal comprises using a fixed beamformer.

Assignees

• Amazon Tech Inc

Inventors

• Barton William Folwell
• Hild Ii Kenneth Edgar
• Gopalan Ramya
• Velusamy Kavitha
• Chhetri Amit Singh

Classifications

• H04R2430/20

  Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic (H04R2203/12 takes precedence) · CPC title

• H04R25/407

  Circuits for combining signals of a plurality of transducers · CPC title

• G01S3/86

  with means for eliminating undesired waves, e.g. disturbing noises · CPC title

• G01S5/22

  Position of source determined by co-ordinating a plurality of position lines defined by path-difference measurements (G01S5/28 takes precedence) · CPC title

• H04R1/406

  microphones · CPC title