Audio processing using an intelligent microphone

Patent metadata

Field	Value
Publication number	US-10269343-B2
Application number	US-201515505736-A
Country	US
Kind code	B2
Filing date	Aug 27, 2015
Priority date	Aug 28, 2014
Publication date	Apr 23, 2019
Grant date	Apr 23, 2019

Abstract

The present disclosure relates generally to improving audio processing using an intelligent microphone and, more particularly, to techniques for processing audio received at a microphone with integrated analog-to-digital conversion, digital signal processing, acoustic source separation, and for further processing by a speech recognition system. Embodiments of the present disclosure include intelligent microphone systems designed to collect and process high-quality audio input efficiently. Systems and method for audio processing using an intelligent microphone include an integrated package with one or more microphones, analog-to-digital converters (ADCs), digital signal processors (DSPs), source separation modules, memory, and automatic speech recognition. Systems and methods are also provided for audio processing using an intelligent microphone that includes a microphone array and uses a preprogrammed audio beamformer calibrated to the included microphone array.

First claim

The invention claimed is:

1. An integrated circuit for providing advanced speech processing as a single package, comprising:
a microphone array for generating respective audio signals corresponding to distinct microphones in the microphone array;
circuitry for processing the respective audio signals, the circuitry comprising:
source separation module for separating sources present in the respective audio signals and generating one or more improved audio signals;
automatic speech recognition module for extracting speech information in the one or more improved audio signals and determining confidence level of extracted speech information; and
a feedback path for the confidence level to control one or more parameters affecting the source separation module.

2. The integrated circuit of claim 1 , wherein:
the source separation module determines a level of noise in the respective audio signals; and
the circuitry further includes a feedforward path for the level of the noise to control the automatic speech recognition module.

3. The integrated circuit of claim 1 , further comprising:
one or more sensors for sensing a source near the microphone array;
wherein the circuitry further includes a control path for an output of the one or more sensors to control the automatic speech recognition module.

4. The integrated circuit of claim 1 , wherein:
the circuitry for processing the respective audio signals further comprises a voice activity detecting module for detecting voice activity in the respective audio signals; and
the circuitry further includes a control path for an output of the voice activity detecting module to control the automatic speech recognition module.

5. An integrated circuit for providing advanced speech processing as a single package, comprising:
a microphone array for generating respective audio signals corresponding to distinct microphones in the microphone array; and
circuitry for processing the respective audio signals, the circuitry comprising:
a noise reduction module for reducing noise in the respective audio signals and generating one or more improved audio signals;
an automatic speech recognition module for extracting speech information in the one or more improved audio signals and determining confidence level of extracted speech information; and
a feedback path for the confidence level to control one or more parameters affecting sensitivity of the noise reduction module.

6. The integrated circuit of claim 5 , wherein:
the circuitry for processing the respective audio signals further comprises:
a source separation module for separating sources present in the respective audio signals and determining a level of noise in the one or more improved audio signals; and
a feedback path for the level of noise to control one or more parameters affecting sensitivity of the noise reduction module.

7. The integrated circuit of claim 5 , wherein:
the noise reduction module determines a level of noise in the respective audio signals; and
the circuitry further includes a feedforward path for the level of the noise to control the automatic speech recognition module.

8. An integrated circuit for providing advanced speech processing as a single package, comprising:
a microphone array for generating respective audio signals corresponding to distinct microphones in the microphone array; and
circuitry for processing the respective audio signals comprises:
a beamforming module for adaptively steering a beam of the microphone array;
a source separation module for separating sources present in the respective audio signals and determining a level of noise in the respective audio signals; and
a feedback path for the level of noise to control one or more parameters affecting the beam being formed by the beamforming module.

9. An integrated circuit for providing advanced speech processing as a single package, comprising:
a microphone array for generating respective audio signals corresponding to distinct microphones in the microphone array; and
circuitry for processing the respective audio signals comprises:
a beamforming module for adaptively steering a beam of the microphone array;
a noise reduction module for determining a level of noise in the respective audio signals; and
a feedback path for the level of noise to control one or more parameters affecting the beam being formed by the beamforming module.

10. An integrated circuit for providing advanced speech processing as a single package, comprising:
a microphone array for generating respective audio signals corresponding to distinct microphones in the microphone array; and
one or more sensors for sensing a source near the microphone array;
circuitry for processing the respective audio signals, the circuitry comprising:
a beamforming module for adaptively steering a beam of the microphone array;
an automatic speech recognition module for extracting speech information in the respective audio signals and determining confidence level of extracted speech information;
a feedback path for the confidence level to control one or more parameters affecting the beam being formed by the beamforming module; and
a control path for an output of the one or more sensors to control one or more parameters affecting the beam being formed by the beamforming module.

11. The integrated circuit of claim 10 , wherein the microphone array is a quad microphone comprising four microphone elements arranged in a geometric configuration.

12. An integrated circuit for providing advanced speech processing as a single package, comprising:
a microphone array for generating respective audio signals corresponding to distinct microphones in the microphone array; and
circuitry for processing the respective audio signals, the circuitry comprising:
a beamforming module for adaptively steering a beam of the microphone array;
an automatic speech recognition module for extracting speech information in the respective audio signals and determining confidence level of extracted speech information;
a feedback path for the confidence level to control one or more parameters affecting the beam being formed by the beamforming module;
a voice activity detecting module for detecting voice activity in the respective audio signals; and
a control path for an output of the voice activity detecting module to control one or more parameters affecting the beam being formed by the beamforming module.

13. An integrated circuit for providing advanced speech processing as a single package, comprising:
a microphone array for generating respective audio signals corresponding to distinct microphones in the microphone array;
circuitry for processing the respective audio signals, the circuitry comprising:
a beamforming module for adaptively steering a beam of the microphone array;
an automatic speech recognition module for extracting speech information in the respective audio signals and determining confidence level of extracted speech information;
a feedback path for the confidence level to control one or more parameters affecting the beam being formed by the beamforming module; and

a motion sensing module for sensing movement of an electronic device having the microphone array and the circuitry; and
wherein the beamforming module determines changes in position or orientation of the microphone array relative to an audio source of interest based on the respective audio signals and movement information from the motion sensing module adjusts beamforming functionality in response to the changes.

14. A method for audio processing within a single integrated package, the method comprising

Assignees

• Analog Devices Inc

Inventors

• Wingate David

Classifications

• H04R3/005

  for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407) · CPC title

• G10L21/0216

  characterised by the method used for estimating noise · CPC title

• H04R3/00

  Circuits for transducers (arrangements for producing a reverberation or echo sound G10K15/08; amplifiers H03F) · CPC title

• H04R2410/00

  Microphones · CPC title

• H04R1/406

  microphones · CPC title