System for automatic speech recognition and audio entertainment

Patent metadata

Field	Value
Publication number	US-9767819-B2
Application number	US-201314775830-A
Country	US
Kind code	B2
Filing date	Apr 11, 2013
Priority date	Apr 11, 2013
Publication date	Sep 19, 2017
Grant date	Sep 19, 2017

Abstract

In one aspect, the present application is directed to a device for providing different levels of sound quality in an audio entertainment system. The device includes a speech enhancement system with a reference signal modification unit and a plurality of acoustic echo cancellation filters. Each acoustic echo cancellation filter is coupled to a playback channel. The device includes an audio playback system with loudspeakers. Each loudspeaker is coupled to a playback channel. At least one of the speech enhancement system and the audio playback system operates according to a full sound quality mode and a reduced sound quality mode. In the full sound quality mode, all of the playback channels contain non-zero output signals. In the reduced sound quality mode, a first subset of the playback channels contains non-zero output signals and a second subset of the playback channels contains zero output signals.

First claim

What is claimed is:

1. A device for providing different levels of sound quality in an audio entertainment system, the device comprising:
a speech enhancement system with a reference signal modification unit and a plurality of acoustic echo cancellation filters, each acoustic echo cancellation filter being coupled to a playback channel;
an audio playback system with loudspeakers, each loudspeaker being coupled to a playback channel,
wherein at least one of the speech enhancement system and the audio playback system operates according to:
i) a full sound quality mode, during which all of the playback channels contain non-zero output signals, and
ii) a reduced sound quality mode, during which a first subset of the playback channels contains non-zero output signals and a second subset of the playback channels contains zero output signals; and
an automatic speech recognition (ASR) system that operates according to a broad listening mode and a selective listening mode, wherein the ASR system is coupled to the audio playback system so that
i) the at least one of the speech enhancement system and the audio playback system operates in the full sound quality mode when the ASR system operates in the broad listening mode, and
ii) the at least one of the speech enhancement system and the audio playback system operates in the reduced sound quality mode when the ASR operates in the selective listening mode.

2. The device of claim 1 , wherein the audio playback system activates all the playback channels during the full sound quality mode and activates a subset of the playback channels during the reduced sound quality mode.

3. The device according to claim 2 , wherein the reduced sound quality mode is a stereo mode or a mono mode.

4. The device of claim 1 , wherein the speech signal modification unit of the speech enhancement system outputs the non-zero output signals to all of the acoustic echo cancellation filters during the full sound quality mode, and outputs the non-zero output signals to a first subset of the acoustic echo cancellation filters and the zero output signals to a second subset of the acoustic echo cancellation filters during the reduced sound quality mode.

5. The device according to claim 4 , wherein the speech signal modification unit outputs the zero output signals instead of non-zero output signals intended for the second subset of acoustic echo cancellation filters during the reduced sound quality mode.

6. The device according to claim 1 , wherein the speech enhancement system deactivates a subset of the acoustic echo cancellation filters during the reduced sound quality mode, the subset of the acoustic echo cancellation filters corresponding to the second subset of the playback channels that contain zero output signals.

7. The device according to claim 1 , wherein a subset of microphones coupled to the ASR system are activated during the full sound quality mode and all of the microphones are activated during the reduced sound quality mode.

8. The device according to claim 1 , wherein the ASR system sends the at least one of the speech enhancement system and the audio playback system a signal indicative of a mode to which the ASR system is switching.

9. The device according to claim 1 , wherein the ASR system sends the at least one of the speech enhancement system and the audio playback system a signal indicative of a mode in which the ASR system is operating.

10. The device according to claim 1 , wherein the at least one of the speech enhancement system and the audio playback system switches between the full and reduced sound quality modes in response to a switching cue.

11. A device for providing different levels of sound quality in an audio entertainment system, the device comprising:
a speech enhancement system with a reference signal modification unit and a plurality of acoustic echo cancellation filters, each acoustic echo cancellation filter being coupled to a playback channel;
an audio playback system with loudspeakers, each loudspeaker being coupled to a playback channel,
wherein at least one of the speech enhancement system and the audio playback system operates according to:
iii) a full sound quality mode, during which all of the playback channels contain non-zero output signals, and
iv) a reduced sound quality mode, during which a first subset of the playback channels contains non-zero output signals and a second subset of the playback channels contains zero output signals,
wherein the at least one of the speech enhancement system and the audio playback system switches between the full and reduced sound quality modes in response to a switching cue, and
wherein the switching cue includes one or more mode switching words from a speech input, one or more dialog states, or one or more visual cues from the possible speakers.

12. A computer program product encoded in a non-transitory computer-readable medium for providing different levels of sound quality in an audio entertainment system, the product comprising:
program code for operating at least one of a speech enhancement system coupled to playback channels and an audio playback system coupled to the playback channels, the program code adapted to:
receive a signal indicative of a mode of the at least one of a speech enhancement system and an audio playback system;
operate the at least one of a speech enhancement system and the audio playback system so that all of the playback channels contain non-zero output signals in a full sound quality mode; and
operate the at least one of a speech enhancement system and the audio playback system so that a first subset of the playback channels contain non-zero output signals and a second subset of the playback channels contain zero output signals in a reduced sound quality mode; and
operate an automatic speech recognition (ASR) system having a broad listening mode and a selective listening mode, wherein the ASR system is coupled to the audio playback system so that

i) the at least one of the speech enhancement system and the audio playback system operates in the full sound quality mode when the ASR system operates in the broad listening mode, and
ii) the at least one of the speech enhancement system and the audio playback system operates in the reduced sound quality mode when the ASR operates in the selective listening mode.

13. The computer program product of claim 12 , further comprising:
program code for deactivating one or more playback channels in the audio playback system when the mode is the reduced sound quality mode.

14. The computer program product of claim 12 , further comprising:
program code for switching the audio playback system to a stereo mode or a mono mode.

15. The computer program product of claim 12 , further comprising:
program code for transmitting non-zero output signals to all acoustic echo cancellation filters of the speech enhancement system in the full sound quality mode; and
program code for transmitting non-zero output signals to a first subset of the acoustic echo cancellation filters and zero output signals to a second subset of the acoustic echo cancellation filters in the reduced sound quality mode.

16. A method for providing different levels of sound quality in an audio entertainment system, the method comprising:
communicating with least one of a speech enhancement system coupled to playback channels and an audio playback system coupled to the playback channels;
receiving a signal indicative of a mode of the at least one of a speech enhancement system and an audio playback system;
operating the at least one of a speech enhanceme

Assignees

• Nuance Communications Inc

Inventors

• Buck Markus
• Haulick Tim
• Wolff Tobias
• Suhadi Suhadi

Classifications

• G10L2021/02087

  the noise being separate speech, e.g. cocktail party · CPC title

• G10L21/0208 Primary

  Noise filtering · CPC title

• G10L15/20

  Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech (G10L21/02 takes precedence) · CPC title

• H04M9/082 Primary

  using echo cancellers (echo cancellers per se H04B3/23) · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title