System and method for speech enhancement in multisource environments

Patent metadata

Field	Value
Publication number	US-10482878-B2
Application number	US-201715831808-A
Country	US
Kind code	B2
Filing date	Dec 5, 2017
Priority date	Nov 29, 2017
Publication date	Nov 19, 2019
Grant date	Nov 19, 2019

Abstract

A method, computer program product, and computer system for receiving, by a computing device, a first signal emitted from one or more sources. A second signal may be received emitted from the one or more sources. A first confidence level that the wake-up-word is included in the first signal may be determined. A second confidence level that the wake-up-word is included in the second signal may be determined. It may be identified that the wake-up-word originated from a first source of the one or more sources based upon, at least in part, the first and second confidence levels. The first source may be enabled to participate in a dialog phase.

First claim

What is claimed is:

1. A computer-implemented method comprising:
receiving, by a computing device, a first signal emitted from one or more sources;
receiving a second signal emitted from the one or more sources;
determining a first confidence level that a wake-up-word is included in the first signal;
determining a second confidence level that the wake-up-word is included in the second signal;
identifying that the wake-up-word originated from a first source of the one or more sources based upon, at least in part, the first and second confidence levels; and
enabling the first source to participate in a dialogue phase.

2. The computer-implemented method of claim 1 further comprising excluding at least a second source of the one or more sources from participating in the dialogue phase based upon, at least in part, historical information of the one or more sources.

3. The computer-implemented method of claim 1 wherein a Bayes decision process is used, at least in part, to identify the one or more sources.

4. The computer-implemented method of claim 1 wherein a wrapped Gaussian mixture model is used, at least in part, to identify the one or more sources.

5. The computer-implemented method of claim 1 further comprising tracking movement of the first source with at least one of one or more core localizers.

6. The computer-implemented method of claim 1 wherein the first signal and the second signal are received at a microphone group.

7. The computer-implemented method of claim 1 further comprising determining one or more angles at a given frequency expected to exhibit a maximum grating lobe based upon, at least in part, a latest model state.

8. The computer-implemented method of claim 1 further comprising extracting, by a beamformer, any source of the one or more sources except sources of the one or more sources deemed as interference.

9. A computer program product residing on a non-transitory computer readable storage medium having a plurality of instructions stored thereon which, when executed across one or more processors, causes at least a portion of the one or more processors to perform operations comprising: receiving a first signal emitted from one or more sources; receiving a second signal emitted from the one or more sources; determining a first confidence level that a wake-up-word is included in the first signal; determining a second confidence level that the wake-up-word is included in the second signal; identifying that the wake-up-word originated from a first source of the one or more sources based upon, at least in part, the first and second confidence levels; and enabling the first source to participate in a dialogue phase.

10. The computer program product of claim 9 further comprising excluding at least a second source of the one or more sources from participating in the dialogue phase based upon, at least in part, historical information of the one or more sources.

11. The computer program product of claim 9 wherein a Bayes decision process is used, at least in part, to identify the one or more sources.

12. The computer program product of claim 9 wherein a wrapped Gaussian mixture model is used, at least in part, to identify the one or more sources.

13. The computer program product of claim 9 wherein the operations further comprise tracking movement of the first source with at least one of one or more core localizers.

14. The computer program product of claim 9 wherein the operations further comprise extracting, by a beamformer, any source of the one or more sources except sources of the one or more sources deemed as interference.

15. The computer program product of claim 9 wherein the operations further comprise determining one or more angles at a given frequency expected to exhibit a maximum grating lobe based upon, at least in part, a latest model state.

16. A computing system including one or more processors and one or more computer readable media having a plurality of instructions stored thereon which, when executed across the one or more processors, causes at least a portion of the one or more processors to perform operations comprising:
receiving a first signal emitted from one or more sources;
receiving a second signal emitted from the one or more sources;
determining a first confidence level that a wake-up-word is included in the first signal;
determining a second confidence level that the wake-up-word is included in the second signal;
identifying that the wake-up-word originated from a first source of the one or more sources based upon, at least in part, the first and second confidence levels; and
enabling the first source to participate in a dialogue phase.

17. The computing system of claim 16 wherein the operations further comprise excluding at least a second source of the one or more sources from participating in the dialogue phase based upon, at least in part, historical information of the one or more sources.

18. The computing system of claim 16 wherein a Bayes decision process is used, at least in part, to identify the one or more sources.

19. The computing system of claim 16 wherein a wrapped Gaussian mixture model is used, at least in part, to identify the one or more sources.

20. The computing system of claim 16 wherein the operations further comprise at least one of extracting, by a beamformer, any source of the one or more sources except sources of the one or more sources deemed as interference and determining one or more angles at a given frequency expected to exhibit a maximum grating lobe based upon, at least in part, a latest model state.

Assignees

• Nuance Communications Inc

Inventors

• Wolff Tobias
• Janssen Jan Philip
• Graf Simon
• Haulick Tim

Classifications

• G01S3/8006

  Multi-channel systems specially adapted for direction-finding, i.e. having a single aerial system capable of giving simultaneous indications of the directions of different signals · CPC title

• H04R3/005

  for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407) · CPC title

• H04R2420/07

  Applications of wireless loudspeakers or wireless microphones · CPC title

• H04R1/406

  microphones · CPC title

• G10L2015/088

  Word spotting · CPC title