Location estimation of active speaker

Patent metadata

Field	Value
Publication number	US-10219098-B2
Application number	US-201715707299-A
Country	US
Kind code	B2
Filing date	Sep 18, 2017
Priority date	Mar 3, 2017
Publication date	Feb 26, 2019
Grant date	Feb 26, 2019

Abstract

A system and method to perform an estimation of a location of an active speaker in real time includes designating a microphone of an array of microphones as a reference microphone. The method includes storing a relative transfer function (RTF) for each microphone of the array of microphones other than the reference microphone associated with each potential location among potential locations as a set of stored RTFs, and obtaining a voice sample of the active speaker and obtaining a speaker RTF for each microphone of the array of microphones other than the reference microphone. The method also includes performing an RTF projection of the speaker RTF for each microphone on the set of stored RTFs, and determining one of the potential locations as the location of the active speaker based on the performing the RTF projection.

First claim

What is claimed is:

1. A method of performing an estimation of a location of an active speaker in real time, the method comprising:
designating any one microphone of an array of microphones as a reference microphone;
storing a relative transfer function (RTF) for each microphone of the array of microphones other than the reference microphone associated with each potential location among potential locations as a set of stored RTFs;
obtaining a voice sample of the active speaker and obtaining a speaker RTF for each microphone of the array of microphones other than the reference microphone;
performing an RTF projection of the speaker RTF for each microphone on the set of stored RTFs; and
Determining, using a processor, one of the potential locations as the location of the active speaker based on the performing the RTF projection, wherein the obtaining the speaker RTF for each microphone of the array of microphones other than the reference microphone includes computing, for each of the potential locations, a ratio of an acoustic transfer function of the voice sample at the microphone to an acoustic transfer function of the voice sample at the reference microphone.

2. The method according to claim 1 , wherein the obtaining the voice sample is performed in real time.

3. The method according to claim 1 , further comprising sampling a sound from each of the potential locations to obtain the set of stored RTFs.

4. The method according to claim 1 , further comprising obtaining the set of stored RTFs as the RTF for each microphone of the array of microphones other than the reference microphone based on computing, for each of the potential locations, a ratio of an acoustic transfer function from one potential location among the potential locations to the microphone to an acoustic transfer function from the one potential location among the potential locations to the reference microphone.

5. The method according to claim 1 , wherein the performing the RTF projection includes calculating a cosine distance between each speaker RTF and each RTF of the set of stored RTFs.

6. The method according to claim 5 , wherein the determining the location of the active speaker is based on the maximum of the cosine distances.

7. The method according to claim 1 , wherein the storing the set of stored RTFs for the potential locations includes storing the set of stored RTFs for each seat in an automobile.

8. The method according to claim 7 , wherein the storing the set of stored RTFs is part of a calibration process performed for the automobile.

9. The method according to claim 7 , wherein the storing the set of stored RTFs is part of a calibration process performed for a calibration automobile of a same model as the automobile.

10. A system to estimate a location of an active speaker, the system comprising:
a memory device configured to store a relative transfer function (RTF) for each microphone of an array of microphones other than a reference microphone associated with each potential location among potential locations as a set of stored RTFs, wherein the reference microphone is any one of the array of microphones; and
a processor configured to obtain a voice sample of the active speaker and obtain a speaker RTF for each microphone of the array of microphones other than the reference microphone, perform an RTF projection of the speaker RTF for each microphone on the set of stored RTFs, and determine one of the potential locations as the location of the active speaker based on the RTF projection, wherein the processor obtains the speaker RTF for each microphone of the array of microphones other than the reference microphone based on computing, for each of the potential locations, a ratio of an acoustic transfer function of the voice sample at the microphone to an acoustic transfer function of the voice sample at the reference microphone.

11. The system according to claim 10 , wherein the processor obtains the voice sample in real time.

12. The system according to claim 10 , wherein the processor samples a sound from each of the potential locations to obtain the set of stored RTFs.

13. The system according to claim 10 , wherein the processor obtains the set of stored RTFs as the RTF for each microphone of the array of microphones other than the reference microphone based on computing, for each of the potential locations, a ratio of an acoustic transfer function from one potential location among the potential locations to the microphone to an acoustic transfer function from the one potential location among the potential locations to the reference microphone.

14. The system according to claim 10 , wherein the processor performs the RTF projection by calculating a cosine distance between each speaker RTF and each RTF of the set of stored RTFs.

15. The system according to claim 14 , wherein the processor determines the location of the active speaker based on the maximum of the cosine distances.

16. The system according to claim 10 , wherein the memory device stores the set of stored RTFs for each seat in an automobile.

17. The system according to claim 16 , wherein the memory device stores the set of stored RTFs as part of a calibration process performed for the automobile.

18. The system according to claim 16 , wherein the memory device stores the set of stored RTFs as part of a calibration process performed for a calibration automobile of a same model as the automobile.

Assignees

• Gm Global Tech Operations Llc
• Univ Bar Ilan

Inventors

• Tzirkel-Hancock Eli
• Tourbabin Vladimir
• Malka Ilan
• Gannot Sharon

Classifications

• H04S7/305 Primary

  Electronic adaptation of stereophonic audio signals to reverberation of the listening space (H04S7/301 takes precedence) · CPC title

• H04R3/005 Primary

  for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407) · CPC title

• H04R1/406

  microphones · CPC title

• H04R2201/401

  2D or 3D arrays of transducers · CPC title

• G01S5/20 Primary

  Position of source determined by a plurality of spaced direction-finders · CPC title