Method and apparatus to detect and isolate audio in a vehicle using multiple microphones

Patent metadata

Field	Value
Publication number	US-10448150-B2
Application number	US-201715613076-A
Country	US
Kind code	B2
Filing date	Jun 2, 2017
Priority date	Jun 3, 2016
Publication date	Oct 15, 2019
Grant date	Oct 15, 2019

Abstract

Certain embodiments may include methods and systems for receiving first audio data from a plurality of microphones disposed in a cabin of a vehicle, calculating phase differences between the first audio data received from different ones of the plurality of microphones, determining a location of a source of the first audio data based on the calculated phase differences, isolating second audio data received from the plurality of microphones, taking into account the determined location of the source, and controlling a function of the vehicle based on the isolated second audio data. Some embodiments can further include detecting voice data in the second audio data based on audio characteristics of the second audio data, and determining a voice command in the voice data, where the controlling the function of the vehicle is based on the voice command in the voice data in the second audio data.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
receiving, by a processor, first audio data from a plurality of microphones disposed in a cabin of a vehicle;
calculating, by the processor, phase differences between the first audio data received from different ones of the plurality of microphones;
determining, by the processor, that a location of a source of the first audio data is located in a driver's seat based on the calculated phase differences;
isolating, by the processor, second audio data received from the plurality of microphones, taking into account the determined location of the source;
detecting, by the processor, voice data in the second audio data based on audio characteristics of the second audio data;
determining, by the processor, a voice command in the voice data;
generating a user profile associated with the voice data;
detecting changes to driver-controlled performance characteristics of the vehicle;
associating the detected changes with the user profile;
detecting subsequent audio data having audio characteristics corresponding to the voice data;
determining that a location of a source of the subsequent audio data is located in the driver's seat; and
applying the detected changes to the driver-controlled performance characteristics of the vehicle;
controlling a function of the vehicle based on the voice command in the voice data in the second audio data.

2. The method of claim 1 further comprising:
determining, by the processor, a location of a second source of third audio data received from the different ones of the plurality of microphones;
isolating, by the processor, fourth audio data received from the plurality of microphones, taking into account the determined location of the second source; and
controlling a second function of the vehicle based on the isolated fourth audio data.

3. The method of claim 1 wherein the vehicle includes a plurality of passenger seats, and wherein the method further comprises:
determining, by the processor, which of the plurality of passenger seats corresponds to the determined location of the source of the first audio data; and
associating a priority to the second audio data based on the determined corresponding passenger seat.

4. The method of claim 3 wherein when the determined corresponding passenger seat is a driver's seat, the associated priority of the second audio data is assigned a highest priority, and wherein when the determined corresponding passenger seat is not the driver's seat the associated priority of the second audio data is assigned a lower priority.

5. The method of claim 1 wherein isolating the second audio data includes adjusting a directional focus of the plurality of microphones toward the determined location of the source of the first audio data.

6. A system comprising:
one or more processors; and one or more non-transitory computer-readable storage mediums containing instructions configured to cause the one or more processors to perform operations including:
receiving, by a processor, first audio data from a plurality of microphones disposed in a cabin of a vehicle;
calculating, by the processor, phase differences between the first audio data received from different ones of the plurality of microphones;
determining, by the processor, that a location of a source of the first audio data is located in a driver's seat based on the calculated phase differences;
isolating, by the processor, second audio data received from the plurality of microphones, taking into account the determined location of the source;
controlling a function of the vehicle based on the isolated second audio data;
detecting, by the processor, voice data in the second audio data based on audio characteristics of the second audio data;
determining, by the processor, a voice command in the voice data,
wherein the controlling the function of the vehicle is based on the voice command in the voice data in the second audio data,
generating a user profile associated with the voice data;
detecting changes to driver-controlled performance characteristics of the vehicle;
associating the detected changes with the user profile;
detecting subsequent audio data having audio characteristics corresponding to the voice data;
determining that a location of a source of the subsequent audio data is located in the driver's seat; and
applying the detected changes to the driver-controlled performance characteristics of the vehicle.

7. The system of claim 6 further comprising instructions configured to cause the one or more processors to perform operations including:
determining, by the processor, a location of a second source of third audio data received from the different ones of the plurality of microphones;
isolating, by the processor, fourth audio data received from the plurality of microphones, taking into account the determined location of the second source; and
controlling a second function of the vehicle based on the isolated fourth audio data.

8. The system of claim 6 wherein the vehicle includes a plurality of passenger seats, and wherein the system further comprises instructions configured to cause the one or more processors to perform operations including:
determining, by the processor, which of the plurality of passenger seats corresponds to the determined location of the source of the first audio data; and
associating a priority to the second audio data based on the determined corresponding passenger seat.

9. The system of claim 8 wherein when the determined corresponding passenger seat is a driver's seat, the associated priority of the second audio data is assigned a highest priority, and wherein when the determined corresponding passenger seat is not the driver's seat the associated priority of the second audio data is assigned a lower priority.

10. The system of claim 6 wherein isolating the second audio data includes adjusting a directional focus of the plurality of microphones toward the determined location of the source of the first audio data.

11. A system comprising:
means for receiving first audio data from a plurality of microphones disposed in a cabin of a vehicle;
means for calculating phase differences between the first audio data received from different ones of the plurality of microphones;
means for determining that a location of a source of the first audio data is located in a driver's seat based on the calculated phase differences;
means for isolating second audio data received from the plurality of microphones, taking into account the determined location of the source;
means for detecting voice data in the second audio data based on audio characteristics of the second audio data;
means for determining a voice command in the voice data,
means for generating a user profile associated with the voice data;
means for detecting changes to driver-controlled performance characteristics of the vehicle;
means for associating the detected changes with the user profile;
means for detecting subsequent audio data having audio characteristics corresponding to the voice data;
means for determining that a location of a source of the subsequent audio data is located in the driver's seat;
means for applying the detected changes to the driver-controlled performance characteristics of the vehicle; and
means for controlling a function of the vehicle is based on the voice command in the voice data in the second audio data.

12. The system of claim 11 further comprising:
means for determining a location of a second source of third audio data received from the different ones of the plurality of microphones;
means for isolating fourth audio data

Assignees

• Faraday&Future Inc
• Faraday & Future Inc

Inventors

• Ekkizogloy Luke Michael
• Kolluru Sethu Hareesh
• Liu Yunwei
• Brouwer Michael Lambertus Hubertus

Classifications

• G10L2021/02166

  Microphone arrays; Beamforming · CPC title

• G01S5/22

  Position of source determined by co-ordinating a plurality of position lines defined by path-difference measurements (G01S5/28 takes precedence) · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G10L21/0208

  Noise filtering · CPC title

• H04R29/004 Primary

  for microphones (H04R29/007 takes precedence) · CPC title