Self-calibrating microphone and loudspeaker arrays for wearable audio devices

Patent metadata

Field	Value
Publication number	US-11832082-B2
Application number	US-202117514881-A
Country	US
Kind code	B2
Filing date	Oct 29, 2021
Priority date	Jun 21, 2019
Publication date	Nov 28, 2023
Grant date	Nov 28, 2023

Abstract

A method for self-calibrating a sound pickup process that uses a microphone array in a wearable device that also includes a loudspeaker, where the microphone array being in a physical arrangement with respect to the loudspeaker. The method obtains, for each of several microphones of the microphone array, one or more transfer functions that each represent a response of the microphone to sound from a position in an acoustic space. The method determines whether a physical arrangement of the microphone array with respect to the loudspeaker has changed and adjusts the transfer function, for at least one of the microphones of the several microphones, in response to determining that the current physical arrangement of the microphone array with respect to the loudspeaker has changed.

First claim

What is claimed is:

1. A method for self-calibrating a sound pickup process that uses a microphone array in a wearable device that also includes a loudspeaker, the microphone array being in a physical arrangement with respect to the loudspeaker, the method comprising:
obtaining, for each of a plurality of microphones of the microphone array, one or more transfer functions that each represents a response of the microphone to sound from a position in an acoustic space;
determining whether a physical arrangement of the microphone array with respect to the loudspeaker has changed; and
adjusting the transfer function, for at least one of the microphones of the plurality of microphones, in response to determining that the physical arrangement of the microphone array with respect to the loudspeaker has changed.

2. The method of claim 1 , wherein the wearable device is a pliable device, wherein the physical arrangement of microphone array changes in response to a shape of the pliable device changing.

3. The method of claim 1 , wherein the transfer function for each of the plurality of microphones is a far-field transfer function, and wherein determining whether the physical arrangement of the microphone array with respect to the loudspeaker has changed comprises:
outputting an audio signal by the loudspeaker; and
measuring a near-field transfer function of at least one of the microphones of the plurality of microphones to the loudspeaker, responsive to the output of the audio signal outputted by the loudspeaker.

4. The method of claim 3 , wherein adjusting the far-field transfer function comprises selecting a different far-field transfer function according to the measured near-field transfer function by performing a table lookup in a data structure that associates far-field transfer functions with near-field transfer functions.

5. The method of claim 1 , wherein adjusting the transfer function comprises:
determining a current physical arrangement of the microphone array with respect to the loudspeaker;
comparing the current physical arrangement of the microphone array with one or more physical arrangements of the microphone array that were determined prior to the current physical arrangement; and
determining a difference based on the comparison;
wherein the transfer function is adjusted according to the determined difference.

6. The method of claim 1 further comprising using the adjusted transfer function to determine beamforming weights for a beamforming sound pickup process.

7. The method of claim 1 , wherein the wearable device includes a strain gauge sensor, wherein determining the whether the physical arrangement has changed further comprises:
measuring a resistance of the strain gauge sensor; and
identifying that the resistance is at or above a threshold value.

8. The method of claim 1 , wherein the wearable device includes a camera, wherein determining whether the physical arrangement has changed further comprises:
obtaining image data captured by the camera that is representative of a portion of the wearable device; and
comparing image data previously captured by the camera that is representative of the portion of the wearable device and the obtained image data captured by the camera that is representative of the portion of the wearable device,
wherein adjusting the transfer function is based on comparing the image data.

9. A wearable device comprising:
a loudspeaker;
an microphone array having a physical arrangement with respect to the loudspeaker, the microphone array comprising a plurality of microphones;
a processor; and
memory having stored therein instructions that when executed by the processor causes the wearable device to:
obtain, for each of the plurality of microphones of the microphone array, one or more transfer functions that each represents a response of the microphone to sound from a position in an acoustic space;
determine whether the physical arrangement of the microphone array with respect to the loudspeaker has changed; and
adjust the transfer function, for at least one of the microphones of the plurality of microphones, in response to determining that the physical arrangement of the microphone array with respect to the loudspeaker has changed.

10. The wearable device of claim 9 , wherein the transfer function for each of the plurality of microphones is a far-field transfer function, wherein instructions to determine whether the physical arrangement of the microphone array with respect to the loudspeaker has changed comprises instructions that when executed by the processor causes the wearable device to:
output an audio signal by the loudspeaker; and
measure a near-field transfer function of at least one of the microphones of the plurality of microphones to the loudspeaker, responsive to the output of the audio signal by the loudspeaker.

11. The wearable device of claim 10 , wherein the instructions to adjust the far-field transfer function comprises instructions that when executed by the processor causes the wearable device to select a different far-field transfer function according to the measured near-field transfer function by performing a table lookup into a data structure that associates far-field transfer functions with near-field transfer functions.

12. The wearable device of claim 10 , wherein the instructions to determine whether the physical arrangement of the microphone array with respect to the loudspeaker has changed comprises instructions to determine a difference between the measured near-field transfer function and a previously measured near-filed transfer function of the at least one of the microphone of the plurality of microphones, prior to the change in the physical arrangement of the microphone array,
wherein the far-field transfer function is adjusted according to the determined difference.

13. The wearable device of claim 9 further comprises a strain gauge sensor, wherein the instructions to determine whether the physical arrangement has changed comprises instructions to:
measure a resistance of the strain gauge sensor; and
identify that the resistance is at or above a threshold value.

14. The wearable device of claim 9 further comprises a camera, wherein the instructions to determine whether the physical arrangement has changed comprises instructions to:
obtain image data captured by the camera that is representative of a portion of the wearable device; and
compare image data previously captured by the camera that is representative of the portion of the wearable device and the obtained image data captured by the camera that is representative of the portion of the wearable device,
wherein the transfer function is adjusted based on the comparing the image.

15. The wearable device of claim 9 further comprises
a first portion that is rotatably coupled to a second portion about an axis, each portion having at least one of the microphones of the plurality of microphones; and
a rotational encoder that is arranged to detect rotation of the first portion about the axis and produce an electrical signal that represents an angle between the first and second portions about the axis in response to the first portion's rotation,
wherein the instructions to determine whether the physical arrangement of the microphone array with respect to the loudspeaker has changed comprises instructions to compare the angle with a previous angle between the first and second portions about the axis.

16. A non-transitory machine-readable medium having stored therein instructions which when executed by at least one processor of a wearable d

Assignees

• Apple Inc

Inventors

• Sheaffer Jonathan D
• Boothe Daniel K
• Johnson Martin E
• Evans Neal D
• Vitt Nikolas T
• Eubank Christopher T
• Jupin Peter V
• Delikaris Manias Symeon
• Messingher Lang Shai

Classifications

• H04S7/301 Primary

  Automatic calibration of stereophonic sound system, e.g. with test microphone · CPC title

• H04R1/1008

  Earpieces of the supra-aural or circum-aural type · CPC title

• H04R1/403

  loud-speakers · CPC title

• H04R1/406

  microphones · CPC title

• H04R29/005

  Microphone arrays · CPC title