Method and apparatus for wind noise detection and beam pattern processing

Patent metadata

Field	Value
Publication number	US-11356786-B2
Application number	US-202017002131-A
Country	US
Kind code	B2
Filing date	Aug 25, 2020
Priority date	Sep 16, 2019
Publication date	Jun 7, 2022
Grant date	Jun 7, 2022

Abstract

An image capture device includes a sensor, a microphone array, and a processor. The microphone array may include a first microphone, a second microphone, a third microphone, or any combination thereof. The first microphone may be configured to face a first direction. The second microphone may be configured to face a second direction. The second direction may be diametrically opposed to the first direction. The third microphone may be configured to face a third direction. The third direction may be substantially perpendicular to the first direction, the second direction, or both. The processor may be configured to determine a microphone capture pattern and detect wind noise. The microphone capture pattern may be determined based on data obtained from the sensor. The sensor data may include image data, audio data, image capture device orientation data, location data, accelerometer data, or any combination thereof.

First claim

What is claimed is:

1. An image capture device comprising:
a first image sensor facing a first direction, the first image sensor configured to obtain first image data;
a second image sensor facing a second direction, the second direction being diametrically opposed to the first direction, the second image sensor configured to obtain second image data;
a first microphone assembly facing the first direction, wherein the first microphone assembly comprises a first microphone and a second microphone;
a second microphone assembly facing the second direction, wherein the second microphone assembly comprises a third microphone;
a third microphone assembly facing a third direction that is perpendicular to the first and second directions, wherein the third microphone assembly comprises a fourth microphone and a fifth microphone; and
a processor configured to:
determine an activity based on at least one of the first image data or the second image data;
determine a microphone capture pattern using at least two microphones based on the activity; and
detect wind noise based on a coherence value between the at least two microphones.

2. The image capture device of claim 1 , wherein the microphone capture pattern is created using the first microphone assembly, the second microphone assembly, or the third microphone assembly.

3. The image capture device of claim 1 , wherein the microphone capture pattern is created using the first microphone and the second microphone, and the at least two microphones comprise the first microphone and the second microphone.

4. The image capture device of claim 1 , wherein the microphone capture pattern is created using the first microphone and the second microphone, and the at least two microphones comprise the fourth microphone and the fifth microphone.

5. The image capture device of claim 1 , wherein the microphone capture pattern is created using the third microphone, and the at least two microphones comprise the fourth microphone and the fifth microphone.

6. The image capture device of claim 1 , wherein the microphone capture pattern is created using the fourth microphone and the fifth microphone, and the at least two microphones comprise the first microphone and the second microphone.

7. The image capture device of claim 1 , wherein the microphone capture pattern is created using the fourth microphone and the fifth microphone, and the at least two microphones comprise the fourth microphone and the fifth microphone.

8. The image capture device of claim 1 , wherein the processor is further configured to segment a signal from each of the at least two microphones into bins to detect wind noise.

9. The image capture device of claim 1 , wherein the processor is further configured to determine whether the coherence value is below a threshold.

10. The image capture device of claim 9 , wherein on a condition that the coherence value is below the threshold, the processor is further configured to determine that wind noise is present.

11. The image capture device of claim 9 , wherein on a condition that the coherence value is above the threshold, the processor is further configured to determine that wind noise is not present.

12. A method comprising:
obtaining first image data from a first image sensor facing a first direction;
obtaining second image data from a second image sensor facing a second direction, the second direction being diametrically opposed to the first direction;
determining an activity based on at least one of the first image data or the second image data;
determining a microphone capture pattern using at least two microphones based on the activity; and
detecting wind noise based on a coherence value between the at least two microphones.

13. The method of claim 12 , wherein detecting wind noise comprises:
segmenting a signal from each of the at least two microphones into bins;
determining, for each bin, the coherence value between the at least two microphones; and
determining whether the coherence value is below a threshold.

14. The method of claim 13 further comprising:
determining that wind noise is present on a condition that the coherence value is below a threshold; and
transitioning the microphone capture pattern to a wind processing mode.

15. The method of claim 13 , wherein a first set of bins may be processed differently than a second set of bins, wherein the first set of bins is for wind processing.

16. The method of claim 12 , wherein the coherence value is a measurement of correlation for each bin of a signal between two microphones.

17. An image capture device comprising:
a sensor;
a first microphone assembly facing a first direction;
a second microphone assembly facing a second direction, the second direction being diametrically opposed to the first direction;
a third microphone assembly facing a third direction that is perpendicular to the first and second directions; and
a processor configured to:
determine an activity based on image data; and
determine a microphone capture pattern and a microphone assembly for wind noise detection based on the activity and data obtained from the sensor.

18. The image capture device of claim 17 , wherein the sensor is an inertial measurement unit (IMU).

19. The image capture device of claim 17 , wherein the microphone capture pattern is associated with a sound field of the first microphone assembly, and the microphone assembly for wind noise detection is the third microphone assembly.

20. The image capture device of claim 17 , wherein the microphone capture pattern is associated with a sound field of the first microphone assembly, and the microphone assembly for wind noise detection is the first microphone assembly.

Assignees

• Gopro Inc

Inventors

• Tisch Erich
• Penrod Eric
• Hardin Mark
• Dick Timothy
• Mesiwala Hakim

Classifications

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title

• H04R3/005

  for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407) · CPC title

• H04R2430/03

  Synergistic effects of band splitting and sub-band processing · CPC title

• H04R2410/07

  Mechanical or electrical reduction of wind noise generated by wind passing a microphone · CPC title

• H04S3/008

  in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02) · CPC title