Microphone pattern based on selected image of dual lens image capture device

Patent metadata

Field	Value
Publication number	US-10966017-B2
Application number	US-201916239973-A
Country	US
Kind code	B2
Filing date	Jan 4, 2019
Priority date	Jan 4, 2019
Publication date	Mar 30, 2021
Grant date	Mar 30, 2021

Abstract

An image capture device may include a sensor, a microphone array, and a processor. The microphone array may include a first microphone, a second microphone, a third microphone, or any combination thereof. The first microphone may be configured to face a first direction. The second microphone may be configured to face a second direction. The second direction may be diametrically opposed to the first direction. The third microphone may be configured to face a third direction. The third direction may be substantially perpendicular to the first direction, the second direction, or both. The processor may be configured to determine a microphone capture pattern. The microphone capture pattern may be determined based on data obtained from the sensor. The sensor data may include image data, audio data, image capture device orientation data, location data, accelerometer data, or any combination thereof.

First claim

What is claimed is:

1. An image capture device comprising:
a first hyper-hemispherical image sensor on a first surface facing a first direction, the first image sensor having a first field-of-view (FOV) and configured to obtain first image data;
a second hyper-hemispherical image sensor facing a second direction, the second direction being diametrically opposed to the first direction, the second image sensor having a second FOV that partially overlaps with the first FOV and configured to obtain second image data;
a microphone array comprising:
a first microphone component facing the first direction, wherein the first microphone component comprises three microphone elements in a triangular arrangement, wherein the three microphone elements are on a same side of the first surface relative to the first hyper-hemispherical image sensor;
a second microphone component facing the second direction, wherein the second microphone component comprises at least one microphone element; and
a third microphone component facing a third direction that is perpendicular to the first and second directions, wherein the third microphone component comprises at least two microphone elements arranged parallel to an optical axis of the first hyper-hemispherical image sensor or the second hyper-hemispherical image sensor; and

a processor configured to determine a microphone capture pattern based on a detected direction of voice audio.

2. The image capture device of claim 1 , wherein the microphone capture pattern is associated with a sound field of the first microphone component, a sound field of the second microphone component, or a sound field of the third microphone component.

3. The image capture device of claim 1 , wherein the microphone capture pattern is associated with a sound field of the first microphone component and the second microphone component.

4. The image capture device of claim 1 , wherein the microphone capture pattern is associated with a sound field of the first microphone component and the third microphone component.

5. The image capture device of claim 1 , wherein the microphone capture pattern is associated with a sound field of the second microphone component and the third microphone component.

6. The image capture device of claim 1 , wherein the microphone capture pattern is associated with a sound field of the first microphone component, the second microphone component, and the third microphone component.

7. A method comprising:
obtaining first image data from a first hyper-hemispherical image sensor on a first surface facing a first direction;
obtaining second image data from a second hyper-hemispherical image sensor facing a second direction, the second direction being diametrically opposed to the first direction;
obtaining a first microphone signal from a first microphone component facing the first direction that includes three microphone elements in a triangular arrangement, wherein the three microphone elements are on a same side of the first surface relative to the first image sensor;
obtaining a second microphone signal from a second microphone component that includes at least one microphone element;
obtaining a third microphone signal from a third microphone component that includes at least two microphone elements arranged parallel to an optical axis of the first hyper-hemispherical image sensor or the second hyper-hemispherical image sensor; and
determining a microphone capture pattern based on a detected direction of voice audio.

8. The method of claim 7 , wherein the determined microphone capture pattern is associated with a sound field of the first microphone component facing the first direction, a sound field of the second microphone component facing the second direction, or a sound field of the third microphone component facing a third direction that is perpendicular to the first and second directions.

9. The method of claim 7 , wherein the determined microphone capture pattern is associated with a sound field of the first microphone component and the second microphone component.

10. The method of claim 7 , wherein the determined microphone capture pattern is associated with a sound field of the first microphone component and the third microphone component.

11. The method of claim 7 , wherein the determined microphone capture pattern is associated with a sound field of the second microphone component and the third microphone component.

12. The method of claim 7 , wherein the determined microphone capture pattern is associated with a sound field of the first microphone component, the second microphone component, and the third microphone component.

13. An image capture device comprising:
a sensor;
a microphone array comprising:
a first microphone component facing a first direction, wherein the first microphone component comprises three microphone elements in a triangular arrangement spaced at least 6 mm and less than 18 mm apart;
a second microphone component facing a second direction, the second direction being diametrically opposed to the first direction, wherein the second microphone component comprises at least one microphone element; and
a third microphone component facing a third direction that is perpendicular to the first and second directions, wherein the third microphone component comprises at least two microphone elements; and
a processor configured to determine a microphone capture pattern based on a detected direction of voice audio.

14. The image capture device of claim 13 , wherein the sensor is an image sensor.

15. The image capture device of claim 13 , wherein the sensor is an inertial measurement unit (IMU).

16. The image capture device of claim 13 , wherein the sensor is a global positioning system (GPS) receiver component.

17. The image capture device of claim 13 , wherein the first microphone component is configured to transform a sound capture to an X-axis component of an Ambisonics B-Format.

18. The image capture device of claim 13 , wherein the second microphone component is configured to transform a sound capture to a Y-axis component of an Ambisonics B-Format.

19. The image capture device of claim 13 , wherein the third microphone component is configured to transform a sound capture to a Z-axis component of an Ambisonics B-Format.

20. The image capture device of claim 13 , wherein the second microphone component is configured as a drain microphone.

Assignees

• Gopro Inc

Inventors

• Hardin Mark
• Tisch Erich
• Penrod Eric

Classifications

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• H04N23/60

  Control of cameras or camera modules · CPC title

• H04N23/51

  Housings · CPC title

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title