Field of view based audio selection

Patent metadata

Field	Value
Publication number	US-2024388845-A1
Application number	US-202418785227-A
Country	US
Kind code	A1
Filing date	Jul 26, 2024
Priority date	Oct 24, 2022
Publication date	Nov 21, 2024
Grant date	—

Abstract

Systems and methods are described for improving audio quality. Sensor data is received from an accelerometer of a camera. Based on measurements captured by the sensor data, a position of a lens of the camera and a current field of view (FOV) of the camera is determined. Audio beamforming is performed based on the current FOV of the camera by selecting a subset of microphones disposed on the camera to record audio based on the position of the lens and the current FOV of the camera; and activating the subset of microphones disposed on the camera, where microphones outside the selected subset of microphones are excluded from activation so that audio originating outside of the current FOV is removed.

First claim

What is claimed is:

1 . A method for improving audio quality comprising:
determining a current field of view (FOV) of a camera based on an output from at least one sensor of the camera; activating a subset of microphones disposed on the camera based on the output; and excluding from activation microphones other than the subset of microphones based on the output, thereby restricting a recording of audio originating outside of the current FOV.

2 . The method of claim 1 , the method further comprising:
analyzing audio from one or more microphones on the camera to determine signal amplitudes within the audio; and selecting the subset of microphones to be activated based on the one or more microphones with a highest signal amplitude or lowest average level of noise.

3 . The method of claim 1 , the method further comprising:
determining, based on sensor data from an accelerometer and a gyroscope of the camera, a direction of incident light received by a lens of the camera; and selecting the subset of microphones disposed on the camera to record audio based on the direction of incident light received by the lens.

4 . The method of claim 1 , the method further comprising:
receiving first accelerometer data from a first accelerometer disposed on a base of the camera; receiving second accelerometer data from a second accelerometer disposed on a sensor board of the camera, wherein the sensor board of the camera is moveable to point in a range of directions; and detecting a direction of a lens of the camera in relation to a body of the camera based on a combination of at least the first accelerometer data and the second accelerometer data, wherein the detected direction of the lens of the camera provides dynamic information about tilt and movement of the lens in relation to the body of the camera, and wherein the body of the camera is a point of reference for the movement of the lens.

5 . The method of claim 1 , the method further comprising:
arranging audio beamforming to match an area covered by the current FOV of the camera, wherein the audio beamforming matches a direction a lens is pointed and sound outside the current FOV is attenuated.

6 . The method of claim 1 , the method further comprising:
switching from a first mode of matching audio beamforming to the current FOV to a second mode of receiving omnidirectional audio.

7 . The method of claim 1 , the method further comprising:
determining that one or more of the microphones are occluded by a portion of a camera body, preventing audio detection for a region of interest within the current FOV; and dynamically selecting the subset of microphones based on the determination that each microphone within the subset is not occluded by the portion of the camera body.

8 . A computing apparatus comprising:
a processor; and a memory storing instructions that, when executed by the processor, configure the apparatus to:
determine a current field of view (FOV) of a camera based on an output from at least one sensor of the camera;
activate a subset of microphones disposed on the camera based on the output; and
exclude from activation microphones other than the subset of microphones based on the output, thereby restricting a recording of audio originating outside of the current FOV.

9 . The computing apparatus of claim 8 , wherein the instructions further configure the apparatus to:
analyze audio from one or more microphones on the camera to determine signal amplitudes within the audio; and select the subset of microphones to be activated based on the one or more microphones with a highest signal amplitude or lowest average level of noise.

10 . The computing apparatus of claim 8 , wherein the instructions further configure the apparatus to:
determine, based on sensor data from an accelerometer and a gyroscope of the camera, a direction of incident light received by a lens of the camera; and select the subset of microphones disposed on the camera to record audio based on the direction of incident light received by the lens.

11 . The computing apparatus of claim 8 , wherein the instructions further configure the apparatus to:
receive first accelerometer data from a first accelerometer disposed on a base of the camera; receive second accelerometer data from a second accelerometer disposed on a sensor board of the camera, wherein the sensor board of the camera is moveable to point in a range of directions; and detect a direction of a lens of the camera in relation to a body of the camera based on a combination of at least the first accelerometer data and the second accelerometer data, wherein the detected direction of the lens of the camera provides dynamic information about tilt and movement of the lens in relation to the body of the camera, and wherein the body of the camera is a point of reference for the movement of the lens.

12 . The computing apparatus of claim 8 , wherein the instructions further configure the apparatus to:
arrange audio beamforming to match an area covered by the current FOV of the camera, wherein the audio beamforming matches a direction a lens is pointed and sound outside the current FOV is attenuated.

13 . The computing apparatus of claim 8 , wherein the instructions further configure the apparatus to:
switch from a first mode of matching audio beamforming to the current FOV to a second mode of receiving omnidirectional audio.

14 . The computing apparatus of claim 8 , wherein the instructions further configure the apparatus to:
determine that one or more of the microphones are occluded by a portion of a camera body, preventing audio detection for a region of interest within the current FOV; and dynamically select the subset of microphones based on the determination that each microphone within the subset is not occluded by the portion of the camera body.

15 . A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:
determine a current field of view (FOV) of a camera based on an output from at least one sensor of the camera; activate a subset of microphones disposed on the camera based on the output; and exclude from activation microphones other than the subset of microphones based on the output, thereby restricting a recording of audio originating outside of the current FOV.

16 . The non-transitory computer-readable storage medium of claim 15 , wherein the instructions further configure the computer to:
analyze audio from one or more microphones on the camera to determine signal amplitudes within the audio; and select the subset of microphones to be activated based on the one or more microphones with a highest signal amplitude or lowest average level of noise.

17 . The non-transitory computer-readable storage medium of claim 15 , wherein the instructions further configure the computer to:
determine, based on sensor data from an accelerometer and a gyroscope of the camera, a direction of incident light received by a lens of the camera; and select the subset of microphones disposed on the camera to record audio based on the direction of incident light received by the lens.

18 . The non-transitory computer-readable storage medium of claim 15 , wherein the instructions further configure the computer to:
receive first accelerometer data from a first accelerometer disposed on a base of the camera; receive second accelerometer data from a second accelerometer disposed on a sensor board of the camera,

Assignees

• Cisco Tech Inc

Inventors

• Snyder Ian Matthew
• Swamy Ramkrishna

Classifications

• H04R1/028 Primary

  associated with devices performing functions other than acoustics, e.g. electric candles · CPC title

• H04R29/005

  Microphone arrays · CPC title

• H04R1/406

  microphones · CPC title

• H04R2499/11

  Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title