System and method for listener controlled beamforming

Patent metadata

Field	Value
Publication number	US-9729994-B1
Application number	US-201414456577-A
Country	US
Kind code	B1
Filing date	Aug 11, 2014
Priority date	Aug 9, 2013
Publication date	Aug 8, 2017
Grant date	Aug 8, 2017

Abstract

A system and method for providing assistive listening for a plurality of listeners in an environment including a plurality of acoustic sources. A microphone array in combination with an acoustic beamforming processor configured to receive the acoustic signals within the environment and to process the acoustic signals based upon a target location of an acoustic signal selected on a listener-controlled interface device to generate a steered beam pattern. The acoustic beamforming processor further configured to transmit the steered beam pattern to the listener-controlled interface device based on the target location selected. The listener-controlled interface device configured to provide the steered beam pattern to an ear-level transducer of a hearing-impaired listener.

First claim

What is claimed is:

1. A method to provide assistive listening for a plurality of listeners in an environment comprising a plurality of acoustics sources, the method comprising:
receiving, at one or more microphone arrays located in an environment, an acoustic signal from each of a plurality of acoustic sources located in the environment, wherein one or more of the plurality of acoustic sources are mobile acoustic sources;
transmitting the acoustic signal received from each of the plurality of acoustic sources located in the environment to an acoustic beam forming processor;
determining, at the acoustic beamforming processor, a location of each of the plurality of acoustic sources in the environment;
transmitting, from the acoustic beamforming processor, the location of each of the plurality of acoustic sources in the environment to one or more listener-controlled interface devices located in the environment, wherein each of the one or more listener-controlled interface devices are located distant from the acoustic beamforming processor;
displaying the location of each of the plurality of acoustic sources in the environment on the one or more listener-controlled interface devices;
selecting a target location of a mobile acoustic source from the locations displayed on the one or more listener-controlled interface devices;
processing, at the acoustic beamforming processor, the acoustic signals from each of the plurality of acoustic sources to generate a steered beam pattern focused at the target location of the mobile acoustic source selected on each of the one or more listener-controlled interface devices;
transmitting, from the acoustic beamforming processor, the steered beam pattern to one or more of the listener-controlled interface devices based upon the target location of the mobile acoustic source selected on the listener-controlled interface device;
tracking, at the acoustic beamforming device, the movement of the target location of the mobile acoustic source using a an acoustic tracking algorithm; and
adjusting, at the acoustic beamforming device, the steered beam pattern based upon the movement of the target location of the mobile acoustic source.

2. The method of claim 1 , further comprising, transmitting the steered beam pattern from the listener-controlled interface to an ear-level transducer.

3. The method of claim 1 , wherein processing, at the acoustic beamforming device, the acoustic signals from each of the plurality of acoustic sources to generate a steered beam pattern focused at the target location selected on each of the one or more listener-controlled interface devices further comprises, performing delay-sum beamforming of each of the plurality of acoustic signals based upon the selected target location.

4. The method of claim 1 , wherein processing, at the acoustic beamforming device, the acoustic signals from each of the plurality of acoustic sources to generate a steered beam pattern focused at the target location selected on each of the one or more listener-controlled interface devices further comprises, amplifying the one or more acoustic signals of the acoustic sources at the selected target location.

5. The method of claim 1 , wherein processing, at the acoustic beamforming device, the acoustic signals from each of the plurality of acoustic sources to generate a steered beam pattern focused at the target location selected on each of the one or more listener-controlled interface devices further comprises, attenuating the acoustic signals of the acoustic sources at the locations other than the selected target location.

6. The method of claim 1 , further comprising, performing spatial calibration to identify a location of each of the listener-controlled interface devices in the environment.

7. The method of claim 1 , wherein the mobile acoustic source is a human speaker acoustic source, the method further comprising:
analyzing one or more characteristics of the human speaker acoustic source;
identifying the human speaker acoustic source as belonging to one of a plurality of known human speakers; and
wherein tracking, at the acoustic beamforming device, the movement of the target location of the mobile acoustic source using an acoustic tracking algorithm further comprises tracking the movement of the target location of the mobile acoustic source based upon the identification of the human speaker.

8. A system to provide assistive listening for a plurality of listeners in an environment comprising a plurality of acoustics sources, the system comprising:
an acoustic beam forming processor;
a microphone array configured for receiving an acoustic signal from each of a plurality of acoustic sources located in an environment and for transmitting the acoustic signal received from each of the plurality of acoustic sources located in the environment to the acoustic beam forming processor, wherein one or more of the acoustics sources are mobile acoustic sources;
a listener-controlled interface device located in the environment, wherein the listener-controlled interface device is located distant from the acoustic beamforming processor;
the acoustic beam forming processor configured for determining a location of each of the plurality of acoustic sources in the environment and for transmitting the location of each of the plurality of acoustic sources in the environment to the listener-controlled interface device;
the listener-controlled interface device configured for displaying the location of each of the plurality of acoustic sources in the environment on the listener-controlled interface device and for selecting a target location of a mobile acoustic source from the locations displayed on the listener-controlled interface device;
the acoustic beamforming processor further configured for processing the acoustic signals received from each of the plurality of acoustic sources and the target location of the mobile acoustic source selected on the listener controlled interface device to generate a steered beam pattern focused at the target location of the mobile acoustic source selected on the listener-controlled interface device, for transmitting the steered beam pattern to the listener-controlled interface devices based on the target location of the mobile acoustic source selected on the listener-controlled interface device, for tracking the movement of the target location of the mobile acoustic source using an acoustic tracking algorithm and for adjusting the steered beam pattern based upon the movement of the target location of the mobile acoustic source.

9. The system of claim 8 , wherein the listener-controlled interface device is further configured for transmitting the steered beam pattern from the listener-controlled interface device to an ear-level transducer.

10. The system of claim 8 , wherein the beamforming processor is further configured for performing delay-sum beamforming of each of the plurality of acoustic signals based upon the target location selected.

11. The system of claim 8 , wherein the beamforming processor is further configured for amplifying the one or more acoustic signals of the acoustic sources at the target location selected.

12. The system of claim 8 , wherein the beamforming processor is further configured for attenuating the acoustic signals of the acoustic sources at the locations other than the target location selected.

13. The system of claim 8 , wherein the beamforming processor is further configured for performing spatial calibration to identify a location the listener-controlled interface device in the environment.

14. The system of claim 8 , wherein the acoustic source is a human

Assignees

• Eddins David A
• Borkholder David A
• Amuso Vincent J
• Univ South Florida
• Rochester Inst Of Tech

Inventors

• Eddins David A
• Borkholder David A
• Amuso Vincent J

Classifications

• H04S7/302 Primary

  Electronic adaptation of stereophonic sound system to listener position or orientation (H04S7/301 takes precedence) · CPC title

• H04S2400/11

  Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) · CPC title

• G10K11/341

  Circuits therefor · CPC title

• H04R2203/12

  Beamforming aspects for stereophonic sound reproduction with loudspeaker arrays · CPC title

• H04R2430/20

  Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic (H04R2203/12 takes precedence) · CPC title