Ambient sound enhancement and acoustic noise cancellation based on context

Patent metadata

Field	Value
Publication number	US-11276384-B2
Application number	US-202016871661-A
Country	US
Kind code	B2
Filing date	May 11, 2020
Priority date	May 31, 2019
Publication date	Mar 15, 2022
Grant date	Mar 15, 2022

Abstract

An audio system has an ambient sound enhancement function, in which an against-the-ear audio device having a speaker converts a digitally processed version of an input audio signal into sound. The audio system also has an acoustic noise cancellation (ANC) function that may be combined in various ways with the sound enhancement function, and that may be responsive to voice activity detection. Other aspects are also described and claimed.

First claim

What is claimed is:

1. A method for sound enhancement by an against the ear audio device that can also produce anti-noise for acoustic noise cancellation, the method comprising:
producing an ambient sound signal from an external microphone so that a user of the against the ear audio device hears their environment while wearing the device;
determining user context of the user while the user is wearing the device, wherein the user context is determined automatically or without instruction from the user; and
based on the determined user context, producing using the external microphone an anti-noise signal for acoustic noise cancellation, ANC, and combining the anti-noise signal with the ambient sound signal before together driving a speaker of the against the ear audio device,
a) determining that the user context has changed in a first instance by detecting that ambient sound level is above a threshold and in response i) attenuating the ambient sound signal by reducing gain applied to the ambient sound signal while contemporaneously ii) raising a level of the anti-noise signal, and
b) determining that the user context has changed in a second instance by detecting that ambient sound level is below the threshold and in response i) raising the ambient sound signal by increasing the gain applied to the ambient sound signal while contemporaneously ii) reducing the level of the anti-noise signal but still producing anti-noise.

2. The method of claim 1 wherein determining user context comprises detecting that ambient sound level is above a threshold,
and wherein attenuating the ambient sound signal comprises reducing an amplitude gain that is applied to detected ambient sound, by more than 20 dB.

3. The method of claim 1 wherein determining user context indicates the user is at a concert, the method further comprising flattening a spectrum of the ambient sound signal in response to the user context being at the concert.

4. The method of claim 1 further comprising
detecting speech and in response increasing gain of speech frequencies in the ambient sound signal.

5. The method of claim 4 further comprising
attenuating the ambient sound signal in response to detecting speech.

6. A method performed by a system having an against the ear audio device, the method comprising:
reproducing sound of a wearer's environment in a pass-through mode via an ambient sound signal from an external microphone, wherein the pass-through mode is one of a plurality of operating modes;
attenuating the reproduced sound in an attenuated pass-through mode by reducing a gain that is applied to the ambient sound signal, while still allowing some reproduced sound to be heard by the wearer, wherein the attenuated pass through mode is one of the plurality of operating modes;
further attenuating the reproduced sound by further reducing the gain that is applied to the ambient sound signal while producing anti-noise via an anti-noise signal using the external microphone, and combining the anti-noise signal with the ambient sound signal before together driving a speaker of the against the ear audio device in an active ear plug mode to protect the wearer's hearing when the wearer's environment has become too loud, wherein the active ear plug mode is one of the plurality of operating modes; and
transitioning the system between the plurality of operating modes in response to user context by
a) determining that the user context has changed in a first instance by detecting that ambient sound level is above a threshold and in response i) attenuating the ambient sound signal and ii) raising a level of the anti-noise signal by increasing a gain that is applied to the anti-noise signal, and
b) determining that the user context has changed in a second instance by detecting that ambient sound level is below the threshold and in response i) raising the ambient sound signal by increasing the gain applied to the ambient sound signal and ii) reducing the level of the anti-noise signal but still producing anti-noise.

7. An audio system for enhancing sound produced by an against the ear audio device, the audio system comprising:
a processor; and
memory having stored therein instructions that configure the processor to
drive a speaker of the against the ear audio device to reproduce ambient sound via an ambient sound signal from an external microphone in the against the ear audio device so that a user of the against the ear audio device hears their environment while wearing the device,
determine user context of the user while the user is wearing the device, wherein the user context is determined automatically or without instruction from the user, and
based on the determined user context, drive the speaker of the against the ear audio device to produce anti-noise for acoustic noise cancellation, ANC, of the ambient sound via an anti-noise signal using the external microphone, and combining the anti-noise signal with the ambient sound signal before together driving the speaker of the against the ear audio device,
a) determine that the user context has changed in a first instance by detecting that ambient sound level is above a threshold and in response i) attenuating the ambient sound signal by reducing gain applied to the ambient sound signal while contemporaneously ii) raising a level of the anti-noise signal, and
b) determining that the user context has changed in a second instance by detecting that ambient sound level is below the threshold and in response i) raising the ambient sound signal by increasing the gain applied to the ambient sound signal while contemporaneously ii) reducing the level of the anti-noise signal but not eliminating anti-noise.

8. The audio system of claim 7 wherein the processor determines user context by detecting that ambient sound level is above a threshold,
and attenuates the ambient sound signal by attenuating an amplitude gain that is applied to the ambient sound signal by more than 20 dB.

9. The audio system of claim 7 wherein the memory has stored therein further instructions that configure the processor to drive the speaker to flatten a spectrum of the ambient sound signal in response to the user context being at a concert.

10. The audio system of claim 7 wherein the memory has stored therein further instructions that configure the processor to detect speech and in response a) increase gain of speech frequencies in the ambient sound signal, and b) reduce gain of other frequencies in the ambient sound signal.

Assignees

• Apple Inc

Inventors

• Woodruff John
• Saux Tom-Davy W
• Bajic Vladan
• Iyengar Vasu
• Greenwood Andrew E
• Chen Tyrone T
• Mazur Jakub
• Verma Tony S

Classifications

• H04R2430/01

  Aspects of volume control, not necessarily automatic, in sound systems · CPC title

• H04R3/002 Primary

  Damping circuit arrangements for transducers, e.g. motional feedback circuits · CPC title

• H04R2460/01

  Hearing devices using active noise cancellation · CPC title

• H04R3/04 Primary

  for correcting frequency response · CPC title

• H04R1/1083

  Reduction of ambient noise (active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06) · CPC title