Privacy protection in collective feedforward

Patent metadata

Field	Value
Publication number	US-11145320-B2
Application number	US-201916396553-A
Country	US
Kind code	B2
Filing date	Apr 26, 2019
Priority date	Nov 25, 2015
Publication date	Oct 12, 2021
Grant date	Oct 12, 2021

Abstract

Personal audio systems and methods are disclosed. A personal audio system includes a processor to generate a personal audio stream by processing an ambient audio stream in accordance with an active processing parameter set, a circular buffer memory to store a most recent snippet of the ambient audio stream, and an event detector to detect a trigger event. In response to detection of the trigger event, a controller may extract audio feature data from the most recent snippet of the ambient audio stream and transmit the audio feature data and associated metadata to a knowledgebase remote from the personal audio system.

First claim

What is claimed:

1. A system, comprising:
a memory; and
a processor configured to:
receive audio feature data and associated metadata from a personal audio system, wherein the audio feature data is extracted from a most recent snippet of an ambient audio stream;
analyze the audio feature data and the associated metadata;
develop a current ambient sound profile based, at least in part, on the audio feature data;
develop a new processing parameter set based, at least in part, on the current ambient sound profile, the new processing parameter set indicating a type and degree of one or more processes to be performed on the ambient audio stream;
provide the new processing parameter set to the personal audio system; and
cause the memory to store the new processing parameter set and the current ambient sound profile.

2. The system of claim 1 , wherein the processor is further configured to receive the audio feature data in response to a trigger event associated with the personal audio system.

3. The system of claim 2 , wherein the trigger event is based on a location of the personal audio system.

4. The system of claim 3 , wherein the trigger event involves the automatic retrieval, based on location or ambient sound profile, of a selected processing parameter set for use as an active processing parameter set.

5. The system of claim 1 , wherein the associated metadata includes an active processing parameter set before modification.

6. The system of claim 1 , wherein the associated metadata transmitted to the device includes a descriptor received from a user via a user interface.

7. The system of claim 1 , wherein the associated metadata transmitted to the device includes data indicating a location of the personal audio system.

8. The system of claim 1 , wherein the audio feature data includes one or more of arithmetic mean, geometric mean, harmonic mean, centroid, variance, standard deviation, spectral skew, kurtosis, spectral shape, rolloff, spread, flatness, spectral flux, Mel frequency cepstral coefficients, pitch, tonal power ratio, harmonic-to-average power ratio, maximum of autocorrelation function, zero crossing rate, RMS power, peak power, crest factor, amplitude/power envelope and attack/decay rates.

9. The system of claim 1 , wherein the processor is configured to develop the new processing parameter set using one or more machine learning techniques.

10. The system of claim 1 , wherein the processor is configured to develop the new processing parameter set using one or more analytical techniques.

11. The system of claim 1 , wherein to develop a new processing parameter set includes:
sorting the audio feature data and associated metadata from the personal audio system and additional audio feature data and associated metadata from one or more other personal audio systems into a plurality of clusters; and
developing a corresponding consensus processing parameter set for each cluster of the plurality of clusters.

12. The system of claim 11 , wherein the plurality of clusters are sorted based on the associated metadata from the personal audio system and the associated metadata from the other personal audio systems.

13. The system of claim 11 , wherein the corresponding consensus processor parameter set is based on a median or average of processing parameters associated with a cluster.

14. The system of claim 11 , wherein an outlier processing parameter is discarded from a cluster.

15. A method, comprising:
receiving audio feature data and associated metadata from a personal audio system, wherein the audio feature data is extracted from a most recent snippet of an ambient audio stream;
analyzing the audio feature data and the associated metadata;
developing a current ambient sound profile based, at least in part, on the audio feature data;
developing a new processing parameter set based, at least in part, on the current ambient sound profile, the new processing parameter set indicating a type and degree of one or more processes to be performed on the ambient audio stream; and
providing the new processing parameter set to the personal audio system.

16. The method of claim 15 , further comprising receiving the audio feature data in response to a trigger event associated with the personal audio system.

17. The method of claim 15 , wherein developing a new processing parameter set includes:
sorting the audio feature data and associated metadata from the personal audio system and additional audio feature data and associated metadata from one or more other personal audio systems into a plurality of clusters; and
developing a corresponding consensus processing parameter set for each cluster of the plurality of clusters.

18. The method of claim 17 , further comprising providing the new processing parameter set to one or more other personal audio systems.

19. The method of claim 17 , wherein the corresponding consensus processor parameter set is based on a median or average of processing parameters associated with a cluster.

20. One or more non-transitory media having software stored thereon, the software including instructions for controlling one or more devices for:
receiving audio feature data and associated metadata from a personal audio system, wherein the audio feature data is extracted from a most recent snippet of an ambient audio stream;
analyzing the audio feature data and the associated metadata;
developing a current ambient sound profile based, at least in part, on the audio feature data;
developing a new processing parameter set based, at least in part, on the current ambient sound profile, the new processing parameter set indicating a type and degree of one or more processes to be performed on the ambient audio stream; and
providing the new processing parameter set to the personal audio system.

Assignees

• Dolby Laboratories Licensing Corp

Inventors

• Klimanis Gints
• Kraft Noah
• Jaffe Matthew J
• Lanman Iii Richard Fritz
• Baker Jeff

Classifications

• H04L67/52

  specially adapted for the location of the user terminal · CPC title

• H04W4/33

  for indoor environments, e.g. buildings · CPC title

• G06Q50/184

  Intellectual property management · CPC title

• G06F3/162

  Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs · CPC title

• G10L2015/025

  Phonemes, fenemes or fenones being the recognition units · CPC title