Music detection and identification

Patent metadata

Field	Value
Publication number	US-10089987-B2
Application number	US-201615384297-A
Country	US
Kind code	B2
Filing date	Dec 19, 2016
Priority date	Dec 21, 2015
Publication date	Oct 2, 2018
Grant date	Oct 2, 2018

Abstract

A sensor processing unit comprises a microphone and a sensor processor. The sensor processor is coupled with the microphone. The sensor processor is configured to operate the microphone to capture an audio sample from an environment in which the microphone is disposed. The sensor processor is configured to perform music activity detection on the audio sample to detect for music within the audio sample. Responsive to detection of music within the audio sample, the sensor processor is configured to send a music detection signal to an external processor located external to the sensor processing unit, the music detection signal indicating that music has been detected in the environment.

First claim

What is claimed is:

1. A sensor processing unit comprising:
a microphone; and
a sensor processor coupled with said microphone, said sensor processor configured to:
operate said microphone to capture an audio sample from an environment in which said microphone is disposed;
perform music activity detection on said audio sample to detect for music within said audio sample; and
responsive to detection of music within said audio sample, send a music detection signal to an external processor located external to said sensor processing unit, said music detection signal indicating that music has been detected in said environment.

2. The sensor processing unit of claim 1 , wherein said sensor processing unit further comprises:
a buffer coupled with said sensor processor; and
wherein said sensor processor is further configured to:
store said audio sample in said buffer;
send a buffer full indication to said external processor; and
responsive to said external processor failing to access contents of said buffer after expiration of a predetermined period of time following said buffer full indicator being sent, overwrite said buffer with new information.

3. The sensor processing unit of claim 1 , wherein said sensor processor is further configured to:
provide one of said audio sample and a second audio sample to said external processor after detection of music in said audio sample, wherein said second audio sample is captured after said audio sample.

4. The sensor processing unit of claim 3 , wherein said one of said audio sample and said second audio sample is provided to said external processor in response to a request from said external processor.

5. The sensor processing unit of claim 3 , wherein said one of said audio sample and said second audio sample is provided as a stream to said external processor until said external processor provides an instruction to cease said stream.

6. The sensor processing unit of claim 1 , wherein said sensor processing unit is configured to receive an identification signal from said external processor, wherein said identification signal indicates a first song corresponding to said audio sample has been identified.

7. The sensor processing unit of claim 6 , wherein said sensor processor is further configured to:
adapt said music activity detection to said first song in response to receiving said identification signal, wherein said adaptation comprises suspending said music activity detection for a period of time associated with said first song and provided by said identification signal.

8. The sensor processing unit of claim 1 , wherein said sensor processor is operated in a first mode to detect for a first song, and said sensor processor is operated in a second mode to detect for a change from said first song to a second song, and switching from said first mode to said second mode is performed after receiving an identification signal from said external processor, wherein said identification signal indicates a first song has been identified.

9. The sensor processing unit of claim 1 , wherein said music comprises a first song and wherein sensor processor is further configured to:
detect a change in a second audio sample from said first song to a second song that is different from said first song.

10. The sensor processing unit of claim 9 , wherein said sensor processor is further configured to:
send a second music detection signal to said external processor following a predefined delay in response to said detection of said change from said first song to said second song, wherein said second music detection signal is sent a predetermined period of time after said detection of said change.

11. The sensor processing unit of claim 1 , wherein said sensor processor is further configured to:
perform voice activity detection on said audio sample to detect for human speech within said audio sample.

12. The sensor processing unit of claim 11 , wherein, responsive to both human speech and music being detected within said audio sample, said sensor processor is further configured to:
prevent said music detection signal from being sent to said external processor.

13. The sensor processing unit of claim 11 , wherein responsive to both human speech and music being detected within said audio sample, said sensor processor is further configured to:
send said music detection signal to said external processor a predefined time after it is detected that human speech has stopped but music is still detected.

14. The sensor processing unit of claim 11 , wherein responsive to both human speech and music being detected, said sensor processor is further configured to:
apply a beam forming technique using said microphone and at least one additional microphone to capture a second audio signal in which said music has been isolated from human speech: and
send music detection signal to said external processor in response to capturing said second audio signal.

15. The sensor processing unit of claim 1 , wherein said sensor processor is configured to operate said microphone on a duty cycle comprising an active mode in which music activity detection is performed on said audio sample, followed by a sleep mode in which said music activity detection is suspended for a predefined period of time, wherein said predefined period of time is between 30 seconds and 2 minutes in length.

16. The sensor processing unit of claim 1 , wherein the performing the music activity detection is adapted to at least one of available power resources and available computing resources.

17. A mobile electronic device comprising:
a host processor;
a microphone; and
a sensor processing unit coupled with said host processor and said microphone, said sensor processing unit configured to:
operate said microphone to capture an audio sample from an environment in which said microphone is disposed;
perform music activity detection on said audio sample to detect for music within said audio sample; and
responsive to detection of music within said audio sample, send a music detection signal to said host processor, wherein said host processor is located external to said sensor processing unit, said music detection signal indicating that music has been detected in said environment.

18. The mobile electronic device of claim 17 , wherein sensor processor is further configured to:
provide one of said audio sample and a second audio sample to said external processor after detection of music in said audio sample, wherein said second audio sample is captured after said audio sample.

19. The mobile electronic device of claim 18 , wherein said one of said audio sample and said second audio sample is provided to said host processor in response to a request from host processor.

20. The mobile electronic device of claim 18 , wherein said one of said audio sample and said second audio sample is provided to said host processor along with said music detection signal.

21. The mobile electronic device of claim 17 , wherein responsive to receipt of said music detection signal, said host processor is configured to:
wirelessly provide information about said audio sample to a music identification service; and
wirelessly receive identification information associated with said audio sample from said music identification service, said identification information comprising at least one of: a song title associated with said music detected in said audio sample; a performer name associated with said music detected in said audio sample;

Assignees

• Invensense Inc

Inventors

• Keal William Kerry
• Dhanapalan Ajay Kumar
• Choi Sangnam
• Murgia Carlo
• Medina Eitan A
• Kimura Taro

Classifications

• G10H2240/211

  Wireless transmission, e.g. of music parameters or control data by radio, infrared or ultrasound · CPC title

• G10H2220/355

  Geolocation input, i.e. control of musical parameters based on location or geographic position, e.g. provided by GPS, Wi-Fi® network location databases or mobile phone base station position databases · CPC title

• G10H1/0033 Primary

  Recording/reproducing or transmission of music for electrophonic musical instruments · CPC title

• G10L25/81

  for discriminating voice from music · CPC title

• G10H2220/351

  Environmental parameters, e.g. temperature, ambient light, atmospheric pressure, humidity, used as input for musical purposes · CPC title