Broadcast content view analysis based on ambient audio recording

Patent metadata

Field	Value
Publication number	US-10075767-B2
Application number	US-201615376515-A
Country	US
Kind code	B2
Filing date	Dec 12, 2016
Priority date	Dec 12, 2016
Publication date	Sep 11, 2018
Grant date	Sep 11, 2018

Abstract

An online system analyzes broadcast content viewed by individuals in a household. Each individual in the household is associated with a client device on which a software application module is executed. When the software application module detects one or more broadcasting signals of a content item broadcasted to the household, the software application module records the ambient audio, including audio from the broadcasting device. The software application module sends an identifier of the individual associated with the client device, an ambient audio fingerprint derived from the recorded ambient audio, and time information for the recorded ambient audio to the online system. The online system, based on the ambient audio data, identifies the corresponding individual and content item and logs an impression for the content item upon determination that there was an impression of the identified content item by the identified individual.

First claim

What is claimed is:

1. A computer implemented method comprising:
receiving, by an online system from a client device, a data set comprising an identifier of an individual associated with the client device, an ambient audio fingerprint representing ambient audio captured by the client device during a broadcast by a household device in a vicinity of the client device, and time information indicating a length of time of the ambient audio captured by the client device;
identifying a user profile associated with the online system based on the identifier of the individual received from the client device;
identifying a content item associated with the broadcast based on the ambient audio fingerprint;
determining that there was an impression of the identified content item by the identified user associated with the client device in response to the length of time of the ambient audio exceeding a detection threshold;
logging the impression of the identified content item in association with the user profile in a data store of the online system;
determining if impression data in the data store exceeds a threshold impression value; and
responsive to determining that the impression data in the data store exceeds the threshold impression value, sending an instruction to a content provider to increase broadcasting frequency of the content item on the household device.

2. The method of claim 1 , wherein the audio feature is high frequency sound that is inaudible to human being and is located at the beginning of the recorded ambient audio.

3. The method of claim 1 , further comprising:
updating the user profile based on the logged impression for the individual identified in the data set.

4. The method of claim 1 , further comprising:
applying the impression associated with the individual to derive information describing the individual's interest in content items;
selecting one or more content items for the individual based on the analysis of the impression; and
presenting the selected content items to the individual.

5. The method of claim 1 , further comprising:
aggregating the impression associated with the individual with impressions of one or more other users of the online system; and
selecting one or more content items for the individual based on the aggregation of the impression; and
providing, by the online system, the selected one or more content items for display to the client device associated with the user.

6. The method of claim 5 , wherein aggregating the impression comprises:
identifying the one or more other users of the online system, wherein the one or more other users are connected with the individual in the online system.

7. The method of claim 5 , wherein aggregating the impression comprises:
identifying the one or more other users of the online system, wherein the user profiles of the one or more other users at least in part match the user profile of the individual.

8. The method of claim 1 , further comprising:
applying the impression associated with the individual to derive information describing attribution of the content item based on the analysis, wherein the attribution of the content items indicates whether the individual is interested in the content item.

9. A computer program product comprising a non-transitory computer readable storage medium having instructions encoded thereon that, when executed by a processor, cause the processor to perform steps including:
receiving, by an online system from a client device, a data set comprising an identifier of an individual associated with the client device, an ambient audio fingerprint representing ambient audio captured by the client device during a broadcast by a household device in a vicinity of the client device, and time information indicating a length of time of the ambient audio captured by the client device;
identifying a user profile associated with the online system based on the identifier of the individual received from the client device;
identifying a content item associated with the broadcast based on the ambient audio fingerprint;
determining that there was an impression of the identified content item by the identified user associated with the client device in response to the length of time of the ambient audio exceeding a detection threshold;
logging the impression of the identified content item in association with the user profile in a data store of the online system;
determining if impression data in the data store exceeds a threshold impression value; and
responsive to determining that the impression data in the data store exceeds the threshold impression value, sending an instruction to a content provider to increase broadcasting frequency of the content item on the household device.

10. The computer program product of claim 9 , wherein the audio feature is high frequency sound that is inaudible to human being and is located at the beginning of the recorded ambient audio.

11. The computer program product of claim 9 , further comprising instructions for:
updating the user profile based on the logged impression for the individual identified in the data set.

12. The computer program product of claim 9 , further comprising instructions for:
applying the impression associated with the individual to derive information describing the individual's interest in content items;
selecting one or more content items for the individual based on the analysis of the impression; and
presenting the selected content items to the individual.

13. The computer program product of claim 9 , further comprising instructions for:
aggregating the impression associated with the individual with impressions of one or more other users of the online system; and
selecting one or more content items for the individual based on the aggregation of the impression; and
providing, by the online system, the selected one or more content items for display to the client device associated with the user.

14. The computer program product of claim 13 , wherein aggregating the impression comprises:
identifying the one or more other users of the online system, wherein the one or more other users are connected with the individual in the online system.

15. The computer program product of claim 13 , wherein aggregating the impression comprises:
identifying the one or more other users of the online system, wherein the user profiles of the one or more other users at least in part match the user profile of the individual.

16. The computer program product of claim 9 , further comprising instructions for:
applying the impression associated with the individual to derive information describing attribution of the content item based on the analysis, wherein the attribution of the content items indicates whether the individual is interested in the content item.

17. A computer system comprising:
a processor; and
a non-transitory computer readable storage medium having instructions encoded thereon that, when executed by a processor, cause the processor to perform steps including:
receiving, by an online system from a client device, a data set comprising an identifier of an individual associated with the client device, an ambient audio fingerprint representing ambient audio captured by the client device during a broadcast by a household device in a vicinity of the client device, and time information indicating a length of time of the ambient audio captured by the client device;
identifying a user profile associated with the online system based on the identifier of the individual received from the client device;
ide

Assignees

• Facebook Inc

Inventors

• Husain Aliasgar Mumtaz
• Xu Yali

Classifications

• H04H60/66

  for using the result on distributors' side · CPC title

• H04N21/25883

  being end-user demographical data, e.g. age, family status or address (arrangements for identifying locations of users in broadcast systems H04H60/52) · CPC title

• H04N21/25891

  being end-user preferences (retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18) · CPC title

• H04N21/4394

  involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58) · CPC title

• H04N21/44218 Primary

  Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45) · CPC title