Media channel identification with video multi-match detection and disambiguation based on audio fingerprint

Patent metadata

Field	Value
Publication number	US-10440430-B2
Application number	US-201816017203-A
Country	US
Kind code	B2
Filing date	Jun 25, 2018
Priority date	Feb 29, 2016
Publication date	Oct 8, 2019
Grant date	Oct 8, 2019

Abstract

Disclosed are methods and systems to help disambiguate channel identification in a scenario where a video fingerprint of media content matches multiple reference video fingerprints corresponding respectively with multiple different channels. Given such a multi-match situation, an entity could disambiguate based on an audio component of the media content, such as by further determining that an audio fingerprint of the media content at issue matches an audio fingerprint of just one of the multiple channels, thereby establishing that that is the channel on which the media content being rendered by the media presentation device is arriving.

First claim

What is claimed is:

1. A media presentation device comprising:
a media input interface through which to receive media content to be presented by the media presentation device;
a media presentation interface for presenting the media content;
a network communication interface;
a processing unit;
non-transitory data storage; and
program instructions stored in the non-transitory data storage and executable by the processing unit to carry out operations including:
generating a digital video fingerprint of the media content based on analysis of the media content, and outputting the generated digital video fingerprint for transmission through the network communication interface to a server,
after outputting the digital video fingerprint for transmission to the server, receiving from the server a request for an audio fingerprint of the media content when the server has determined that the digital video fingerprint matches reference video fingerprints corresponding with multiple channels,
responsive to the request, outputting a digital audio fingerprint of the media content for transmission through the network communication interface to the server, and
causing the media presentation device to present, in conjunction with the media content, supplemental channel-specific content associated with one of the multiple channels, the one channel being identified from among the multiple channels based on a determination that the digital audio fingerprint matches a reference audio fingerprint of just the one channel of the multiple channels.

2. The media presentation device of claim 1 , wherein the media content has a video track and an audio track, wherein the digital video fingerprint is a fingerprint of the video track and the digital audio fingerprint is a fingerprint of the audio track.

3. The media presentation device of claim 1 , wherein the digital audio fingerprint represents at least a language track of the media content.

4. The media presentation device of claim 1 , wherein the operations further include:
responsive to the request, generating the digital audio fingerprint of the media content.

5. The media presentation device of claim 1 , wherein the supplemental channel-specific content comprises at least one of a pop-up advertisement, a commercial break, or a channel-identification.

6. The media presentation device of claim 1 , wherein the supplemental channel-specific content is a replacement for one or more portions of the media content.

7. The media presentation device of claim 1 , wherein the media presentation device is a television.

8. A method comprising:
generating by a media presentation device, based on analysis of media content being rendered by the media presentation device, a digital video fingerprint of the media content being rendered by the media presentation device;
outputting by the media presentation device the generated video fingerprint for transmission over a network to a server;
after outputting the digital video fingerprint for transmission to the server, receiving by the media presentation device, from the server, a request for an audio fingerprint of the media content when the server has determined that the digital video fingerprint matches reference video fingerprints corresponding with multiple channels;
responsive to the request, outputting by the media presentation device a digital audio fingerprint of the media content for transmission over the network to the server; and
presenting, by the media presentation device, in conjunction with the media content, supplemental channel-specific content associated with one of the multiple channels, the one channel being identified from among the multiple channels based on a determination that the digital audio fingerprint matches a reference audio fingerprint of just the one channel of the multiple channels.

9. The method of claim 8 , wherein the media content has a video track and an audio track, wherein the digital video fingerprint is a fingerprint of the video track and the digital audio fingerprint is a fingerprint of the audio track.

10. The method of claim 8 , wherein the digital audio fingerprint represents at least a language track of the media content.

11. The method of claim 8 , further comprising:
responsive to the request, generating the digital audio fingerprint of the media content.

12. The method of claim 8 , wherein the supplemental channel-specific content comprises at least one of a pop-up advertisement, a commercial break, or a channel-identification.

13. The method of claim 8 , wherein the supplemental channel-specific content is a replacement for one or more portions of the media content.

14. A non-transitory computer readable medium having stored thereon instructions executable by a processing unit to carry out operations including:
generating, based on analysis of media content being rendered by a media presentation device, a digital video fingerprint of the media content being rendered by the media presentation device, and outputting by the media presentation device the generated video fingerprint for transmission over a network to a server;
after outputting the digital video fingerprint for transmission to the server, receiving from the server a request for an audio fingerprint of the media content when the server has determined that the digital video fingerprint matches reference video fingerprints corresponding with multiple channels;
responsive to the request, outputting a digital audio fingerprint of the media content for transmission over the network to the server; and
causing the media presentation device to present, in conjunction with the media content, supplemental channel-specific content associated with one of the multiple channels, the one channel being identified from among the multiple channels based on a determination that the digital audio fingerprint matches a reference audio fingerprint of just the one channel of the multiple channels.

15. The non-transitory computer readable medium of claim 14 , wherein the media content has a video track and an audio track, wherein the digital video fingerprint is a fingerprint of the video track and the digital audio fingerprint is a fingerprint of the audio track.

16. The non-transitory computer readable medium of claim 14 , wherein the digital audio fingerprint represents at least a language track of the media content.

17. The non-transitory computer readable medium of claim 14 , further comprising: responsive to the request, generating the digital audio fingerprint of the media content.

18. The non-transitory computer readable medium of claim 14 , wherein the supplemental channel-specific content comprises at least one of a pop-up advertisement, a commercial break, or a channel-identification.

19. The non-transitory computer readable medium of claim 14 , wherein the supplemental channel-specific content is a replacement for one or more portions of the media content.

20. The non-transitory computer readable medium of claim 14 , wherein the non-transitory computer readable medium is implemented in the media presentation device.

Assignees

• Gracenote Inc

Inventors

• Seo Chung Won
• Kwon Youngmoo
• Lee Jaehyung

Classifications

• H04N21/812

  involving advertisement data (advertising per se G06Q30/02) · CPC title

• H04N21/4622

  Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859) · CPC title

• H04N21/4394

  involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58) · CPC title

• H04N21/23418

  involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title

• H04H60/59

  of video {(recognising characters or patterns in general G06F18/00, G06V20/00)} · CPC title