Media channel identification and action, with disambiguation through client-side fingerprint matching of channel-specific icon

Patent metadata

Field	Value
Publication number	US-12149768-B2
Application number	US-202318309989-A
Country	US
Kind code	B2
Filing date	May 1, 2023
Priority date	Dec 16, 2020
Publication date	Nov 19, 2024
Grant date	Nov 19, 2024

Abstract

Disclosed is a method that includes a media presentation device (i) generating query fingerprint data representing video frames of a channel being rendered by the media presentation device, and transmitting the generated query fingerprint data from the device over a network to a server, (ii) responsive to transmitting the query fingerprint data to the server, receiving, from the server, channel-icon fingerprint data representing channel icons of multiple channels selected based at least on the server having detected that the query fingerprint data representing the video frames of the channel being rendered by the media presentation device matches the reference fingerprint data representing the frames of the multiple channels of video content, and (iii) responsive to receiving the channel-icon fingerprint data from the server, performing channel-icon fingerprint matching to determine which channel in the multiple channels is the channel being rendered by the media presentation device.

First claim

What is claimed is:

1. A method comprising:
generating, by a media presentation device, query fingerprint data representing one or more video frames of a channel being rendered by the media presentation device, and transmitting the query fingerprint data from the media presentation device over a network to a server;
responsive to transmitting the query fingerprint data to the server, receiving by the media presentation device and from the server, channel-icon fingerprint data including channel-icon characteristics and fingerprint-generation techniques selected based on the channel-icon characteristics for multiple channels based at least on the server having detected that the query fingerprint data representing the one or more video frames of the channel being rendered matches reference fingerprint data of the multiple channels;
generating a query channel-icon fingerprint representing an in-frame region at which the channel presents a respective channel icon of the channel by applying the fingerprint-generation techniques;
comparing the generated query channel-icon fingerprint with reference channel-icon fingerprints representing channel icons specific to the multiple channels, thereby determining which channel of the multiple channels is being rendered by the media presentation device; and
based on the determination of which channel of the multiple channels is being rendered by the media presentation device, notifying the server or another entity to take a specific action for the channel;
wherein the specific action comprises:
reporting identification of the channel,
recording ratings data, or
enabling dynamic ad insertion.

2. The method of claim 1 , further comprising:
generating the query fingerprint data over a course of multiple frames of the channel; and
averaging the multiples frames to establish a composite query fingerprint representing the query fingerprint data.

3. The method of claim 1 , wherein the media presentation device is a television.

4. The method of claim 1 , wherein the channel-icon fingerprint data further includes, for each of the multiple channels, coordinates defining an in-frame region at which the channel presents an icon specific to each of the multiple channels.

5. The method of claim 4 , wherein the in-frame region is defined by exclusion, with a mask defining which pixels in a frame are absent from the in-frame region.

6. A non-transitory computer readable medium with instructions stored thereon, that when processed by one or more processors of a media presentation device, cause the media presentation device to perform operations comprising:
generating query fingerprint data representing one or more video frames of a channel being rendered by the media presentation device, and transmitting the query fingerprint data from the media presentation device over a network to a server;
responsive to transmitting the query fingerprint data to the server, receiving, from the server, channel-icon fingerprint data including channel-icon characteristics and fingerprint-generation techniques selected based on the channel-icon characteristics for multiple channels based at least on the server having detected that the query fingerprint data representing the one or more video frames of the channel being rendered matches reference fingerprint data of the multiple channels;
generating a query channel-icon fingerprint representing an in-frame region at which the channel presents a respective channel icon of the channel by applying the fingerprint-generation techniques;
comparing the generated query channel-icon fingerprint with reference channel-icon fingerprints representing channel icons specific to the multiple channels, thereby determining which channel of the multiple channels is being rendered by the media presentation device; and
based on the determination of which channel of the multiple channels is being rendered by the media presentation device, notifying the server or another entity to take a specific action for the channel;
wherein the specific action comprises:
reporting identification of the channel,
recording ratings data, or
enabling dynamic ad insertion.

7. The non-transitory computer readable medium of claim 6 , wherein the operations further comprise:
generating the query fingerprint data over a course of multiple frames of the channel; and
averaging the multiples frames to establish a composite query fingerprint representing the query fingerprint data.

8. The non-transitory computer readable medium of claim 6 , wherein the media presentation device is a television.

9. The non-transitory computer readable medium of claim 6 , wherein the channel-icon fingerprint data further includes, for each of the multiple channels, coordinates defining an in-frame region at which the channel presents the a icon specific to each of the multiple channels.

10. The non-transitory computer readable medium of claim 9 , wherein the in-frame region is defined by exclusion, with a mask defining which pixels in a frame are absent from the in-frame region.

11. A media presentation device comprising:
a memory storing instructions; and
one or more processors, coupled to the memory and configured to process the instructions to:
generate query fingerprint data representing one or more video frames of a channel being rendered by the media presentation device, for transmission from the media presentation device over a network to a server;
responsive to transmission of the query fingerprint data to the server, receive, from the server, channel-icon fingerprint data including channel-icon characteristics and fingerprint-generation techniques selected based on the channel-icon characteristics for multiple channels based at least on the server having detected that the query fingerprint data representing the one or more video frames of the channel being rendered matches reference fingerprint data of the multiple channels;
generate a query channel-icon fingerprint representing an in-frame region at which the channel presents a respective channel icon of the channel by applying the fingerprint-generation techniques;
compare the generated query channel-icon fingerprint with reference channel-icon fingerprints representing channel icons specific to the multiple channels, thereby determining which channel of the multiple channels is being rendered by the media presentation device; and
based on the determination of which channel of the multiples channels is being rendered by the media presentation device, generate a notification to the server or another entity to take a specific action for the channel;
wherein the specific action for the channel comprises:
reporting identification of the channel,
recording ratings data, or
enabling dynamic ad insertion.

12. The media presentation device of claim 11 , wherein the one or more processors are further configured to:
generate the query fingerprint data over a course of multiple frames of the channel; and
average the multiples frames to establish a composite query fingerprint representing the query fingerprint data.

13. The media presentation device of claim 11 , wherein the media presentation device is a television.

14. The media presentation device of claim 11 , wherein the channel-icon fingerprint data further includes:
for each of the multiple channels, coordinates defining an in-frame region at which the channel presents an icon specific to each of the multiple channels; and
wherein the in-frame region is defined by exclusion, with a mask defining which pixels in a frame are absent from the in-frame region.

Assignees

• Roku Inc

Inventors

• Schmidt Andreas
• Merchant Shashank
• Cremer Markus Kurt Peter

Classifications

• H04N21/654

  Transmission by server directed to the client · CPC title

• H04N21/44204

  Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched (monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31) · CPC title

• H04N21/23424

  involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement · CPC title

• H04N21/8153

  comprising still images, e.g. texture, background image · CPC title

• H04N21/4314

  for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid · CPC title