Automatic content recognition (ACR) fingerprinting and video encoding

Patent metadata

Field	Value
Publication number	US-11539986-B2
Application number	US-202117331137-A
Country	US
Kind code	B2
Filing date	May 26, 2021
Priority date	Dec 22, 2014
Publication date	Dec 27, 2022
Grant date	Dec 27, 2022

Abstract

A processing device and method are disclosed to generate automatic content recognition (ACR) fingerprints. A device can include a processing device to execute a capture daemon. The capture daemon may include a capturer to receive media content from a content feed and to generate content frames of the media content. The capture daemon can also include ACR fingerprinter to generate ACR fingerprint information for the content frames. The ACR fingerprinter may communicate the ACR fingerprint information to an ACR server via a first communication channel. The processing device may determine when the ACR fingerprinter fails; cease communicating the ACR fingerprint information to the ACR server; and restart the ACR fingerprinter.

First claim

What is claimed is:

1. A client computing device comprising:
at least one processing device configured to execute a daemon, the daemon comprising an automatic content recognition (ACR) fingerprinter configured to:
(i) receive one or more content frames in a first resolution generated from media content of a content feed,
(ii) generate ACR fingerprint information for the received content frames in the first resolution,
(iii) communicate the ACR fingerprint information from the client computing device to an ACR server via a first communication channel, while determining whether the ACR fingerprinter fails, and
(iv) in response to determining that the ACR fingerprinter has failed, and while the received content frames in a second resolution are being encoded by the at least one processing device:
(a) cease the communication of the ACR finger print information from the ACR fingerprinter to the ACR server, and
(b) restart the ACR fingerprinter, wherein the first resolution is different from the second resolution; and
a memory on which the daemon is stored.

2. The client computing device of claim 1 , further comprising a capture interface, wherein the daemon further comprises a capturer configured to receive the media content from the content feed, generate the one or more content frames in the first resolution from the media content, and send the generated content frames to the ACR fingerprinter.

3. The client computing device of claim 2 , wherein the capture interface is configured to convert the media content to a format that is compatible with the capturer.

4. The client computing device of claim 2 , wherein the capture interface includes a digital interface port to receive the media content.

5. The client computing device of claim 4 , wherein the capturer is configured to:
receive the media content from the content feed via the digital interface port; and
communicate capture criterion to the capture interface, wherein the capture criterion is a criterion to obtain the media content from the content feed.

6. The client computing device of claim 1 , wherein the at least one processing device is further configured to execute a software updater to update the software executed by the at least one processing device.

7. The client computing device of claim 6 , wherein the software updater is configured to:
communicate with a broadcast server to determine a time when an update is scheduled; and
update the software at the time.

8. The client computing device of claim 1 , wherein the daemon further comprises an encoder to encode the media content in parallel with the ACR fingerprinter generating the ACR fingerprint information.

9. The client computing device of claim 1 , wherein the ACR fingerprinter is further configured to:
determine the ACR fingerprint information for a first media consumption device using a first ACR algorithm; and
determine the ACR fingerprint information for a second media consumption device using a second ACR algorithm.

10. A client computing device comprising:
at least one processing device configured to execute a daemon, the daemon comprising:
an encoder configured to (i) receive one or more content frames in a first resolution generated from media content received by the at least one processing device from a content feed and (ii) use encoding criteria as a basis for encoding the received content frames in a second resolution, and
an automatic content recognition (ACR) fingerprinter configured to: (i) receive one or more content frames in the first resolution generated from media content of a content feed, (ii) generate ACR fingerprint information for the received content frames in the first resolution, (iii) communicate the ACR fingerprint information from the client computing device to an ACR server via a first communication channel, while determining whether the ACR fingerprinter fails, and (iv) in response to determining that the ACR fingerprinter has failed, and while the received content frames are being encoded by the at least one processing device in the second resolution: (a) cease the communication of the ACR fingerprint information from the ACR fingerprinter to the ACR server, and (b) restart the ACR fingerprinter, wherein the first resolution is different from the second resolution, and
a memory on which the daemon is stored.

11. The client computing device of claim 10 , wherein the daemon further comprises a capturer configured to receive the media content from the content feed, generate the one or more content frames in the first resolution from the media content, and send the generated content frames to the ACR fingerprinter and the encoder, and
wherein the at least one processing device further comprises a capture interface configured to convert the media content to a format that is compatible with the capturer.

12. The client computing device of claim 11 , wherein:
the capturer is configured to communicate a capture criterion to the capture interface;

and the capture criterion is criterion to obtain media content from the content feed.

13. The client computing device of claim 10 , wherein the at least one processing device is further configured to execute the encoder to adjust for a display size of a media consumption device, a processing capability of the media consumption device, a network condition of the media consumption device, or a battery capability of the media consumption device.

14. A method comprising:
generating, by at least one processing device of a client computing device and using an automatic content recognition (ACR) fingerprinter, ACR fingerprinting information based on content frames in a first resolution generated from media content of a content feed;
communicating, by the at least one processing device, the ACR fingerprint information from the client computing device to an ACR cloud system, while determining whether the ACR fingerprinter fails; and
in response to determining that the ACR fingerprinter has failed and while the content frames in a second resolution generated from the media content are being encoded by the at least one processing device: (i) ceasing, by the at least one processing device, the communication of the ACR fingerprint information to the ACR cloud system, and (ii) restarting, by the at least one processing device, the ACR fingerprinter, wherein the first resolution is different from the second resolution.

15. The method of claim 14 , further comprising:
receiving the media content; and
generating from the received media content, the first set of content frames and the second set of content frames.

16. The method of claim 14 , further comprising:
receiving a status message from a broadcast server indicating a status of the broadcast server to receive streaming content.

17. The method of claim 16 , further comprising:
encoding the content frames in the second resolution based on encoding criteria to obtain encoded media content; and
communicating the encoded media content from the at least one processing device to the broadcast server while the ACR fingerprinter restarts.

18. The method of claim 14 , further comprising encoding the content frames in the second resolution in parallel with generating the ACR fingerprint information.

19. The method of claim 14 , further comprising:
determining the ACR fingerprint information for a first media consumption device using a first ACR algorithm; and
determining the ACR fingerprint information for a second media consumption device using a second ACR algorithm.

Assignees

• Roku Inc

Inventors

• Ashbacher Andrew
• Liassides Marcus

Classifications

• H04N21/2343

  involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements {(video transcoding H04N19/40; media packet handling at the source H04L65/762)} · CPC title

• H04N21/2353

  specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata · CPC title

• H04N21/84

  Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)} · CPC title

• H04N21/23602

  Multiplexing isochronously with the video sync, e.g. according to bit-parallel or bit-serial interface formats, as SDI · CPC title

• H04N21/222

  Secondary servers, e.g. proxy server, cable television Head-end {(provisioning of proxy services in data packet switching networks H04L67/56)} · CPC title