Digital video fingerprinting

Patent metadata

Field	Value
Publication number	US-9330426-B2
Application number	US-201113877267-A
Country	US
Kind code	B2
Filing date	Sep 30, 2011
Priority date	Sep 30, 2010
Publication date	May 3, 2016
Grant date	May 3, 2016

Abstract

A digitally encoded video fingerprinting system for generating and comparing/matching finger-prints from digitally encoded video which has been encoded according to an encoding method which involves the generation of residual macroblocks of pixels and the generation of quantized transform coefficients of the residual macroblocks, or of portions of the residual macroblocks, comprises a fingerprint database ( 5 ) and a video processing subsystem ( 10 ). The video processing subsystem ( 10 ) includes a fingerprint sequence selection module ( 14, 24 ) which is operable to select one or more sets of frames from input video content to be processed in order to generate a fingerprint; a fingerprint calculation module ( 14, 26 ) which is operable to generate a fingerprint based on a set of frames selected by the fingerprint sequence selection module; and a fingerprint comparator module ( 14, 28 ) which is operable to compare two fingerprints and to output a similarity score of the compared fingerprints. The method used by the fingerprint selection and fingerprint calculation modules includes selecting a group of frames of the encoded video content; processing the digitally encoded video content to obtain a set of quantized transform coefficients of residual macroblocks or portions of residual macroblocks associated with each of the selected frames; identifying a set of residual macroblocks per frame whose transform coefficients satisfy a threshold criterion; and generating a digital video fingerprint for the encoded video content in dependence upon the identified macroblocks or some property thereof within each of the selected frames.

First claim

The invention claimed is:

1. A method of generating a digital video fingerprint from a piece of digitally encoded video content, the video content having been encoded according to an encoding method which involves the generation of residual macroblocks of pixels and the generation of quantized transform coefficients of the residual macroblocks or of portions of the residual macroblocks, the method comprising: selecting a group of frames of the encoded video content; processing the digitally encoded video content to obtain a set of quantized transform coefficients of residual macroblocks or portions of residual macroblocks associated with each of the selected frames; identifying a set of residual macroblocks per frame whose transform coefficients satisfy a threshold criterion; and generating a digital video fingerprint for the encoded video content in dependence upon the identified macroblocks or some property thereof within each of the selected frames.

2. A method according to claim 1 wherein identifying a set of residual macroblocks per frame whose transform coefficients satisfy a threshold criterion includes generating a test value in respect of each macroblock, comparing the test value of each macroblock with a threshold value and identifying some of the macroblocks as having transform coefficients which do satisfy the threshold criterion and some of the macroblocks as having transform coefficients which do not satisfy the threshold criterion in dependence upon the comparison of the respective macroblocks' test values with the threshold value.

3. A method according to claim 2 wherein identifying a set of residual macroblocks per frame whose transform coefficients satisfy a threshold criterion is a multistage process which involves comparing a test value of a macroblock with different threshold values at different stages.

4. A method according to claim 1 wherein the step of selecting a group of frames of the encoded video content includes identifying a group of frames such that a digital video fingerprint generated therefrom has high levels of robustness and reliability.

5. A method according to claim 4 wherein the step of selecting a group of frames of the encoded video content comprises generating fingerprints from a plurality of different groups of frames of the encoded video and then ascertaining the degree of match found between each fingerprint derived from a respective one of this plurality of different groups of frames with a respective fingerprint generated from a corresponding group of frames taken from an encoding of the same video content using a different encoding method.

6. A process of identifying a digitally encoded and compressed piece of unknown video content, the process comprising: generating a database of fingerprints from a plurality of known pieces of video content using the method according to claim 1 ; generating a fingerprint from the unknown video content using the method and comparing the fingerprint generated from the unknown video content with each of the fingerprints in the database; and identifying the unknown piece of video content as being likely to be the known video content whose fingerprint within the database of fingerprints satisfies a similarity criterion when compared with the fingerprint generated from the unknown video content.

7. A digitally encoded video fingerprinting system comprising:
a fingerprint database; and
a video processing subsystem, the video processing subsystem being configured to at least execute:
a fingerprint sequence selection to select one or more sets of frames to be processed in order to generate a fingerprint;
a fingerprint calculation to generate a fingerprint based on a set of frames selected by the fingerprint sequence selection using the method according to claim 1 ; and
a fingerprint comparison to compare two fingerprints and to output a similarity score of the compared fingerprints.

8. A digitally encoded video fingerprinting system according to claim 7 wherein the fingerprint comparison compares a fingerprint generated by the fingerprint calculation with a fingerprint extracted from the fingerprint database.

9. Apparatus for generating a digital video fingerprint from a piece of digitally encoded or partially decoded video content, the video content having been encoded according to an encoding method which involves the generation of residual macroblocks of pixels and the generation of quantized transform coefficients of the residual macroblocks or of portions of the residual macroblocks, the apparatus comprising:
a processing system including a processor unit and a memory unit, the processing system being configured to at least execute:
a fingerprint sequence selection to select a group of frames from the encoded or partially decoded video content; and
a fingerprint calculation to identify a set of macroblocks per frame whose residual transform coefficients satisfy a threshold criterion and to generate a digital video fingerprint for the encoded or partially decoded video content in dependence upon the identified macroblocks or some property thereof within each of the selected frames.

10. Apparatus according to claim 9 further including a video decoder configured to generate partially decoded video content from digitally encoded video content, the partially decoded video content including residual transform coefficients.

11. The apparatus according to claim 9 further including a video decoding processor configured to generate partially decoded video content from digitally encoded video content, the partially decoded video content including residual transform coefficients.

12. A non-transitory computer-readable storage medium storing a computer program or suite of computer programs which upon execution by a computer system to provide functionality of generating a digital video fingerprint from a piece of digitally encoded video content, the video content having been encoded according to an encoding method which involves the generation of residual macroblocks of pixels and the generation of quantized transform coefficients of the residual macroblocks or of portions of the residual macroblocks, the functionality comprising:
selecting a group of frames of the encoded video content; processing the digitally encoded video content to obtain a set of quantized transform coefficients of residual macroblocks or portions of residual macroblocks associated with each of the selected frames;
identifying a set of residual macroblocks per frame whose transform coefficients satisfy a threshold criterion; and
generating a digital video fingerprint for the encoded video content in dependence upon the identified macroblocks or some property thereof within each of the selected frames.

13. The non-transitory computer-readable storage medium of claim 12 , wherein identifying a set of residual macroblocks per frame whose transform coefficients satisfy a threshold criterion includes generating a test value in respect of each macroblock, comparing the test value of each macroblock with a threshold value and identifying some of the macroblocks as having transform coefficients which do satisfy the threshold criterion and some of the macroblocks as having transform coefficients which do not satisfy the threshold criterion in dependence upon the comparison of the respective macroblocks' test values with the threshold value.

14. The non-transitory computer-readable storage medium of claim 13 , wherein identifying a set of residual macroblocks per frame whose transform coefficients satisfy a threshold criterion is a multistage process which involves comparing a test value of a macroblock with

Assignees

• Davis Andrew Gordon
• British Telecomm

Inventors

• Davis Andrew Gordon

Classifications

• G06F21/64

  Protecting data integrity, e.g. using checksums, certificates or signatures · CPC title

• G06F17/30784

  Physics · mapped topic

• H04N19/177

  the unit being a group of pictures [GOP] · CPC title

• G06T1/0021 Primary

  Image watermarking · CPC title

• H04N19/172

  the region being a picture, frame or field · CPC title