Digital watermark encoding and decoding with localization and payload replacement

Patent metadata

Field	Value
Publication number	US-10147433-B1
Application number	US-201615145784-A
Country	US
Kind code	B1
Filing date	May 3, 2016
Priority date	May 3, 2015
Publication date	Dec 4, 2018
Grant date	Dec 4, 2018

Abstract

Efficient detection of watermark payload boundaries provide granular localization of transitions between programs and advertisements of various types. In addition, it facilitates payload replacement schemes in which digital watermark layers are partially removed and overwritten with new payloads.

First claim

We claim:

1. A method of detecting a boundary of an audio segment in which a watermark payload is encoded, the method comprising:
buffering a sequence of audio signal samples from an audio signal;
attempting to detect a watermark payload from the sequence;
repeating the buffering with time shifted sequences of audio samples from the audio signal and attempting to detect the watermark payload in the time shifted sequences;
in response to detecting the watermark payload within a first sequence of audio signal samples, regenerating a watermark signal from the payload;
searching for the regenerated watermark signal in buffered sequences of the audio signal, either before or after the first sequence to find a boundary of an audio segment in which the watermark payload is encoded by sliding the regenerated watermark signal in increments along the audio signal, determining a detection metric by correlating the regenerated watermark signal with the audio signal at an increment, checking the detection metric against a threshold, and based on the checking, locating the boundary where the detection metric falls below the threshold;
wherein detecting the watermark payload comprises decoding of a variable message in the watermark payload, and wherein the regenerating of the watermark signal comprises constructing an encoded version of the variable message from the variable message, and mapping the encoded version to components of the audio signal.

2. The method of claim 1 wherein the buffering comprises buffering an incoming stream of audio signal samples and executing a process of detecting the watermark in real time.

3. The method of claim 1 wherein detecting the watermark payload comprises performing error correction decoding of variable message and validating the variable message with error detection, and wherein the regenerating of the watermark signal comprises performing error correction encoding.

4. The method of claim 3 wherein the searching comprises correlating the regenerated watermark signal with partially decoded audio previously buffered for audio sequences prior to the first sequence.

5. The method of claim 4 wherein the correlating produces a detection metric, and further comprising evaluating the detection metric to find a boundary at the start of the audio segment with a granularity less than one second.

6. The method of claim 3 wherein the searching comprises correlating the regenerated watermark signal with partially decoded audio buffered for audio sequences after the first sequence, wherein a detected synchronization parameter obtained from the first sequence is re-used for partially decoded audio buffered for audio sequences after the first sequence.

7. The method of claim 6 wherein the detected synchronization parameter comprises a detected shift.

8. A non-transitory computer readable medium on which is stored instructions, which when executed by a processor, perform a method of detecting a boundary of an audio segment in which a watermark payload is encoded, the method comprising:
buffering a sequence of audio signal samples from an audio signal;
attempting to detect a watermark payload from the sequence;
repeating the buffering with time shifted sequences of audio samples from the audio signal and attempting to detect the watermark payload in the time shifted sequences;
in response to detecting the watermark payload within a first sequence of audio signal samples, regenerating a watermark signal from the payload;
searching for the regenerated watermark signal in buffered sequences of the audio signal, either before or after the first sequence to find a boundary of an audio segment in which the watermark payload is encoded by sliding the regenerated watermark signal in increments along the audio signal, determining a detection metric by correlating the regenerated watermark signal with the audio signal at an increment, checking the detection metric against a threshold, and based on the checking, locating a boundary where the detection metric falls below the threshold;
wherein detecting the watermark payload comprises decoding of a variable message in the watermark payload, and wherein the regenerating of the watermark signal comprises constructing an encoded version of the variable message from the variable message, and mapping the encoded version to components of the audio signal.

9. The non-transitory computer readable medium of claim 8 wherein the buffering comprises buffering an incoming stream of audio signal samples and executing a process of detecting the watermark in real time.

10. The non-transitory computer readable medium of claim 8 wherein detecting the watermark payload comprises performing error correction decoding of variable message and validating the variable message with error detection, and wherein the regenerating of the watermark signal comprises performing error correction encoding.

11. The non-transitory computer readable medium of claim 10 wherein the searching comprises correlating the regenerated watermark signal with partially decoded audio previously buffered for audio sequences prior to the first sequence.

12. The non-transitory computer readable medium of claim 11 wherein the correlating produces a detection metric, and further comprising evaluating the detection metric to find a boundary at the start of the audio segment with a granularity less than one second.

13. The non-transitory computer readable medium of claim 10 wherein the searching comprises correlating the regenerated watermark signal with partially decoded audio buffered for audio sequences after the first sequence, wherein a detected synchronization parameter obtained from the first sequence is re-used for partially decoded audio buffered for audio sequences after the first sequence.

14. The non-transitory computer readable medium of claim 13 wherein the detected synchronization parameter comprises a detected shift.

15. The non-transitory computer readable medium of claim 8 , wherein the instructions further configure the processor to perform acts of:
buffering the audio signal in plural buffers of different length;
attempting plural attempts of watermark detection in first audio segment, the attempts corresponding to instances in which the first audio segment is within the plural buffers, as the first audio segment is shifted through the plural buffers, the attempts producing a detection result indicating likelihood that a watermark is present in the first audio segment; and
combining the detection results to produce a combined likelihood that the watermark is present in the first audio segment.

16. The non-transitory computer readable medium of claim 8 , wherein the instructions further configure the processor to perform a method of:
determining from the combined likelihood for plural audio segments, a span of audio signal in which the watermark is present.

17. A method of detecting a boundary of an audio segment in which a watermark payload is encoded, the method comprising:
a step for obtaining time shifted sequences of audio signal samples from an audio signal;
a step for attempting to detect a watermark payload in the time shifted sequences;
a step for decoding the watermark payload from a first sequence of the time shifted sequences in response to detecting the watermark payload in the first sequence, the step for decoding comprising decoding of a variable message in the watermark payload;
a step for regenerating a watermark signal from the watermark payload, the step for regenerating a watermark signal comprising constructing an encoded ve

Assignees

• Digimarc Corp

Inventors

• Bradley Brett A

Classifications

• G10L19/018 Primary

  Audio watermarking, i.e. embedding inaudible data in the audio signal · CPC title

• G10L19/167

  Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes · CPC title

• G10L19/005

  Correction of errors induced by the transmission channel, if related to the coding algorithm · CPC title