Correlating timeline information between media streams

Patent metadata

Field	Value
Publication number	US-9860581-B2
Application number	US-201415022851-A
Country	US
Kind code	B2
Filing date	Sep 5, 2014
Priority date	Sep 20, 2013
Publication date	Jan 2, 2018
Grant date	Jan 2, 2018

Abstract

A system is provided for enabling correlating timeline information between a first media stream and a second media stream, with the first media stream and the second media stream being both associated with a common play-out timeline. The system comprises at least two content monitors, each arranged for providing a persistent identification of one or more media samples of a media stream. The system further comprises a correlation subsystem arranged for receiving a first persistent identification related in time with a second persistent identification, receiving a first timestamp value of the first media stream related in time with a second timestamp value of the second media stream, matching the first persistent identification to a first play-out time on the common play-out timeline and the second persistent identification to a second play-out time, and generating correlation information based on a comparison of the first play-out time with the second play-out time for enabling correlating the first timestamp value with the second timestamp value and thereby correlating the first timeline information with the second timeline information.

First claim

The invention claimed is:

1. A system for enabling correlating timeline information between a first media stream and a second media stream, the first media stream and the second media stream being both associated with a common play-out timeline and comprising different timeline information, and the system comprising:
at least two content monitors, each arranged for providing a persistent identification of one or more media samples of a media stream, the persistent identification being data wherein the persistent identification is one of the group of: a fingerprint, a watermark and a marker, of the one or more media samples, wherein the at least two content monitors comprise a first content monitor for providing a first persistent identification of the first media stream and a second content monitor for providing a second persistent identification of the second media stream, wherein each of the at least two content monitors are further arranged for providing the respective persistent identifications related in time a) by obtaining the respective persistent identifications synchronously in time or b) by providing a wallclock timestamp value together with the respective timestamp value;
at least two timeline monitors, each of the at least two timeline monitors being arranged for providing a timestamp value from timestamp values in headers of a media stream, wherein the at least two timeline monitors comprise a first timeline monitor for providing the first timestamp value of the first media stream and a second timeline monitor for providing the second timestamp value of the second media stream, wherein each of the at least two timeline monitors are further arranged for providing the respective timestamp values related in time aa) by obtaining the respective timestamp values synchronously in time or bb) by providing a further wallclock timestamp value together with the respective timestamp value; and
a correlation subsystem arranged for:
i) receiving the first persistent identification and the second persistent identification,
ii) receiving a first timestamp value from timeline information of the first media stream and a second timestamp value from timeline information of the second media stream,
iii) matching the first persistent identification to a first play-out time on the common play-out timeline and the second persistent identification to a second play-out time on the common play-out timeline, and
iv) generating correlation information based on a comparison of the first play-out time with the second play-out time for enabling correlating the first timestamp value with the second timestamp value and thereby correlating the first timeline information with the second timeline information.

2. The system according to claim 1 , wherein the first persistent identification and the second persistent identification are received related in time based on each of the at least two content monitors being arranged for:
i) determining a wallclock timestamp value associated with the persistent identification based on a clock signal which is synchronized between the at least two content monitors, and
ii) providing the wallclock timestamp value together with the persistent identification to the correlation subsystem.

3. The system according to claim 1 , wherein the first persistent identification and the second persistent identification are received related in time based on each of the at least two content monitors synchronously in time obtaining the persistent identification and providing the persistent identification to the correlation subsystem.

4. The system according to claim 1 , wherein the first timestamp value and the second timestamp value are received related in time based on each of the at least two timeline monitors being arranged for:
i) determining a wallclock timestamp value associated with the timestamp value based on a clock signal which is synchronized between the at least two timeline monitors, and
ii) providing the wallclock timestamp value together with the timestamp value to the correlation subsystem.

5. The system according to claim 1 , wherein the first timestamp value and the second timestamp value are received related in time based on each of the at least two timeline monitors synchronously in time obtaining the timestamp value and providing the timestamp value to the correlation subsystem.

6. The system according to claim 1 , wherein the first media stream is distributed via a first segment of a media distribution network and the second media stream is distributed via a second segment of the media distribution network, and wherein the first content monitor and the first timeline monitor are associated with the first segment and the second content monitor and the second timeline monitor are associated with the second segment.

7. The system according to claim 6 , wherein the media distribution network comprises a synchronization subsystem for performing a synchronization action with respect to the second media stream, and wherein the correlation subsystem is arranged for providing timing information for enabling the synchronization subsystem to perform the synchronization action based on the timeline information of the first media stream.

8. The system according to claim 7 , wherein the synchronization action is one of the group of:
a media stream buffering or skipping ahead to enable synchronized playback of the first media stream and/or the second media stream on a plurality of receivers,
a media stream buffering or skipping ahead to enable synchronized playback of the first media stream with the second media stream on a receiver, and
a triggering of an application on a receiver in synchronization with a media stream play-out on the receiver.

9. The system according to claim 1 , wherein one or more of the at least two content monitors is arranged for obtaining the persistent identification of the media stream from a capture of a play-out of the media stream.

10. Content monitor, timeline monitor and/or correlation subsystem as used in the system according to claim 1 .

11. Synchronization client for use in the system according to claim 7 , the synchronization client being part of the synchronization subsystem and being arranged for identifying the segment of the media distribution network in which the synchronization client is comprised to the correlation subsystem.

12. Method for enabling correlating timeline information between a first media stream and a second media stream, the first media stream and the second media stream being both associated with a common play-out timeline and comprising different timeline information, and the method comprising:
receiving a first persistent identification of the first media stream with a second persistent identification of the second media stream where the first persistent identification and the second persistent identification are related in time a) by obtaining the respective persistent identifications synchronously in time or b) by providing a wallclock timestamp value together with the respective timestamp value, each of said persistent identifications being data wherein the respective persistent identifications are one of the group of: a fingerprint, a watermark and a marker;
receiving a first timestamp value from timestamp values in headers of the first media stream and a second timestamp value from timestamp values in headers of the second media stream, where the first timestamp value and the second timestamp value are related in time aa) by obtaining the respective timestamp values synchronously in time or bb) by providing a further wallclock timestamp value together with the respective timestamp value;
matching the

Assignees

• Koninklijke Kpn Nv
• Nederlandse Organisatie Voor Toegepast-Natuurwetenschappelijk Onderzoek Tno

Inventors

• Stokking Hans Maarten
• Van Deventer Mattijs Oskar
• Van Brandenburg Ray

Classifications

• H04N21/8456

  by decomposing the content in the time domain, e.g. in time segments · CPC title

• H04N21/8358

  involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)} · CPC title

• H04N21/242

  Synchronisation processes, e.g. processing of PCR [Programme Clock References] {(arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18)} · CPC title

• G11B27/10

  Indexing; Addressing; Timing or synchronising; Measuring tape travel · CPC title

• H04N21/8547

  involving timestamps for synchronizing content · CPC title