Service signaling recovery for multimedia content using embedded watermarks

Patent metadata

Field	Value
Publication number	US-2016182973-A1
Application number	US-201514975297-A
Country	US
Kind code	A1
Filing date	Dec 18, 2015
Priority date	Dec 18, 2014
Publication date	Jun 23, 2016
Grant date	—

Abstract

Methods, devices, systems and computer program products facilitate accessing metadata associated with a primary audio visual content. Upon reception of a primary content, one or more watermark messages are extracted from the primary content obtain a server code and an interval code. A query to a metadata server is initiated based on the information obtained from the extracted watermark messages. In response to the query, service recovery information is received that includes information identifying one or more timed events, where each timed event identifies an operation to be performed at a corresponding instance in time as the primary content is being presented by the receiver device. One or more operations identified the timed events are initiated at the corresponding instance(s) in time.

First claim

What is claimed is:

1 . A method for acquiring information related to a primary content, comprising:
accessing a primary content at a receiver device; extracting one or more watermark messages that are embedded in the primary content to obtain a server code and an interval code, the one or more watermark messages extracted using a watermark detector that it implemented at least partially in electronic circuits; initiating a query to a metadata server based on information extracted from the one or more watermark messages; receiving service recovery information at the receiver device, the service recovery information comprising information that identifies one or more timed events, each timed event identifying an operation to be performed at a corresponding instance in time as the primary content is being presented by the receiver device; and initiating one or more operations identified by the one or more timed events at the corresponding instance(s) in time.

2 . The method of claim 1 , wherein the service recovery information comprises the following information corresponding to the one or more timed events:
a delivery time representing a time at which the associated timed event is scheduled to occur, and one or more of the following: a uniform resource locator (URL) associated with a file containing event information; or message data containing event information.

3 . The method of claim 1 , wherein the service recovery information is received as one or more service recovery files, and the service recovery information includes a service codestamp and a service identifier, wherein:
the service codestamp maps an associated interval code to a service time which is a time value on a service timeline associated with a service, and the service identifier is an identifier for a service associated with the primary content.

4 . The method of claim 3 , further comprising:
computing a service timestamp using the service codestamp and a receiver codestamp; and storing the service timestamp and the service identifier in a storage device of the receiver device.

5 . The method of claim 4 , wherein:
the service codestamp includes the associated interval code, i sc , and a service time value, t sc , on the service timeline associated with a starting boundary of the one or more watermark messages, and the service timestamp is computed using the following relationship:
[ t st ,t rt ]=[D ( i sc −i rc )+ t sc ,t rc ], wherein
the service timestamp is represented by [t st , t rt ], t rc represents a time value on a receiver presentation timeline associated with the starting boundary of the one or more watermark messages, i rc represents the interval code extracted from the one or more watermark messages by the receiver device, and D is a duration of each extracted watermark message.

6 . The method of claim 5 , wherein the duration of each extracted watermark message is 1.5 seconds.

7 . The method of claim 3 , wherein the service recovery information includes a trigger slack value that identifies a maximum interval of time within which a query can be initiated subsequent to detection of a trigger indication.

8 . The method of claim 7 , wherein the trigger indication is produced upon detection of a change in value of a trigger field of the one or more watermark messages that are extracted from the primary content.

9 . The method of claim 1 , wherein the service recovery information includes a delivery time associated with each timed event representing a time at which the associated timed event is scheduled to occur, and an event type that specifies one of a file delivery, message delivery, query or null events, the method further comprising:
for each timed event,
upon a determination that the delivery time is earlier than a service time, discarding the timed event;
upon a determination that the event type is a file delivery event, adding the timed event to a timed event queue;
upon a determination that the event type is a message delivery event, adding the timed event to a timed event queue with event time equal to the delivery time;
upon a determination that the event type is a query, adding the timed event to the timed event queue with event time equal to the delivery time plus (a) a randomly selected value between zero and a predetermined slack value, or (b) zero, if the slack value is not specified.

10 . The method of claim 9 , further comprising:
providing, to the watermark detector, a timer event request (TIR) associated with earliest event in the timed queue event and having a time value that is translated to a receiver presentation timeline, the receiver presentation timeline representing a timeline that is controlled by the receiver device on which audio components of the primary content input to the watermark detector are presented in synchronization with video components of the primary content.

11 . A method for recovering lost metadata of a primary broadcast content, the method comprising:
extracting a watermark message from the primary content that is received at a receiver device to obtain a server code and an interval code; initiating a query to a metadata server that is identified using the server code, the query further including the interval code; receiving information at the receiver device from the metadata sever that enables retrieval of lost metadata as service recovery information, the service recovery information including a plurality of timed events, each timed event including a service identifier and a service timing information, wherein the service identifier identifies a service associated with the primary content and the service timing information identifies an execution time of an operation to be performed as the primary content is being presented by the receiver device.

12 . A device, comprising:
a processor; and a memory including processor-executable code, the processor executable code, when executed by the processor, causes the device to: access a primary content; extract one or more watermark messages that are embedded in the primary content to obtain a server code and an interval code, the one or more watermark messages extracted using a watermark detector; initiate a query to a metadata server based on information obtained from the one or more watermarks; receive service recovery information at the device, the service recovery information comprising information that identifies one or more timed events, each timed event identifying an operation to be performed at a corresponding instance in time as the primary content is being presented by the device; and initiate one or more operations identified by the one or more timed events at the corresponding instance(s) in time.

13 . The device of claim 12 , wherein the service recovery information comprises the following information corresponding to the one or more timed events:
a delivery time representing a time at which the associated timed event is scheduled to occur, and one or more of the following: a uniform resource locator (URL) associated with a file containing event information; or message data containing event information.

14 . The device of claim 12 , wherein the service recovery information is received as one or more service recovery files, and the service recovery information includes a service codestamp and a service identifier, wherein:
the service codestamp maps an associated interval code to a service time which is a time value on a service timeline associated with a service, and the service identifier is an identifier for a service associated with the primar

Assignees

• Verance Corp

Inventors

• Winograd Joseph M
• Petrovic Rade
• Zhao Jian

Classifications

• H04N21/4722

  for requesting additional data associated with the content · CPC title

• H04N21/23892

  involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level · CPC title

• G06F16/7837

  using objects detected or recognised in the video content · CPC title

• H04N21/8358 Primary

  involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)} · CPC title

• H04N21/26291

  for providing content or additional data updates, e.g. updating software modules, stored at the client (deployment, distribution, installation, update of software G06F8/65; error detection or correction during software upgrading G06F11/1433; arrangements for updating broadcast information or broadcast-related information H04H60/25) · CPC title