Method for synchronizing multimedia flows and corresponding device

Patent metadata

Field	Value
Publication number	US-9729762-B2
Application number	US-201113878216-A
Country	US
Kind code	B2
Filing date	Oct 14, 2011
Priority date	Oct 15, 2010
Publication date	Aug 8, 2017
Grant date	Aug 8, 2017

Abstract

The present invention relates to a reception device and a method for the processing of multimedia data flows in said device comprising an interface to a first network and an interface to a second network, said method comprising the following steps: receive, from the first network, a first flow comprising multimedia data through a first transport protocol fitted with a first data synchronization system; receive, from the second network, a second flow comprising multimedia data through a second transport protocol fitted with a second data synchronization system, said second synchronization system being based on timing references different from those of the first data synchronization system; characterized in that said first and second flows transport the same synchronization information in the payload field of the first and of the second transport protocol, said synchronization information comprising data indicating the moment from which said multimedia data must be rendered; synchronize said first and second flows by using said synchronization information; and perform a step for rendering said first and second multimedia flows.

First claim

The invention claimed is:

1. A method for the processing of multimedia data in a reception device comprising an interface to a first network and an interface to a second network, comprising the following steps of:
receiving, from the first network, through a first transport protocol, a first flow comprising first multimedia data, and temporal synchronization data related to a timeline for content rendering, said temporal synchronization data being synchronized with the first multimedia data using a synchronization protocol specific to said first protocol;
receiving, from the second network, through a second transport protocol, a second flow comprising second multimedia data and the temporal synchronization data related to the timeline for content rendering, said temporal synchronization data being synchronized with the second multimedia data using a synchronization protocol specific to said second protocol said second multimedia data being pre-loaded upon request of said reception device to enable the reception device to render it synchronously with the first multimedia data;
synchronizing the rendering of said first and second multimedia data by using temporal synchronization data related to the timeline for content rendering;

 said method comprising the steps of, prior to rendering said first flow:
receiving, from the first network, countdown information indicating when the timeline for content rendering to begin, said countdown information being transported in said first flow; and
issuing, based on said countdown information, said request to receive said second multimedia data before said beginning of the timeline for content rendering, so that said second multimedia data is rendered synchronously with said first multimedia data.

2. The method according to claim 1 , said first transport protocol being of the MPEG-2 TS type.

3. The method according to claim 2 , said first component being adapted to transport auxiliary data.

4. The method according to claim 3 , said first component being a broadcast timeline descriptor.

5. The method according to claim 1 , said second transport protocol being of the RTP type.

6. The method according to claim 1 , the synchronization step comprising a step for delaying the content received in advance by memorization, until the contents can be rendered synchronously.

7. The method according to claim 1 , the first flow being received on the first network in broadcast mode.

8. A reception device comprising
an interface to a first network for receiving, through a first transport protocol, a first flow comprising first multimedia data, and temporal synchronization data related to a timeline for content rendering, said temporal synchronization data being synchronized with the first multimedia data using a synchronization protocol specific to said first protocol;
an interface to a second network, for receiving, through a second transport protocol, a second flow comprising second multimedia data and the temporal synchronization data related to the timeline for content rendering, said temporal synchronization data being synchronized with the second multimedia data using a synchronization protocol specific to said second protocol said second multimedia data being pre-loaded upon request of said reception device to enable the reception device to render it synchronously with the first multimedia data;
a synchronizer for:
synchronizing the rendering of said first and said second multimedia data by using temporal synchronization data related to the timeline for content rendering;
receiving, from the first network, countdown information indicating when the timeline for content rendering is to begin, said countdown information being transported in said first flow; and
issuing, based on said countdown information, said request to receive said second multimedia data before the beginning of timeline for content rendering, so that said second multimedia data is rendered synchronously with said first multimedia data.

Assignees

• Laurent Anthony
• Gautier Eric
• Legallais Yvon
• Thomson Licensing

Inventors

• Laurent Anthony
• Gautier Eric
• Legallais Yvon

Classifications

• H04N21/6112

  involving terrestrial transmission, e.g. DVB-T · CPC title

• H04N21/8455

  involving pointers to the content, e.g. pointers to the I-frames of the video stream · CPC title

• H04N21/6437

  Real-time Transport Protocol [RTP] · CPC title

• H04N21/236 Primary

  Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream {(multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00)} · CPC title

• H04N21/631

  Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols · CPC title