Receiving apparatus and receiving method thereof

Patent metadata

Field	Value
Publication number	US-9762774-B2
Application number	US-201214238645-A
Country	US
Kind code	B2
Filing date	Aug 13, 2012
Priority date	Aug 12, 2011
Publication date	Sep 12, 2017
Grant date	Sep 12, 2017

Abstract

Method and apparatus for processing multimedia data received via different networks by synchronizing time stamps of video frames of multimedia data received via the different networks using time codes in the multimedia data.

First claim

What is claimed is:

1. A receiving apparatus comprising:
a first receiver configured to receive, through a broadcasting network, first multimedia data comprising a first time stamp information, each frame of the first multimedia data comprising a first time code;
a second receiver configured to receive, through an Internet Protocol (IP) network, second multimedia data comprising a second time stamp information, each frame of the second multimedia data comprising a second time code;
a processor configured to compare the first time code and the second time code, identify a difference in time stamp information of video frames comprising matching time codes, and reproduce by synchronizing the video frames comprising the matching first and second time codes based on the difference,
wherein the first time stamp information comprises at least one of a first Decoding Time Stamp, DTS, and a first Presentation Time Stamp, PTS, and
wherein the second time stamp information comprises at least one of a second DTS and a second PTS.

2. The receiving apparatus of claim 1 , wherein the processor comprises:
a first and second demultiplexer configured to demultiplex the received first and second multimedia data, respectively;
a first and second buffer configured to store first and second video data which is demultiplexed from the first and second multimedia data, respectively;
a first and second decoder configured to decode the first and second video data stored in the first and second buffer when the first DTS and the second DTS are consistent with a system clock and obtain the first and second video frame, respectively;
a third and fourth buffer configured to store the obtained first and second video frame, respectively.

3. The receiving apparatus of claim 2 , wherein the processor is further configured to correct the time stamp information of one of the first video data and the second video data stored in the first buffer and the second buffer using the difference in the time stamp information.

4. The receiving apparatus of claim 1 , further comprising a storage configured to store the first multimedia data received through the first receiver,
wherein, in response to the second multimedia data to be synchronized with the stored first multimedia data being received, the processor processes the stored first multimedia data.

5. The receiving apparatus of claim 4 , wherein the processor is further configured to compare the first time code added to the first multimedia data stored in the storage and the second time code added to the second multimedia data received through the second receiver, and determine whether the second multimedia data to be synchronized with the stored first multimedia data is received or not.

6. The receiving apparatus of claim 4 , wherein, when a user command to reproduce by synchronizing the first multimedia data and the second multimedia data is input, the processor is further configured to control the storage to store the first multimedia data.

7. A method for receiving of a receiving apparatus, the method comprising:
receiving, through a broadcasting network, first multimedia data comprising a first time stamp information, each frame of the first multimedia data comprising a first time code;
receiving, through an Internet Protocol (IP) network, second multimedia data comprising a second time stamp information, each frame of the second multimedia data comprising a second time code;
comparing the first time code of the first multimedia and the second time and identifying a difference in time stamp information of video frames comprising matching time codes; and
reproduce by synchronizing the video frames comprising the matching first and second time codes based on the difference,
wherein the first time stamp information comprises at least one of a first Decoding Time Stamp, DTS, and a first Presentation Time Stamp, PTS, and
wherein the second time stamp information comprises at least one of a second DTS and a second PTS.

8. The method of claim 7 , further comprises;
demultiplexing the received first and second multimedia data, respectively;
storing first and second video data which is demultiplexed from the first and second multimedia data in a first and second buffer, respectively;
decoding the first and second video data stored in the first and second buffer if the first DTS and the second DTS are consistent with a system clock and obtaining the first and second video frame; and
storing the obtained first and second video frame in a third and fourth buffer.

9. The method of claim 8 , further comprising correcting the time stamp information of one of the first video data and the second video data stored in the first buffer and the second buffer using the difference in the time stamp information.

10. The method of claim 7 , further comprises; storing the first multimedia data received through a first receiver; and,
in response to the second multimedia data to be synchronized with the stored first multimedia data being received, processing the stored first multimedia data.

11. The method of claim 10 , wherein the generating the first video frame comprises:
comparing the first time code added to the stored first multimedia data and the second time code added to the received second multimedia data; and
determining whether the second multimedia data to be synchronized with the stored first multimedia data is received or not.

12. The method of claim 10 , wherein the storing comprises, when a user command to reproduce by synchronizing the first multimedia data and the second multimedia data is input, storing the first multimedia data.

13. The receiving apparatus of claim 1 , wherein the first time code and the second time code comprise a Society of Motion Picture and Television Engineers (SMPTE) time code.

14. The receiving apparatus of claim 1 , wherein the first multimedia data comprises a multiplexed stream of a first packetized video Elementary Stream (ES) and a first additional ES constituting the first multimedia data using a Packetized Elementary Stream (PES) packetizer, one of a header of the first ES and a header of the first additional ES comprising the first time stamp information, and
wherein the second multimedia data comprises a multiplexed stream of a second packetized video Elementary Stream (ES) and a second additional ES constituting the second multimedia data using a Packetized Elementary Stream (PES) packetizer, one of a header of the second ES and a header of the second additional ES comprising the second time stamp information.

15. The method of claim 7 , wherein the first time code and the second time code comprise a Society of Motion Picture and Television Engineers (SMPTE) time code.

16. The method of claim 7 , wherein the first multimedia data comprises a multiplexed stream of a first packetized video Elementary Stream (ES) and a first additional ES constituting the first multimedia data using a Packetized Elementary Stream (PES) packetizer, one of a header of the first ES and a header of the first additional ES comprising the first time stamp information, and
wherein the second multimedia data comprises a multiplexed stream of a second packetized video Elementary Stream (ES) and a second additional ES constituting the second multimedia data using a Packetized Elementary Stream (PES) packetizer, one of a header of the second ES and a header of the second additional ES comprising the second time stamp information.

Assignees

• Joo Yu-Sung
• Lee Dae-Jong
• Kim Hee-Jean
• Lee Jae-Jun
• Jang Yong-Seok
• Park Hong-Seok
• Samsung Electronics Co Ltd

Inventors

• Joo Yu-Sung
• Lee Dae-Jong
• Kim Hee-Jean
• Lee Jae-Jun
• Jang Yong-Seok
• Park Hong-Seok

Classifications

• H04N21/631

  Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols · CPC title

• H04N21/4622

  Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859) · CPC title

• H04H20/18 Primary

  Arrangements for synchronising broadcast or distribution via plural systems · CPC title

• H04N21/4307

  Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen · CPC title

• H04N21/242

  Synchronisation processes, e.g. processing of PCR [Programme Clock References] {(arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18)} · CPC title