Display apparatus for synchronizing caption data and control method thereof

Patent metadata

Field	Value
Publication number	US-9319566-B2
Application number	US-201414445667-A
Country	US
Kind code	B2
Filing date	Jul 29, 2014
Priority date	Aug 20, 2013
Publication date	Apr 19, 2016
Grant date	Apr 19, 2016

Abstract

A display apparatus and a method of controlling the display apparatus are disclosed. The display apparatus includes: a signal receiver configured to receive a signal containing video data of a series of frames and corresponding sound data; a first data extractor configured to extract caption data from the signal; a second data extractor configured to extract the video data and the sound data from the signal; a buffering section configured to buffer the extracted video data; a sound-text converter configured to convert the extracted sound data into a text through sound recognition; a synchronizer configured to compare the converted text with the extracted caption data, and synchronize the caption data with frames corresponding to respective caption data among frames of the buffered video data; and a display configured to display the frames synchronized with the caption data.

First claim

What is claimed is:

1. A display apparatus comprising:
a signal receiver configured to receive a signal containing video data of a series of frames and corresponding sound data;
a first data extractor configured to extract caption data from the signal;
a second data extractor configured to extract the video data and the sound data from the signal;
a buffering section configured to buffer the extracted video data;
a sound-text converter configured to convert the extracted sound data into a text through sound recognition;
a synchronizer configured to compare the converted text with the extracted caption data, and synchronize the caption data with frames corresponding to respective caption data among frames of the buffered video data; and
a display configured to display the frames synchronized with the caption data,
wherein the sound-text converter comprises a communicator which transmits the extracted sound data to a server connected through a network, and receives the text from the server.

2. The display apparatus according to claim 1 , wherein
the signal comprises encoded caption data, and
the first data extractor comprises a caption decoder which decodes the encoded caption data and extracts the caption data.

3. The display apparatus according to claim 1 , wherein the first data extractor comprises a character recognizer which recognizes the caption data in the frames of the video data.

4. The display apparatus according to claim 1 , wherein the synchronizer synchronizes the caption data with corresponding frames, based on timing information of the sound data corresponding to the converted text.

5. The display apparatus according to claim 1 , wherein the signal receiver comprises a tuner to receive a broadcasting signal corresponding to one among a plurality of channels.

6. The display apparatus according to claim 1 , wherein the signal receiver comprises a connector connected to a set-top box and receiving the signal from the set-top box.

7. The display apparatus according to claim 1 , further comprising a sound output section configured to synchronize and output a sound corresponding to the caption data with the frames.

8. A method of controlling a display apparatus, the method comprising:
receiving a signal containing video data of a series of frames and corresponding sound data;
extracting caption data from the signal;
extracting the video data and the sound data from the signal;
buffering the extracted video data;
converting the extracted sound data into a text through sound recognition;
comparing the converted text with the extracted caption data, and synchronizing the caption data with frames corresponding to respective caption data among frames of the buffered video data, to display the synchronized frames,
wherein the converting the extracted sound data comprises:
transmitting the extracted sound data to a server connected through a network; and
receiving the converted text from the server.

9. The method according to claim 8 , wherein
the signal comprises encoded caption data, and
the extracting the caption data comprises decoding the encoded caption data.

10. The method according to claim 8 , wherein the synchronizing and displaying comprises synchronizing the caption data with corresponding frames, based on timing information of the sound data corresponding to the converted text.

11. The method according to claim 8 , wherein the caption data comprises translation data.

12. The method according to claim 8 , wherein the receiving the signal comprises receiving a broadcasting signal corresponding to one among a plurality of channels.

13. The method according to claim 8 , wherein the receiving the signal comprises receiving the signal from a set-top box connected to the display apparatus.

14. The method according to claim 8 , further comprising synchronizing and outputting a sound corresponding to the caption data with the frames.

15. The display apparatus according to claim 1 , wherein the first data extractor and the second data extractor operate concurrently.

16. The method according to claim 8 , wherein the extracting the caption data and the extracting the video data and the sound data are performed concurrently.

17. A system comprising a display apparatus and a server,
wherein the display apparatus comprises:
a signal receiver configured to receive a signal containing video data of a series of frames and corresponding sound data;
a first data extractor configured to extract caption data from the signal;
a second data extractor configured to extract the video data and the sound data from the signal;
a buffering section configured to buffer the extracted video data;
a communicator configured to transmit the extracted sound data to the server through a network and receive converted text from the server;
a synchronizer configured to compare the converted text with the extracted caption data, and synchronize the caption data with frames corresponding to respective caption data among frames of the buffered video data; and
a display configured to display the frames synchronized with the caption data; and
wherein the server is configured to convert the extracted sound data into text and transmit the text to the display apparatus.

18. The system according to claim 17 , wherein the display apparatus and the server are connected via at least one from among a wired and wireless network.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kwon Oh-Yun
• Jun Byung-Jo

Classifications

• G10L15/30

  Distributed recognition, e.g. in client-server systems, for mobile phones or network applications · CPC title

• H04N21/4394

  involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58) · CPC title

• H04N21/4307

  Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen · CPC title

• H04N21/440236

  by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text · CPC title

• H04N21/4856

  for language selection, e.g. for the menu or subtitles · CPC title