Timestamp-based audio and video processing method and system thereof

Patent metadata

Field	Value
Publication number	US-2016205349-A1
Application number	US-201614993091-A
Country	US
Kind code	A1
Filing date	Jan 12, 2016
Priority date	Jan 12, 2015
Publication date	Jul 14, 2016
Grant date	—

Abstract

A timestamp-based audio and video processing method and a system thereof are provided. The method is adapted to an electronic device having an image capturing device and an audio input device and includes the following steps. First, an image signal and an audio signal are extracted within a same time interval by respectively using the image capturing device and the audio input device so as to generate video data and audio data, and the time interval is converted to timestamp data, where the video data includes a single video frame with a variable file size, the audio data includes multiple audio files with a fixed file size. Next, the video data, the audio data, and the timestamp data are integrated into transmission data.

First claim

1 . A timestamp-based audio and video processing method, adapted to an image capturing device and an audio receiving device, comprising:
extracting an image signal and an audio signal within a same time interval by using the image capturing device and the audio receiving device respectively so as to generate video data and audio data, wherein the video data comprises a single video frame with a variable file size, and wherein the audio data comprises a plurality of audio files with a fixed file size; converting the time interval to timestamp data; and integrating the video data, the audio data, and the timestamp data into transmission data.

2 . The method according to claim 1 , wherein the step of extracting the image signal by using the image capturing device so as to generate the video data comprises:
extracting the image signal by using the image capturing device; and digitizing and compressing the image signal to the video data with the variable file size.

3 . The method according to claim 1 , wherein the step of converting the time interval to the timestamp data comprises:
generating the timestamp data according to the time interval and a packet sequence number.

4 . The method according to claim 1 , wherein the step of integrating the video data, the audio data, and the timestamp data into the transmission data comprises:
generating an audio-video packet as the transmission data by using the video data, the audio data, and the timestamp data.

5 . The method according to claim 1 , wherein the step of integrating the video data, the audio data, and the timestamp data into the transmission data comprises:
generating a video packet by using the video data; generating an audio packet by using the audio data and the timestamp data; and setting the video packet and the audio packet as the transmission data.

6 . The method according to claim 1 , wherein after the step of integrating the video data, the audio data, and the timestamp data into the transmission data, the method further comprises:
transmitting the transmission data to another electronic device.

7 . A timestamp-based audio and video processing method, adapted to an image capturing device and an audio receiving device, comprising:
obtaining first transmission data from a first source, wherein the first transmission data comprises first video data, first audio data, and first timestamp data, wherein the first video data comprises a single video frame with a variable file size, and wherein the first audio data comprises a plurality of audio files with a fixed file size; and playing the first video data and the first audio data respectively by using the screen and the audio playing device according to the first timestamp data of the first transmission data.

8 . The method according to claim 7 , wherein the first transmission data is an audio-video packet comprising the first video data, the first audio data, and the first timestamp data, wherein the electronic device comprises a first data buffer having a plurality of first temporary positions, and wherein after the step of obtaining the first transmission data from the first source, the method further comprises:
pushing the first audio-video packet to the first temporary positions sequentially according to the first timestamp data in the first audio-video packet.

9 . The method according to claim 8 , wherein the step of playing the first video data and the first audio data respectively by using the screen and the audio playing device according to the first timestamp data of the first transmission data comprises:
when the first audio-video packet is sorted at first among the first temporary positions, playing the first video data and the first audio data in the first audio-video packet.

10 . The method according to claim 8 , wherein the electronic device further comprises a second data buffer having a plurality of second temporary positions, and wherein the method further comprises:
obtaining second transmission data from a second source, wherein the second transmission data is a second audio-video packet comprising second video data, second audio data, and second timestamp data, wherein the second video data comprises a single video frame with a variable file size, and wherein the second audio data comprises a plurality of audio files with a fixed file size; pushing the second audio-video packet to the second temporary positions sequentially according to the second timestamp data in the second audio-video packet; and when the first audio-video packet is sorted at first among the first temporary positions and when the second audio-video packet is sorted at first among the second temporary positions, concurrently playing the first video data and the first audio data in the first audio-video packet as well as the second video data and the second audio data in the second audio-video packet.

11 . The method according to claim 10 , wherein the electronic device concurrently plays the first video data and the second video data by a multi-window or a pop-up play on the screen.

12 . The method according to claim 7 , wherein the first transmission data is a first video packet comprising the first video data and a first audio packet comprising the first audio data and the first timestamp data, wherein the electronic device comprises a first video buffer having a single first video temporary position and a first audio buffer having a plurality of first audio temporary positions, and wherein after the step of obtaining the first transmission data from the first source, the method further comprises:
pushing the first video packet to the first video temporary position; and pushing the first audio packet to the first audio temporary positions sequentially according to the first timestamp data in the first audio packet.

13 . The method according to claim 12 , wherein the step of pushing the first video packet to the first video temporary position comprises:
when there exists another packet at the first video temporary position, overwriting the another packet by the first video packet.

14 . The method according to claim 12 , wherein the step of playing the first video data and the first audio data respectively by using the screen and the audio playing device according to the first timestamp data of the first transmission data comprises:
immediately playing the first video data in the first video packet at the first video temporary position by using the screen; and when the first audio packet is sorted first among the first audio temporary positions, playing the first audio data in the first audio packet by using the audio playing device.

15 . The method according to claim 12 , wherein the electronic device further comprises a second video buffer having a single second video temporary position and a second audio buffer having a plurality of second audio temporary positions, and wherein the method further comprises:
obtaining second transmission data from a second source, wherein the second transmission data is a second video packet comprising second video data and a second audio packet comprising second audio data and second timestamp data, wherein the second video data comprises a single video frame with a variable file size, and wherein the second audio data comprises a plurality of audio files with a fixed file size; pushing the second video packet to the second video temporary position; pushing the second audio packet to the second audio temporary positions sequentially according to the second timestamp data in the second audio packet; selecting one of the first video data in t

Assignees

• Cheng Hsin-Chieh
• Chang Kun-Hsuan
• Weng Ming-Che
• Compal Electronics Inc

Inventors

• Cheng Hsin-Chieh
• Chang Kun-Hsuan
• Weng Ming-Che

Classifications

• H04N23/66

  Remote control of cameras or camera parts, e.g. by remote control devices · CPC title

• H04N21/23614

  Multiplexing of additional data and video streams (arrangements for simultaneous broadcast of plural pieces of information H04H20/28) · CPC title

• H04N21/23602 Primary

  Multiplexing isochronously with the video sync, e.g. according to bit-parallel or bit-serial interface formats, as SDI · CPC title

• H04N7/142

  Constructional details of the terminal equipment, e.g. arrangements of the camera and the display · CPC title

• H04N7/15 Primary

  Conference systems · CPC title