Multimedia resource synchronous pushing method based on heterogeneous network

Patent metadata

Field	Value
Publication number	US-11265587-B2
Application number	US-201716319531-A
Country	US
Kind code	B2
Filing date	Aug 29, 2017
Priority date	Aug 29, 2016
Publication date	Mar 1, 2022
Grant date	Mar 1, 2022

Abstract

The present disclosure discloses a method for synchronously pushing a multimedia resource based on a heterogeneous network. The method includes: step 1: obtaining, by a server, end-to-end broadband network delay information or broadband network delay and available bandwidth information of different users; step 2: after receiving a client request, calculating, by the server according to the end-to-end broadband network delay information or the broadband network delay and available bandwidth information of the different users, a moment at which the multimedia resource can be synchronously presented; and step 3: sending, by the server, the multimedia resource after the moment at which the multimedia resource can be synchronously presented, and synchronously playing, by a client, content according to a start presentation time of the multimedia resource, so that broadband content of the different users can be synchronously presented.

First claim

What is claimed is:

1. A method for synchronously pushing a multimedia resource based on a heterogeneous network, wherein the method is any one of the following two methods:
method 1: comprising the following steps:
step 1, obtaining, by a server, an end-to-end broadband network delay of different users;
step 2: after receiving a client request, calculating, by the server according to the end-to-end broadband network delay of the different users, a moment t tmp at which the client receives a first independent decodable media unit (MU); and
step 3: sending at a to moment, by the server, the multimedia resource at a t ini moment, which is a start moment of a first complete independent decodable media unit MU after the moment t tmp , at which the multimedia resource is synchronously presented, and synchronously playing, by the client, content according to a start presentation time of the multimedia resource, at and after the t ini moment, so that broadband content of the different users is synchronously presented, wherein in the step 2 of the method 1, when the end-to-end broadband network delay Δt of the different users is different, the server sends, at the t 0 moment, another multimedia resource at the t ini moment to ensure synchronization, wherein the t ini moment is a start moment of a first complete independent decodable media unit (MU) after the moment t tmp , wherein
0≤ t ini −t tmp <MU _duration

t tmp =t 0 +Δt

in the formula, t 0 is a sending moment, MU_duration is media unit duration, Δt is the end-to-end broadband network delay, and t tmp is a moment that is obtained by calculation and at which the client receives a first independent decodable media unit MU;
method 2: comprising the following steps:
step 1: obtaining, by a server, a client request, a broadband network delay Δt and available bandwidth of different users, and duration of an independent decodable media unit MU (media unit) MU_duration;
step 2: after receiving the client request, calculating, by the server according to the broadband network delay Δt and the available bandwidth of the different users, a moment t tmp at which the client receives a first independent decodable media unit (MU); and
step 3: sending at a t 0 moment, by the server, the multimedia resource at a t ini moment, which is a start moment of a first complete independent decodable media unit MU after the moment t tmp , at which the multimedia resource is synchronously presented, and notifying a client of a play start time of content of the multimedia resource, and synchronously presenting, by different clients, broadband content according to the play start time at and after the t ini moment.

2. The method for synchronously pushing the multimedia resource based on the heterogeneous network according to claim 1 , wherein
a value of MU_duration is: 0 s to 10 s; and
a value of Δt is: 0 to ∞.

3. The method for synchronously pushing the multimedia resource based on the heterogeneous network according to claim 2 , wherein
the value of MU_duration is: 0.5 s; and
the value of Δt is: 2 s.

4. The method for synchronously pushing the multimedia resource based on the heterogeneous network according to claim 3 , wherein either the method 1 or the method 2 is applicable to a case in which at a particular moment, the different users in the heterogeneous network media service request the server for a same multimedia resource or switch different multimedia resources or re-request for another multimedia resource due to network deterioration, to make the content of the multimedia resources synchronously presented.

5. The method for synchronously pushing the multimedia resource based on the heterogeneous network according to claim 2 , wherein either the method 1 or the method 2 is applicable to a case in which at a particular moment, the different users in the heterogeneous network media service request the server for a same multimedia resource or switch different multimedia resources or re-request for another multimedia resource due to network deterioration, to make the content of the multimedia resources synchronously presented.

6. The method for synchronously pushing the multimedia resource based on the heterogeneous network according to claim 1 , wherein in the step 3 of the method 1, the content, which is initially sent by the server is the multimedia resource after the t ini moment, and to enable a broadband and a broadcast to be synchronous, after receiving the first complete MU by using the broadband, the client does not immediately play the first MU, but instead, plays, at the t ini moment, the multimedia resource at this moment.

7. The method for synchronously pushing the multimedia resource based on the heterogeneous network according to claim 6 , wherein either the method 1 or the method 2 is applicable to a case in which at a particular moment, the different users in the heterogeneous network media service request the server for a same multimedia resource or switch different multimedia resources or re-request for another multimedia resource due to network deterioration, to make the content of the multimedia resources synchronously presented.

8. The method for synchronously pushing the multimedia resource based on the heterogeneous network according to claim 1 , wherein in the method 1, the server sends the multimedia resource to the client, and the client synchronously plays the content according to the start presentation time of the multimedia resource.

9. The method for synchronously pushing the multimedia resource based on the heterogeneous network according to claim 8 , wherein either the method 1 or the method 2 is applicable to a case in which at a particular moment, the different users in the heterogeneous network media service request the server for a same multimedia resource or switch different multimedia resources or re-request for another multimedia resource due to network deterioration, to make the content of the multimedia resources synchronously presented.

10. The method for synchronously pushing the multimedia resource based on the heterogeneous network according to claim 1 , wherein in the step 2 of the method 2, when the broadband network delay Δt and the available bandwidth of the different users are different, the server sends, at the t 0 moment, another multimedia resource at the t ini moment to ensure synchronization, wherein the t ini moment is a start moment of a first complete independent decodable media unit MU after t tmp , wherein
0≤ t ini −t tmp <MU_duration

MU_size=MU_duration* B r
t tmp =t 0 +MU_size/ B b +Δt
in the formula, t 0 is a sending moment, MU_size is an average size of sent MUs, MU_duration is media unit duration, B r is a constant bit rate at which the multimedia resource is played, B b is an available bandwidth of a broadband network, Δt is the broadband network delay, and t tmp is a moment that is obtained by calculation and at which the client receives a first independent decodable media unit MU.

11. The method for synchronously pushing the multimedia resource based on the heterogeneous network according to claim 10 , wherein
a value of MU_size is: 0 Mbits to 100 Mbits;
a value of MU_duration is: 0 s to 10 s;
a value of B r is: 0 Mbps to 50 Mbps;
a value of B b is: 0 Tbps to 1 Tbps; and
a value of Δt is: 0 to ∞.

12. The method for synchronously pushing the multimedia resource based on the heterogeneous network according to claim 11 , wherein
the value of MU_size is: 30 Mbits;
the value of MU_duration is: 0.5 s;
the value of B r is: 25 Mbps;
the value of B b is: 1 Mbps; and
the value of Δt i

Assignees

• Univ Shanghai Jiaotong

Inventors

• Xu Yiling
• Zhang Wenjun
• Feng Shan
• Chen Hao
• Wang Yanfeng
• Sun Jun
• Guan Yunfeng

Classifications

• H04N21/43076

  of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices · CPC title

• H04L43/0858 Primary

  One way delays · CPC title

• H04L43/0864

  Round trip delays · CPC title

• H04N21/64738 Primary

  Monitoring network characteristics, e.g. bandwidth, congestion level (data switched network analysis H04L41/14; monitoring functioning in data switched networks H04L43/0817; flow control in packet networks H04L47/10) · CPC title

• H04N21/242 Primary

  Synchronisation processes, e.g. processing of PCR [Programme Clock References] {(arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18)} · CPC title