Fec mechanism based on media content

Patent metadata

Field	Value
Publication number	US-10469202-B2
Application number	US-201615542079-A
Country	US
Kind code	B2
Filing date	Jan 8, 2016
Priority date	Jan 8, 2015
Publication date	Nov 5, 2019
Grant date	Nov 5, 2019

Abstract

The invention provides an FEC (Forward error correction) mechanism based on media content. The mechanism classifies the media content, and endows it with different importance, and then changes the coding scheme according to the packets belonging to frames of different importance in combination with channel conditions and user experience, to conduct protection according to the importance of corresponding frames. By using the technical scheme of the invention, for the data congestion caused by excessive coding in the current FEC system, the media content is able to be classified and endowed with different importance, and controlled by signaling and indicating bit; different FEC coding strengths is able to be adopted; the duplication-expanding window fountain code with the unequal error protection performance is able to be further adopted, to achieve the maximum guarantee of media content quality and reduce the large amount of data caused by FEC.

First claim

What is claimed is:

1. An FEC (Forward error correction) mechanism based on media content, wherein the FEC mechanism is implemented by using following method:
Method III: classifying the media content, and endowing it with the different importance; in the absence of a shunt for the original media data flow, dynamically adjusting the importance of frames contained in the media packet and the corresponding coding scheme according to a current channel condition; transmitting the data packets to the corresponding FEC encoder to conduct different degrees of protection; finally, encoding one source data flow as one FEC code stream;
wherein Method III comprises following sub-steps: generating MMTP flows and a signaling based on media resources; according to different importance of each frame of data in MMT flows, using FEC encoding matrix to perform the FEC coding and integrating the FEC codes; returning corresponding repair characters, an FEC data load identification and an original data load identification; packaging all the repair characters into an FEC repair packet and sending to the transport layer.

2. The FEC mechanism based on the media content according to claim 1 , wherein the method III comprises steps of adding the unequal error protection flag bit in the signaling information transmitted together with the media processing unit (MPU), and adding special instruction fields to form more personalized protection schemes.

3. The FEC mechanism based on the media content according to claim 1 , wherein
Method III: classifying the media content and endowing the media content with the different importance; then controlling by a signaling and a indicating bit; coding by using FEC coding strengths.

4. The FEC mechanism based on the media content according to claim 1 , wherein Method III: for the architecture of MMT AL-FEC sending end, a flow method of the sending end comprises steps of:
a) Generating MMTP flows and a signaling by the server based on media resources;
b) According to the different importance of each frame of data in MMT flows, transmitting MMT packets to FEC encoders; for different priorities, using FEC encoding matrices to perform the FEC coding of MMT packets, to generate corresponding FEC codes;
c) Integrating FEC codes formed after performing the FEC coding of MMT packets with different priorities in a same data flow in a previous step, to generate an FEC code stream;
d) After FEC coding is completed, returning a corresponding repair characters, an FEC data load identification and an original data load identification; and
e) Packaging all the repair characters into an FEC repair packet and sending to the transport layer.

5. The FEC mechanism based on the media content according to claim 4 , wherein the method III comprises a step of identifying FEC flows, an FEC coding structure used and an FEC code by the signaling; to support the mechanism, the fec_flow_descriptor field in the signaling is modified: a new fec_coding_structure is added based on current three kinds of fec_coding_structure fields in an AL-FEC message; a function of the fec_coding_structure is to describe a currently used FEC coding scheme, including a selected coding algorithm, whether to use a private coding scheme, a maximum protection time window time and value, etc.; a field is located in an AL-FEC signaling and is transmitted to the receiving end; the flag bit of the newly added fec_coding_structure is selected within a range of an existing reserved;
an original signaling only supports a repair information of one FEC flow multiplexing multiple media resources; the parts with different importance of one media resource is added now; the FEC signaling is respectively controlled to refine the FEC mechanism; the server is able to dynamically adjust the FEC strength of different parts of the media resource according to a user network status, to achieve a balance point between a network bandwidth and the user experience.

Assignees

• Univ Shanghai Jiaotong

Inventors

• Xu Yiling
• Zhang Wenjun
• Sun Jun
• Tang Xuguo
• Huang Wei
• Li Bo
• Guan Yunfeng
• Liu Ning

Classifications

• H04L1/0017

  where the mode-switching is based on Quality of Service requirement · CPC title

• H04L1/0009

  by adapting the channel coding (H04L1/1812 takes precedence) · CPC title

• G06F16/35

  Clustering; Classification · CPC title

• H04L1/0076

  Distributed coding, e.g. network coding, involving channel coding (coding in both space and time H04L1/0618; cooperative diversity H04B7/022) · CPC title

• H04L1/007 Primary

  Unequal error protection (for format H04L1/0078; for codes per se H03M13/35) · CPC title