Embedded rtcp packets

Patent metadata

Field	Value
Publication number	US-2016165015-A1
Application number	US-201414562594-A
Country	US
Kind code	A1
Filing date	Dec 5, 2014
Priority date	Dec 5, 2014
Publication date	Jun 9, 2016
Grant date	—

Abstract

Various of the disclosed embodiments reduce the impact of RTCP overhead by including RTCP information in the media packets themselves. The values in the RTCP headers may be selected based on the context and organized in a unique format for transport in the media packets. For example, RTT, packet loss, and bandwidth estimates may dictate when and how RTCP data is moved into the media packet. An interface may be provided for extracting the data so that clients may easily integrate the embodiments with existing RTCP-based systems. Inclusion of the RTCP information in the media packet may increase the media packet size, which may be anticipated in bandwidth assessments and accommodations.

First claim

What is claimed is:

1 . A computer-implemented method, comprising:
establishing a multimedia communication session from a first communication node to a second communication node, wherein the multimedia communication session is conducted via a communication network using a communication protocol; determining, based on a revision number of the second communication node, whether the second communication node supports a mixed media transmission mode in which media packets include control information; and transmitting, when the second communication node supports the mixed media transmission mode, a plurality of media packets comprising media data from the first communication node to the second communication node at a given rate of packet transmission, wherein at least some of the plurality of media packets are mixed media packets which include digitized media data that is captured at a user interface of the first communication node and further include quality information indicative of a quality of data packets received during the audio communication session from the second communication node within a time window of an observation duration.

2 . The method of claim 1 , further including refraining from transmitting quality information from the first communication node to the second communication node in data packets that do not contain audio information.

3 . The method of claim 1 , wherein each of the media packet is a mixed media packet.

4 . The method of claim 1 wherein a first rate of transmission of mixed media packets as a fraction of the second rate of transmission of the plurality of media packet is a function of quality information.

5 . The method of claim 4 , wherein a value of the fraction increases when with decreasing quality of data packets received from the second communication node.

6 . The method of claim 4 , wherein a value of the fraction decreases when with decreasing quality of data packets received from the second communication node.

7 . The method of claim 1 , wherein the quality information includes at least one of a packet jitter value and a dropped packet count.

8 . The method of claim 1 , wherein the transmitting includes transmitting using a real time protocol (RTP) and wherein the plurality of media packets follow a pre-defined RTP packet format.

9 . The method of claim 1 , wherein each of the plurality of media packets follows a packet format that includes a packet header portion and a packet payload portion, wherein the quality information is included only in the packet header portion and the digitized media data is included only in the packet payload portion.

10 . A communication apparatus, comprising:
a memory; a processor and a network interface; wherein the processor establishes an audio communication session with a far end node, wherein the audio communication session is conducted over the network interface using a communication protocol; wherein the processor determines, based on a revision number of the far end communication node, whether the far end communication node supports a mixed media transmission mode in which media packets include control information; wherein, upon determining that the far end node supports the mixed media transmission mode, the processor further transmits a plurality of media packets comprising media data from the memory to the far end node at a given rate of packet transmission, wherein at least some of the plurality of media packets are mixed media packets which include digitized media data that is captured at a user interface of the communication apparatus and further include quality information indicative of a quality of data packets received during the audio communication session from the second communication node within a time window of an observation duration.

11 . The apparatus of claim 10 , wherein the processor transmits quality information to the far end node only in data packets that include audio information.

12 . The apparatus of claim 10 , wherein each of the media packet is a mixed media packet.

13 . The apparatus of claim 10 wherein a first rate of transmission of mixed media packets as a fraction of the second rate of transmission of the plurality of media packet is a function of quality information.

14 . The apparatus of claim 13 , wherein a value of the fraction increases when with decreasing quality of data packets received from the second communication node.

15 . The apparatus of claim 13 , wherein a value of the fraction decreases when with decreasing quality of data packets received from the second communication node.

16 . The apparatus of claim 10 , wherein the quality information includes at least one of a packet jitter value and a dropped packet count.

17 . The apparatus of claim 10 , wherein the processor transmits using a real time protocol (RTP) and wherein the plurality of media packets follow a pre-defined RTP packet format.

18 . The apparatus of claim 10 , wherein each of the plurality of media packets follows a packet format that includes a packet header portion and a packet payload portion, wherein the quality information is included only in the packet header portion and the digitized media data is included only in the packet payload portion.

19 . A computer program product comprising a computer-readable memory for storing program instructions, when executed, causing a computer to implement a method comprising:
establishing a multimedia communication session from a first communication node to a second communication node, wherein the multimedia communication session is conducted via a communication network using a communication protocol; determining, based on a revision number of the second communication node, whether the second communication node supports a mixed media transmission mode in which media packets include control information; and transmitting, when the second communication node supports the mixed media transmission mode, a plurality of media packets comprising media data from the first communication node to the second communication node at a given rate of packet transmission,
wherein at least some of the plurality of media packets are mixed media packets which include digitized media data that is captured at a user interface of the first communication node and further include quality information indicative of a quality of data packets received during the audio communication session from the second communication node within a time window of an observation duration.

20 . The computer program product of claim 19 , further including program instructions for:
receiving packets in mixed media transmission mode; extracting audio information from the packets; and presenting the extracted audio information to a user interface.

Assignees

• Facebook Inc

Inventors

• Reddappagari Parama Jyothi
• Li Naizhi

Classifications

• H04L65/80

  Responding to QoS · CPC title

• H04L43/087

  Jitter · CPC title

• H04L65/1069

  Session establishment or de-establishment · CPC title

• H04L43/0829

  Packet loss · CPC title

• H04L43/0864

  Round trip delays · CPC title