Content scenario and network condition based multimedia communication

Patent metadata

Field	Value
Publication number	US-10686859-B2
Application number	US-201715856768-A
Country	US
Kind code	B2
Filing date	Dec 28, 2017
Priority date	Dec 28, 2017
Publication date	Jun 16, 2020
Grant date	Jun 16, 2020

Abstract

Embodiments include apparatuses, methods, and systems including a content scenario detection unit and a rate adjustment unit for the communication of a multimedia content. The multimedia content may include a low bitrate scenario and a high bitrate scenario. The content scenario detection unit may detect the low bitrate scenario of the multimedia content for a multimedia traffic when a transmitter is to generate a first window of one or more frames of the low bitrate scenario during a first time period at a first encoding rate. The rate adjustment unit may determine, based at least in part on the detection of the low bitrate scenario, a second encoding rate different from the first encoding rate. The transmitter may generate at the second encoding rate a second window of one or more frames of the low bitrate scenario during a second time period. Other embodiments may also be described and claimed.

First claim

What is claimed is:

1. An apparatus for multimedia communication, comprising:
a content scenario detection unit to detect a first bitrate scenario of a multimedia content for a multimedia traffic when a transmitter is to generate a first window of one or more frames of the first bitrate scenario during a first time period at a first encoding rate, the first bitrate scenario having a first plurality of windows, each window having one or more frames, wherein the multimedia content includes the first bitrate scenario represented by a first bitrate, and a second bitrate scenario to follow the first bitrate scenario, the second bitrate scenario having a second plurality of windows, each window having one or more frames of the multimedia content represented by a second bitrate larger than the first bitrate; and
a rate adjustment unit coupled to the content scenario detection unit, to determine, based at least in part on the detection of the first bitrate scenario, and one or more network congestion parameters, a second encoding rate different from the first encoding rate;
wherein the transmitter generates at the second encoding rate a second window of one or more frames of the first bitrate scenario during a second time period to follow the first time period.

2. The apparatus of claim 1 , wherein the first bitrate scenario is a section of the multimedia content that includes one or more scenes with frames of first quality, a first framerate, or a first number of movement in the one or more scenes, and the second bitrate scenario is a section of the multimedia content that includes one or more scenes with frames of a quality higher than the first quality, a framerate higher than the first framerate, or a number of movement higher than the first number of movement.

3. The apparatus of claim 1 , wherein a difference between the first encoding rate and the second encoding rate is a multiple of a predetermined rate adjustment step value.

4. The apparatus of claim 1 , wherein the one or more network congestion parameters include a goodput, a packet delay, or a packet loss rate (PLR) of the multimedia traffic for the first window of one or more frames, or during the first time period.

5. The apparatus of claim 1 , wherein the content scenario detection unit is to detect the first bitrate scenario based on a transmitter bitrate of the transmitter to measure a bitrate of the multimedia traffic transmitted by the transmitter for the first window of one or more frames, or during the first time period, and a network efficiency defined as a ratio between a receiving bitrate and the transmitter bitrate, wherein the receiving bitrate is to measure a bitrate received by a receiver during the first window of one or more frames or during the first time period.

6. The apparatus of claim 5 , wherein the transmitter bitrate is calculated based on a starting timestamp of a starting packet of the first window of one or more frames, an ending timestamp of an ending packet of the first window of one or more frames, and the first encoding rate of the transmitter for the first window of one or more frames.

7. The apparatus of claim 6 , wherein the starting timestamp of the starting packet of the first window of one or more frames and the first encoding rate of the transmitter for the first window of one or more frames are included in a custom header extension of a header of the ending packet of the first window.

8. The apparatus of claim 6 , wherein the starting timestamp of the starting packet, the ending timestamp of the ending packet, and the first encoding rate of the transmitter for the first window of one or more frames are sent by the transmitter as a custom field in a real-time transport protocol (RTP) control protocol (RTCP) sender report.

9. The apparatus of claim 5 , wherein the transmitter bitrate is estimated based on a maximum transmission unit (MTU) size, or a number of missing packets and an average packet size.

10. The apparatus of claim 5 , wherein the rate adjustment unit is to determine to decrease the first encoding rate to obtain the second encoding rate based at least in part on a set of parameters related to the transmitter bitrate, the network efficiency, a goodput, a packet delay, or a PLR of the multimedia traffic.

11. The apparatus of claim 5 , wherein the rate adjustment unit is to determine to increase the first encoding rate to obtain the second encoding rate based at least in part on a set of parameters related to the transmitter bitrate, the network efficiency, a goodput, a packet delay, or a PLR of the multimedia traffic.

12. The apparatus of claim 5 , wherein the rate adjustment unit includes an interval rate adjustment unit to adjust the first encoding rate to an interval of encoding rates based at least in part on a set of parameters related to the transmitter bitrate, the network efficiency, a goodput, a package delay, or a PLR of the multimedia traffic.

13. The apparatus of claim 12 , wherein the rate adjustment unit includes an encoding rate selection unit coupled to the interval rate adjustment unit to select the second encoding rate from the interval of encoding rates based at least in part on a set of parameters related to the transmitter bitrate, the network efficiency, a goodput, a package delay, or a PLR of the multimedia traffic.

14. The apparatus of claim 5 , wherein the rate adjustment unit includes a first rate adjustment unit and a second rate adjustment unit, wherein the first rate adjustment unit is to periodically, according to a first period, increase the first encoding rate by a multiple of a first rate adjustment value to obtain the second encoding rate, and the second rate adjustment unit is to periodically, according to a second period, increase the first encoding rate by a multiple of a second rate adjustment value to obtain the second encoding rate.

15. The apparatus of claim 1 , further comprising:
a network congestion parameter unit coupled to the rate adjustment unit to detect the one or more network congestion parameters for the first window of one or more frames or during the first time period.

16. The apparatus of claim 1 , further comprising:
a feedback unit coupled to the rate adjustment unit to provide the second encoding rate to the transmitter.

17. The apparatus of claim 1 , wherein the apparatus is a wireless communication device, a wired communication device, a personal computer (PC), a desktop computer, a mobile computer, a laptop computer, a notebook computer, an Ultrabook™ computer, a tablet computer, a server computer, a handheld computer, a handheld device, a personal digital assistant (PDA) device, a handheld PDA device, an on-board device, an off-board device, a hybrid device, a vehicular device, a non-vehicular device, a mobile or portable device, a consumer device, a non-mobile or non-portable device, a wireless communication station, a video device, an audio device, or an audio-video (AN) device.

18. An apparatus for multimedia communication, comprising:
a content scenario detection unit to detect a first bitrate scenario of a multimedia content for a multimedia traffic when a transmitter is to generate a first window of one or more frames of the first bitrate scenario during a first time period at a first encoding rate, the first bitrate scenario having a first plurality of windows, each window having one or more frames, wherein the multimedia content includes the first bitrate scenario represented by a first bitrate, and a second bitrate scenario to follow the first bitrate scenario, the second bitrate scenario having a

Assignees

• Intel Corp

Inventors

• Srikantam Sri Ranjan
• Mandapadi Ramasubramanian Prasanna Kumar
• Nguyen Khanh V
• Cline Linda S

Classifications

• H04L65/752

  adapting media to network capabilities · CPC title

• H04L65/80 Primary

  Responding to QoS · CPC title

• H04L65/613

  for the control of the source by the destination (control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637) · CPC title

• H04L65/70 Primary

  Media network packetisation · CPC title

• H04L65/65

  Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP] · CPC title