Video adaptation for content-aware wireless streaming

Patent metadata

Field	Value
Publication number	US-9819717-B2
Application number	US-201113977039-A
Country	US
Kind code	B2
Filing date	Dec 28, 2011
Priority date	Dec 28, 2011
Publication date	Nov 14, 2017
Grant date	Nov 14, 2017

Abstract

Described herein are techniques related to wirelessly streaming content to a remote display device. Parameters are selected for the streaming based on content information received via an application programming interface (API) associated with a media player. This Abstract is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims.

First claim

What is claimed is:

1. A method of wirelessly streaming multimedia content from a wireless transmission device to a remote display device, the method comprising:
receiving a content information from a media player of the wireless transmission device via an application programming interface (API) associated with the media player, wherein the content information corresponds to the multimedia content played by the media player;
receiving a link quality information of a link between the wireless transmission device and the remote display device from an output component of the wireless transmission device through a feedback element using another API;
selecting a video encoder bitrate based on the received content information and the link quality information;
encoding the multimedia content based on the selected video encoder bitrate;
outputting the encoded content through the output component for wirelessly streaming the encoded multimedia content to the remote display device.

2. The method of claim 1 , wherein the content information comprises at least one of: a minimum bitrate, a maximum bitrate, a current bitrate, a resolution, a frame rate, a content type, and a codec information.

3. The method of claim 1 , wherein the another API is associated with a physical radio layer of the wireless transmission device.

4. The method of claim 1 , wherein the another API is associated with a transport layer of a transmission control protocol (TCP) of the wireless transmission device.

5. The method of claim 1 , further comprising receiving one or more signals from the remote display device and selecting the video encoder bitrate based at least in part on the one or more signals received.

6. The method of claim 1 , wherein the video encoder bitrate is increased by a preselected increment for a latency that is lesser than or equal to a preselected latency threshold.

7. The method of claim 1 , further comprising requesting a lower resolution version of the multimedia content when a number of packets in a queue at the wireless transmission device exceeds a preselected queue size threshold or a latency value exceeds a preselected latency threshold.

8. The method of claim 1 , further comprising:
increasing a quality of service (QoS) priority and associated enhanced distributed channel access (EDCA) parameters when a content bitrate is greater than a scaled wireless link throughput; and
decreasing the quality of service (QoS) priority and the associated enhanced distributed channel access (EDCA) parameters when the content bitrate is less than the scaled wireless link throughput, modified by a QoS bandwidth ratio.

9. The method of claim 1 , wherein the content information is received through a feed-forward component of the media player.

10. At least one non-transitory computer accessible medium comprising computer executable instructions that, when executed by a wireless transmission device, direct the wireless transmission device to perform operations including:
receiving a content information from a media player of the wireless transmission device via an application programming interface (API) associated with the media player, wherein the content information corresponds to a multimedia content played by the media player;
receiving a link quality information of a link between the wireless transmission device and a remote display device from another API through a feedback element of the wireless transmission device;
selecting a video encoder bitrate based on the received content information and the link quality information;
encoding the multimedia content based on the selected video encoder bit rate; and
outputting the encoded multimedia content to an output component of the wireless transmission device to wirelessly stream the encoded content to the remote display device.

11. The at least one non-transitory computer accessible medium of claim 10 , wherein the content information comprises at least one of: a minimum bitrate, a maximum bitrate, a current bitrate, a resolution, a frame rate, a content type, and a codec information.

12. The at least one non-transitory computer accessible medium of claim 10 , wherein the computer executable instructions direct the computer to perform further operations comprising: decreasing the video encoder bitrate when the video encoder bitrate is greater than at least one of a content bitrate and a wireless link throughput.

13. The at least one non-transitory computer accessible medium of claim 10 , wherein the computer executable instructions direct the computer to perform further operations comprising:
increase a quality of service (QoS) priority and associated enhanced distributed channel access (EDCA) parameters when a content bitrate is greater than a scaled wireless link throughput; and
decrease the quality of service (QoS) priority and the associated enhanced distributed channel access (EDCA) parameters when the content bitrate is less than the scaled wireless link throughput, modified by a QoS bandwidth ratio.

14. The at least one non-transitory computer accessible medium of claim 10 , wherein the computer executable instructions direct the computer to perform further operations comprising: decrease the video encoder bitrate by a preselected increment when a latency of the wireless stream exceeds a preselected latency threshold or a number of packets in a queue at the wireless transmission device exceeds a preselected queue size threshold.

15. The at least one non-transitory computer accessible medium of claim 10 , wherein the computer executable instructions direct the computer to perform further operations comprising:
increase the video encoder bitrate by a preselected increment when a latency of the wireless stream is less than or equal to a preselected latency threshold or a number of packets in a queue at the wireless transmission device is less than or equal to a preselected queue size threshold, and the incremented video encoder bitrate is less than a content bitrate and a wireless link throughput, scaled to account for communication overhead.

16. A wireless transmission device, comprising:
a processor;
memory coupled to the processor;
a media component stored in the memory and operable on the processor to play a received multimedia content;
an adaptive streaming component stored in the memory and operable on the processor to:
receive a content information corresponding to the multimedia content from the media component via an application programming interface (API);
receive a link quality information of a link between the wireless transmission device and a remote display device from another API through a feedback element of an output component operable on the wireless transmission device;
select a video encoder bitrate based on the received content information and the link quality information;
encode the multimedia content based on the selected video encoder bitrate; and
output the encoded content to the output component; and

an output component stored in the memory and operable on the processor to output the encoded content; and
a transmission component configured to wirelessly stream the encoded multimedia content to the remote display device.

17. The wireless transmission device of claim 16 , wherein the feedback element is coupled to the output component.

18. The wireless transmission device of claim 16 , wherein the content information comprises at least one of: a minimum bitrate, a maximum bitrate, a current bitrate, a resolution, a frame rate, a content type, and a codec information.

Assignees

• Oyman Ozgur
• Lin Xintian E
• Intel Corp

Inventors

• Oyman Ozgur
• Lin Xintian E

Classifications

• H04N19/10

  using adaptive coding · CPC title

• H04N19/152

  by measuring the fullness of the transmission buffer · CPC title

• H04N21/44227

  Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network (configuring of peripheral devices in general G06F9/4411; monitoring connectivity in data switched networks H04L43/0811) · CPC title

• H04N21/4402

  involving reformatting operations of video signals for household redistribution, storage or real-time display {(details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764)} · CPC title

• H04L65/80

  Responding to QoS · CPC title