Power aware video decoding and streaming

Patent metadata

Field	Value
Publication number	US-11516485-B2
Application number	US-202117323139-A
Country	US
Kind code	B2
Filing date	May 18, 2021
Priority date	Jul 9, 2012
Publication date	Nov 29, 2022
Grant date	Nov 29, 2022

Abstract

Methods and systems are disclosed for a mobile device to decode video based on available power and/or energy. For example, the mobile device may receive a media description file (MDF) from for a video stream from a video server. The MDF may include complexity information associated with a plurality of video segments. The complexity information may be related to the amount of processing power to be utilized for decoding the segment at the mobile device. The mobile device may determine at least one power metric for the mobile device. The mobile device may determine a first complexity level to be requested for a first video segment based on the complexity information from the MDF and the power metric. The mobile device may dynamically alter the decoding process to save energy based on the detected power/energy level.

First claim

What is claimed:

1. A wireless transmit/receive unit (WTRU) for requesting a video stream from a video server, the WTRU comprising:
a memory; and
a processor configured to:
receive a metadata for the video stream, the video stream comprising a first video segment and a second video segment, and the metadata indicating a video decoding power consumption information for one or more complexity levels associated with the first video segment;
determine a power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information;
determine, based on the power reduction ratio, a complexity level from the one or more complexity levels; and
request the first video segment at the complexity level.

2. The WTRU of claim 1 , wherein the processor is further configured to determine the power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information by determining the power reduction ratio using the complexity level.

3. The WTRU of claim 1 , wherein the complexity level is a first complexity level, and wherein the processor is further configured to determine a second complexity level from one or more complexity levels associated with the second video segment.

4. The WTRU of claim 3 , wherein the processor is further configured to determine the power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information by determining the power reduction ratio using the first complexity level and the second complexity level.

5. The WTRU of claim 1 , wherein the video decoding power consumption information for the one or more complexity levels associated with the first video segment further indicates relative amounts of energy that would be used to decode the first video segment at each of the one or more complexity levels.

6. The WTRU of claim 1 , wherein the processor is further configured to:
determine an amount of energy remaining in the WTRU; and
determine, based on the amount of energy remaining in the WTRU, a power available for decoding the first video segment.

7. The WTRU of claim 6 , wherein the processor is further configured to:
determine the power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information by determining the power reduction ratio such that decoding the first video segment results in using approximately the amount of energy available for decoding the first video segment.

8. A method for a wireless transmit/receive unit (WTRU) for requesting a video stream from a video server, the method comprising:
receiving a metadata for the video stream, the video stream comprising a first video segment and a second video segment, and the metadata indicating a video decoding power consumption information for one or more complexity levels associated with the first video segment;
determining a power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information;
determining, based on the power reduction ratio, a complexity level from the one or more complexity levels; and
requesting the first video segment at the complexity level.

9. The method of claim 8 , wherein the method further comprises determining the power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information by determining the power reduction ratio using the complexity level.

10. The method of claim 8 , wherein the complexity level is a first complexity level, and wherein the method further comprises determining a second complexity level from one or more complexity levels associated with the second video segment.

11. The method of claim 10 , wherein the method further comprises determining the power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information by determining the power reduction ratio using the first complexity level and the second complexity level.

12. The method of claim 8 , wherein the video decoding power consumption information for the one or more complexity levels associated with the first video segment further indicates relative amounts of energy that would be used to decode the first video segment at each of the one or more complexity levels.

13. The method of claim 8 , wherein the method further comprises:
determining an amount of energy remaining in the WTRU; and
determining, based on the amount of energy remaining in the WTRU, a power available for decoding the first video segment.

14. The method of claim 13 , wherein method further comprises determining the power reduction ratio for the first video segment relative to the second video segment using the video decoding power consumption information by determining the power reduction ratio such that decoding the first video segment results in using approximately the amount of energy available for decoding the first video segment.

15. A video server, comprising:
a processor, and
a memory, wherein the video server is configured to:
send, to a video streaming device, metadata for a video stream, the video stream comprising a first video segment and a second video segment, and the metadata indicating a video decoding power consumption information for one or more complexity levels associated with the first video segment and the second video segment;
receive, from the video streaming device, a first request for the first video segment at a first complexity level;
receive, from the video streaming device, a second request for the second video segment at a second complexity level; and
send, to the video streaming device, the first video segment at the first complexity level and the second video segment at the second complexity level.

16. The video server of claim 15 , wherein the processor is further configured to:
receive power information associated with the video streaming device, wherein the power information associated with the video streaming device indicates one or more of a power level, a power usage, a battery level, or an amount of energy allocated for decoding at least a portion of the video stream; and
encode one or more of the first video segment or the second video segment into the video stream based on the power information.

17. The video server of claim 15 , wherein the video decoding power consumption information further indicates a relative amount of energy that would be used to decode the first video segment at the first complexity level.

18. The video server of claim 15 , wherein the processor is further configured to:
encode the first video segment at the first complexity level; and
encode the second video segment at the second complexity level.

19. The video server of claim 15 , wherein the processor is further configured to:
receive a message from the video streaming device, the message indicating an amount of energy the video streaming device used to decode the first video segment at the first complexity level.

20. The video server of claim 15 , wherein the processor is further configured to generate the metadata for the video stream.

Assignees

• Vid Scale Inc

Inventors

• He Yuwen
• Ye Yan
• He Yong
• Mcclellan George W
• Ryu Eun Seok

Classifications

• H04N21/4424

  Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used (error monitoring in general G06F11/30; arrangements for monitoring conditions of receiving stations in broadcast systems H04H60/32; diagnosis, testing or measuring for television receivers H04N17/04) · CPC title

• H04N21/41407 Primary

  embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57) · CPC title

• Y02D10/00

  Energy efficient computing, e.g. low power processors, power management or thermal management · CPC title

• G06F1/3212

  Monitoring battery levels, e.g. power saving mode being initiated when battery voltage goes below a certain level · CPC title

• H04L65/613

  for the control of the source by the destination (control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637) · CPC title