Power aware video decoding and streaming

Patent metadata

Field	Value
Publication number	US-10536707-B2
Application number	US-201816196227-A
Country	US
Kind code	B2
Filing date	Nov 20, 2018
Priority date	Jul 9, 2012
Publication date	Jan 14, 2020
Grant date	Jan 14, 2020

Abstract

Methods and systems are disclosed for a mobile device to decode video based on available power and/or energy. For example, the mobile device may receive a media description file (MDF) from for a video stream from a video server. The MDF may include complexity information associated with a plurality of video segments. The complexity information may be related to the amount of processing power to be utilized for decoding the segment at the mobile device. The mobile device may determine at least one power metric for the mobile device. The mobile device may determine a first complexity level to be requested for a first video segment based on the complexity information from the MDF and the power metric. The mobile device may dynamically alter the decoding process to save energy based on the detected power/energy level.

First claim

What is claimed:

1. A method for a wireless transmit/receive unit (WTRU) to request a video stream from a video server, the method comprising:
receiving metadata for the video stream, wherein the video stream is divided into a plurality of video segments, the metadata indicating relative video decoding power consumption information for a plurality of complexity levels at which a first video segment can be requested;
determining an amount of energy remaining in the WTRU;
determining power allocation information for the first video segment based on the amount of energy remaining in the WTRU and the relative video decoding power consumption information indicated in the metadata;
determining to request the first video segment at a first complexity level of the plurality of complexity levels based on the power allocation information and the relative video decoding power consumption information indicated in the metadata; and
requesting the first video segment at the first complexity level.

2. The method as in claim 1 , wherein the video decoding power consumption information is provided per video segment in the metadata.

3. The method as in claim 1 , wherein the power allocation information comprises a power reduction ratio for the first video segment relative to a previous video segment.

4. The method as in claim 1 , wherein a previous video segment was received by the WTRU at a second complexity level of the plurality of complexity levels, and wherein the power allocation information is determined based on a power consumption associated with at least one of decoding or displaying the previous video segment at the second complexity level.

5. The method as in claim 1 , wherein the relative video decoding power consumption information for the plurality of complexity levels at which the first video segment can be requested indicates relative amounts of energy that would be used to decode the first video segment at each of the plurality of complexity levels.

6. The method as in claim 1 , further comprising estimating, based on the amount of energy remaining in the WTRU, a power available for decoding the first video segment, wherein determining to request the first video segment at the first complexity level of the plurality of complexity levels is further based on the estimated power available for decoding the first video segment.

7. The method as in claim 1 , wherein determining to request the first video segment at the first complexity level comprises determining the first complexity level such that decoding the first video segment results in using approximately an amount of energy to be allocated to the first video segment.

8. The method as in claim 1 , wherein determining to request the first video segment at the first complexity level comprises selecting the first complexity level based on a power expended while decoding a previous video segment, a complexity level at which the previous segment was requested, and a power allocated for decoding the first video segment.

9. The method as in claim 1 , further comprising determining whether a region of the first video segment comprises high frequency components that exceed a high frequency threshold, and applying a first interpolation filter during motion compensation for the region on a condition that the high frequency components exceed the high frequency threshold or applying a second interpolation filter for motion compensation for the region on a condition that the high frequency components do not exceed the high frequency threshold, wherein the second interpolation filter is associated with a lower cutoff frequency than the first interpolation filter.

10. The method as in claim 1 , further comprising calculating an amount of power consumed by the WTRU to decode a previous video segment.

11. A wireless transmit/receive unit (WTRU) for requesting a video stream from a video server based on power conditions, the WTRU comprising:
a memory; and
a processor configured to:
receive metadata for the video stream, wherein the video stream is divided into a plurality of video segments, the metadata indicating relative video decoding power consumption information for a plurality of complexity levels at which a first video segment can be requested;
determine an amount of energy remaining in the WTRU;
determine power allocation information for the first video segment based on the amount of energy remaining in the WTRU and the relative video decoding power consumption information indicated in the metadata;
determine to request the first video segment at a first complexity level of the plurality of complexity levels based on the power allocation information and the relative video decoding power consumption information indicated in the metadata; and
request the first video segment at the first complexity level.

12. The WTRU as in claim 11 , wherein the video decoding power consumption information is provided per video segment in the metadata.

13. The WTRU as in claim 11 , wherein the power allocation information comprises a power reduction ratio for the first video segment relative to a previous video segment.

14. The WTRU as in claim 11 , wherein a previous video segment was received by the WTRU at a second complexity level of the plurality of complexity levels, and wherein the power allocation information is determined based on a power consumption associated with at least one of decoding or displaying the previous video segment at the second complexity level.

15. The WTRU as in claim 11 , wherein the relative video decoding power consumption information for the plurality of complexity levels at which the first video segment can be requested indicates relative amounts of energy that would be used to decode the first video segment at each of the plurality of complexity levels.

16. The WTRU as in claim 11 , wherein the processor is further comfigured to estimate, based on the amount of energy remaining in the WTRU, a power available for decoding the first video segment, wherein the processor being configured to determine to request the first video segment at the first complexity level of the plurality of complexity levels is further based on the estimated power available for decoding the first video segment.

17. The WTRU as in claim 11 , wherein the processor being configured to determine to request the first video segment at the first complexity level comprises the processor configured to determine the first complexity level such that decoding the first video segment results in using approximately an amount of energy to be allocated to the first video segment.

18. The WTRU as in claim 11 , wherein the processor being configured to determine to request the first video segment at the first complexity level comprises the processor being configured to select the first complexity level based on a power expended while decoding a previous video segment, a complexity level at which the previous segment was requested, and a power allocated for decoding the first video segment.

19. The WTRU as in claim 11 , wherein the processor is further configured to:
determine whether a region of the first video segment comprises high frequency components that exceed a high frequency threshold; and apply a first interpolation filter during motion compensation for the region on condition that the high frequency components exceed the high frequency threshold; or apply a second interpolation filter for motion compensation for the region on condition that the high frequency components do not exceed the high frequency threshold, wher

Assignees

• Vid Scale Inc

Inventors

• He Yuwen
• Ye Yan
• He Yong
• Mcclellan George W
• Ryu Eun Seok

Classifications

• H04N21/8456

  by decomposing the content in the time domain, e.g. in time segments · CPC title

• H04N21/23439

  for generating different versions · CPC title

• G06F1/3212

  Monitoring battery levels, e.g. power saving mode being initiated when battery voltage goes below a certain level · CPC title

• H04N21/41407 Primary

  embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57) · CPC title

• G06F1/329

  by task scheduling · CPC title