Real-time GPU rendering with performance guaranteed power management

Patent metadata

Field	Value
Publication number	US-11100698-B2
Application number	US-201916457179-A
Country	US
Kind code	B2
Filing date	Jun 28, 2019
Priority date	Jun 28, 2019
Publication date	Aug 24, 2021
Grant date	Aug 24, 2021

Abstract

Systems, apparatuses, and methods for performing real-time video rendering with performance guaranteed power management are disclosed. A system includes at least a software driver, a power management unit, and a plurality of processing elements for performing rendering tasks. The system receives inputs which correspond to rendering tasks which need to be performed. The software driver monitors the inputs that are received and the number of rendering tasks to which they correspond. The software driver also monitors the amount of time remaining until the next video synchronization signal. The software driver determines which performance setting will minimize power consumption while still allowing enough time to finish the rendering tasks for the current frame before the next video synchronization signal. Then, the software driver causes the power management unit to provide this performance setting to the plurality of processing elements as they perform the rendering tasks for the current frame.

First claim

What is claimed is:

1. A system comprising:
one or more processing elements;
a power management unit; and
a control unit configured to:
monitor inputs representative of how many rendering tasks are waiting to be performed for a current frame being rendered;
monitor an amount of time remaining until a next video synchronization signal;
select a given performance setting for allowing one or more rendering tasks to be completed in the amount of time remaining until the next video synchronization signal while also achieving a power consumption target; and
convey an indication of the given performance setting to the power management unit to cause the one or more processing elements to operate at the given performance setting.

2. The system as recited in claim 1 , wherein the control unit is configured to increase the given performance setting responsive to determining the inputs indicate that more rendering tasks have been queued while the amount of time remaining until the next video synchronization signal has decreased.

3. The system as recited in claim 1 , wherein the control unit is configured to select a lowest possible performance setting which allows the one or more rendering tasks to be completed in the amount of time remaining until the next video synchronization signal.

4. The system as recited in claim 1 , wherein the control unit is configured to map a combination of a number of rendering tasks and the amount of time remaining to the given performance setting.

5. The system as recited in claim 4 , wherein the control unit is configured to maintain a table for mapping the combination of the number of rendering tasks and the amount of time remaining to the given performance setting, wherein each entry in the table maps a given number of rendering tasks and a given amount of time remaining to a corresponding performance setting.

6. The system as recited in claim 1 , wherein the inputs comprise user movements in a virtual reality environment.

7. The system as recited in claim 1 , wherein the control unit is further configured to:
cause the one or more processing elements to operate at a relatively high performance setting responsive to determining that the number of rendering tasks is greater than a threshold, wherein the threshold is based on the amount of time remaining until the next video synchronization signal; and
cause the one or more processing elements to operate at a relatively low performance setting responsive to determining that the number of rendering tasks is less than or equal to the threshold.

8. A method comprising:
monitoring, by a control unit, inputs representative of how many rendering tasks are waiting to be performed for a current frame being rendered;
monitoring an amount of time remaining until a next video synchronization signal;
selecting a given performance setting for allowing one or more rendering tasks to be completed in the amount of time remaining until the next video synchronization signal while also achieving a power consumption target; and
conveying an indication of the given performance setting to a power management unit to cause one or more processing elements to operate at the given performance setting.

9. The method as recited in claim 8 , further comprising increasing the given performance setting responsive to determining the inputs indicate that more rendering tasks have been queued while the amount of time remaining until the next video synchronization signal has decreased.

10. The method as recited in claim 8 , further comprising selecting a lowest possible performance setting which allows the one or more rendering tasks to be completed in the amount of time remaining until the next video synchronization signal.

11. The method as recited in claim 8 , further comprising mapping a combination of a number of rendering tasks and the amount of time remaining to the given performance setting.

12. The method as recited in claim 11 , further comprising maintaining a table for mapping the combination of the number of rendering tasks and the amount of time remaining to the given performance setting, wherein each entry in the table maps a given number of rendering tasks and a given amount of time remaining to a corresponding performance setting.

13. The method as recited in claim 8 , wherein the inputs comprise user movements in a virtual reality environment.

14. The method as recited in claim 8 , further comprising:
causing the one or more processing elements to operate at a relatively high performance setting responsive to determining that the number of rendering tasks is greater than a threshold, wherein the threshold is based on the amount of time remaining until the next video synchronization signal; and
causing the one or more processing elements to operate at a relatively low performance setting responsive to determining that the number of rendering tasks is less than or equal to the threshold.

15. An apparatus comprising:
a first processor;
a second processor; and
a memory storing program instructions, wherein the program instructions are executable by the first processor to:
monitor inputs representative of how many rendering tasks are waiting to be performed for a current frame being rendered;
monitor an amount of time remaining until a next video synchronization signal;
select a given performance setting for allowing one or more rendering tasks to be completed in the amount of time remaining until the next video synchronization signal while also achieving a power consumption target; and
cause the second processor to operate at the given performance setting.

16. The apparatus as recited in claim 15 , wherein the program instructions are executable by the first processor to increase the given performance setting responsive to determining the inputs indicate that more rendering tasks have been queued while the amount of time remaining until the next video synchronization signal has decreased.

17. The apparatus as recited in claim 15 , wherein the program instructions are executable by the first processor to select a lowest possible performance setting which allows the one or more rendering tasks to be completed in the amount of time remaining until the next video synchronization signal.

18. The apparatus as recited in claim 15 , wherein the program instructions are executable by the first processor to map a combination of a number of rendering tasks and the amount of time remaining to the given performance setting.

19. The apparatus as recited in claim 18 , wherein the program instructions are executable by the first processor to maintain a table for mapping the combination of the number of rendering tasks and the amount of time remaining to the given performance setting, wherein each entry in the table maps a given number of rendering tasks and a given amount of time remaining to a corresponding performance setting.

20. The apparatus as recited in claim 15 , wherein the program instructions are executable by the first processor to:
cause the second processor to operate at a relatively high performance setting responsive to determining that the number of rendering tasks is greater than a threshold, wherein the threshold is based on the amount of time remaining until the next video synchronization signal;
cause the second processor to operate at a relatively low performance setting responsive to determining that the number of rendering tasks is less than or equal to the threshold.

Assignees

• Ati Technologies Ulc

Inventors

• Chan Benjamin Koon Pan
• Atkinson William Lloyd
• Ip Clarence
• Kwong Tung Chuen

Classifications

• G09G2360/08

  Power processing, i.e. workload management for processors involved in display operations, such as CPUs or GPUs · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title

• G09G2330/021

  Power management, e.g. power saving · CPC title

• G09G2310/08

  Details of timing specific for flat panels, other than clock recovery · CPC title

• G09G5/363 Primary

  Graphics controllers · CPC title