Adaptive control of display refresh rate based on video frame rate and power efficiency

Patent metadata

Field	Value
Publication number	US-9589540-B2
Application number	US-201113310812-A
Country	US
Kind code	B2
Filing date	Dec 5, 2011
Priority date	Dec 5, 2011
Publication date	Mar 7, 2017
Grant date	Mar 7, 2017

Abstract

A battery operated device, having a display with two or more available refresh rates, has its refresh rate selected so as to match the video frame rate of video data played back on the display. This selection is made by coordinating the resources in the device that are used to process the video from its reception through to its display.

First claim

What is claimed is:

1. A computer-implemented process, performed by a compositor of a desktop rendering engine in a computer, the compositor combining graphic data, from multiple windows provided by applications executed on the computer, with a background, to produce a graphical user interface for the computer on a display for the computer, the process comprising:
the compositor receiving, from a first application executed on the computer, a sequence of images at a first video frame rate;
the compositor receiving information identifying the first video frame rate for the sequence of images;
the compositor accessing, from a second application executed on the computer, graphic data at a second frame rate;
the compositor receiving information identifying the second video frame rate for the graphic data;
the compositor receiving information identifying available refresh rates for the display where the graphical user interface is to be displayed;
the compositor selecting a refresh rate for the display from among the available refresh rates based on at least the first video frame rate and the second video frame rate by:
in response to a determination that the first video frame rate and the second video frame rate are not equal, and that a least common multiple of the first video frame rate and the second video frame rate is an available refresh rate, selecting the least common multiple as the refresh rate;
in response to a determination that the least common multiple of the first video frame rate and the second video frame rate is not an available refresh rate, selecting a higher rate of the first video frame rate and the second video frame rate as a target rate;
in response to a determination that an integer multiple of the target rate is an available refresh rate, selecting the integer multiple of the target rate as the refresh rate; and
in response to a determination that an integer multiple of the target rate is not an available refresh rate, selecting a lowest available refresh rate higher than the target rate as the refresh rate;
the compositor generating, at the selected refresh rate, output display data for the graphical user interface by combining an image from the sequence of images from the first application and the graphic data from the second application with the background;
the compositor providing the output display data to the display at the selected refresh rate; and
the compositor setting the refresh rate of the display to the selected refresh rate.

2. The computer-implemented process of claim 1 , wherein determining the first video frame rate comprises reading metadata from data including a bitstream encoding the sequence of images, the metadata including data defining the first video frame rate.

3. The computer-implemented process of claim 2 , wherein determining the first video frame rate comprises receiving reliability data regarding the first video frame rate.

4. The computer-implemented process of claim 2 , wherein the metadata comprises presentation time stamps associated with each image in the sequence of images.

5. The computer-implemented process of claim 1 , wherein when the selected refresh rate is not an integer multiple of the first video frame rate, one or more images of the sequence of images is repeated of the sequence of images by the compositor in the output display data during playback.

6. The computer-implemented process of claim 1 , wherein the first video frame rate is variable, and determining the first video frame rate and selecting the refresh rate are repeated during playback of the sequence of images to adapt the refresh rate to the first video frame rate.

7. The computer-implemented process of claim 1 , wherein when the sequence of images from the first application includes one of graphics animation, display related to touch input, and a video game, the first video frame rate is used to select the refresh rate.

8. The computer-implemented process of claim 1 , further comprising: the compositor providing information about the selected frame rate to the first and second applications.

9. The computer-implemented process of claim 1 , wherein selecting the refresh rate comprises:
in response to a determination that the first video frame rate and the second video frame rate are equal, selecting one of the first video frame rate and the second video frame rate as a target rate;
in response to a determination that the target rate is an available refresh rate, selecting the target rate as the refresh rate.

10. The computer-implemented process of claim 1 , wherein the sequence of images from the first application includes display data corresponding to touch inputs to the first application, and wherein selecting the refresh rate comprises selecting an available refresh rate higher than the first video frame rate.

11. An article of manufacture comprising:
at least one of memory or nonvolatile storage;
computer program instructions of a compositor, of a desktop rendering engine of a computer, stored on the at least one of memory or nonvolatile storage, the compositor combining graphic data, from multiple windows provided by applications executed on a computer, with a background, to produce a graphical user interface for the computer on a display for the computer, wherein the compositor, when executed by the computer, instructs the computer to perform a process comprising:
the compositor receiving information identifying a first video frame rate for a sequence of images to be played back at the first video frame rate and received from a first application executed on the computer;
the compositor receiving information identifying a second video frame rate for graphic data received from a second application executed on the computer;
the compositor receiving information identifying available refresh rates for the display where the graphical user interface is to be displayed;
the compositor selecting a refresh rate of the display from among the available refresh rates according to at least the first video frame rate and the second video frame rate by:
in response to a determination that the first video frame rate and the second video frame rate are not equal, and that a least common multiple of the first video frame rate and the second video frame rate is an available refresh rate, selecting the least common multiple as the refresh rate;
in response to a determination that the least common multiple of the first video frame rate and the second video frame rate is not an available refresh rate, selecting a higher rate of the first video frame rate and the second video frame rate as a target rate;
in response to a determination that an integer multiple of the target rate is an available refresh rate, selecting the integer multiple of the target rate as the refresh rate; and
in response to a determination that an integer multiple of the target rate is not an available refresh rate, selecting a lowest available refresh rate higher than the target rate as the refresh rate;
the compositor generating output display data for the graphical user interface by combining the sequence of images from the first application and the graphic data from the second application with the background and providing the output display data to the display at a frame rate corresponding to the selected refresh rate; and
the compositor setting the refresh rate of the display to the selected refresh rate.

12. The article of manufacture of claim 11 , wherein the first video frame rate is variable, and determining the first video frame rate and selecting the refresh rate are repeated during playback of the sequence of images to adapt the refresh rate to the first vid

Assignees

• Wu Yongjun
• Sadhwani Shyam
• Thumpudi Naveen
• Estrop Stephen
• Evans Glenn
• Microsoft Technology Licensing Llc

Inventors

• Wu Yongjun
• Sadhwani Shyam
• Thumpudi Naveen
• Estrop Stephen
• Evans Glenn

Classifications

• G09G2330/021

  Power management, e.g. power saving · CPC title

• G09G2340/0435

  Change or adaptation of the frame rate of the video stream · CPC title

• G06F3/1407

  General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros · CPC title

• G09G2370/20

  Details of the management of multiple sources of image data · CPC title

• G09G2370/04

  Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller · CPC title