Controlling display performance using display statistics and feedback

Patent metadata

Field	Value
Publication number	US-2020410738-A1
Application number	US-202016946788-A
Country	US
Kind code	A1
Filing date	Jul 7, 2020
Priority date	Jun 3, 2016
Publication date	Dec 31, 2020
Grant date	—

Abstract

One embodiment provides for a display system to generate and display data on a display device, the display system comprising one or more graphics processors to generate one or more frames of data for display on the display device; a window manager to submit a request to display the one or more frames of data; a display engine to present the one or more frames of data to the display device for display; and display logic to receive the request to display the one or more frames of data and generate one or more display events for the display engine based on the request to display the one or more frames of data, wherein the display logic is to manage a set of statistics associated with the request.

First claim

What is claimed is:

1 . A method of generating and displaying data on a display device, the method comprising:
receiving an input to interact with an image presented via the display; generating a sequence of frames in response to the input, the sequence of frames having an animation frame rate independent of a current refresh rate of the display device, the animation frame rate determined based on a parameter associated with the input; configuring display events associated with the sequence of frames, the display events including configuration data to configure a display engine to display one or more frames in the sequence of frames, each frame in the sequence of frames having a requested presentation time based on the animation frame rate; processing a first display event associated with a first frame in the sequence of frames, wherein processing the first display event includes reading the configuration data to configure the display engine to display the first frame; presenting the configuration data to the display engine at a display time based on the requested presentation time; and dynamically refreshing the display device based on the display time to display the sequence of frames.

2 . The method as in claim 1 , additionally comprising successively refreshing the display device at the animation frame rate of the sequence of frames.

3 . The method as in claim 1 , wherein the animation frame rate is a first animation frame rate and the method additionally comprises:
displaying the sequence of frames at the first animation frame rate for a period; adjusting the animation frame rate to a second animation frame rate after the period; and dynamically refreshing the display device at the second animation frame rate.

4 . The method as in claim 1 , wherein the input is received from a touch input device and the parameter associated with the input is a velocity or pressure associated with the input.

5 . The method as in claim 1 , wherein configuring display events associated with the sequence of frames includes storing the display events into a data structure in memory.

6 . The method as in claim 1 , additionally comprising:
periodically reviewing the display events at a first rate to determine whether to process a display event, wherein each review cycle of the display events defines a display quantum; processing a display event when the display event is to occur during a current display quantum; and dynamically refreshing the display device at a second rate to display a frame associated with the display event, the first rate different from the second rate.

7 . The method as in claim 6 , additionally comprising:
displaying the first frame for a first number of display quanta; displaying a second frame for a second number of display quanta; and not refreshing the display between the first frame and the second frame.

8 . A method of determining a refresh rate for a display device, the method comprising:
receiving a first request to display a first sequence of images associated with a first application, the first sequence of images having a first animation frame rate; receiving a second request to display a second sequence of images associated with a second application, the second sequence of images having a second animation frame rate; determining a common refresh interval of the first animation frame rate and the second animation frame rate; and refreshing the display device at a refresh rate based on the common refresh interval.

9 . The method as in claim 8 , additionally comprising coalescing the first animation frame rate and the second animation frame rate into a coalesced animation frame rate, and deriving the refresh rate for the display device based on the coalesced animation frame rate.

10 . The method as in claim 9 , wherein the coalesced animation frame rate is equal to the first animation frame rate and a multiple of the second animation frame rate.

11 . The method as in claim 8 , wherein the common refresh interval is based on one or more presentation quanta and a minimum refresh interval is a multiple of a presentation quantum.

12 . A non-transitory machine readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:
receiving an input to interact with an image presented via a display device; generating a sequence of frames in response to the input, the sequence of frames having an animation frame rate independent of a current refresh rate of the display device, the animation frame rate determined based on a parameter associated with the input; configuring display events associated with the sequence of frames, the display events including configuration data to configure a display engine to display one or more frames in the sequence of frames, each frame in the sequence of frames having a requested presentation time based on the animation frame rate; processing a first display event associated with a first frame in the sequence of frames, the processing including reading the configuration data to configure the display engine to display the first frame; presenting the configuration data to the display engine at a display time based on the requested presentation time; and dynamically refreshing the display device based on the display time to display the sequence of frames.

13 . The non-transitory machine readable medium as in claim 12 , the operations additionally comprising successively refreshing the display device at the animation frame rate of the sequence of frames.

14 . The non-transitory machine readable medium as in claim 12 , wherein the animation frame rate is a first animation frame rate and the operations additionally comprise:
displaying the sequence of frames at the first animation frame rate for a period; adjusting the animation frame rate to a second animation frame rate after the period; and dynamically refreshing the display device at the second animation frame rate.

15 . The non-transitory machine readable medium as in claim 12 , wherein the input is received from a touch input device and the parameter associated with the input is a velocity or pressure associated with the input.

16 . The non-transitory machine readable medium as in claim 12 , the operations additionally comprising:
periodically reviewing the display events at a first rate to determine whether to process a display event, wherein each review cycle of the display events defines a display quantum; processing a display event when the display event is to occur during a current display quantum; and dynamically refreshing the display device at a second rate to display a frame associated with the display event, the first rate different from the second rate.

17 . The non-transitory machine readable medium as in claim 16 , the operations additionally comprising:
displaying the first frame for a first number of display quanta; displaying a second frame for a second number of display quanta; and not refreshing the display between the first frame and the second frame.

18 . A display system comprising:
a display device to display a first frame including a first image; an input device to receive a sequence of inputs to interact with the first image displayed within the first frame; one or more graphics processors to generate a second image for display within a second frame and a third image for display within a third frame, the first frame having a first requested presentation time and the third frame havi

Assignees

• Apple Inc

Inventors

• Spence Arthur L
• Sandmel Jeremy T
• Chan David M
• Zhang Chendi
• Tsoi Peter C

Classifications

• G09G2320/0252

  Improving the response speed · CPC title

• G09G2330/021

  Power management, e.g. power saving · CPC title

• G09G2310/08

  Details of timing specific for flat panels, other than clock recovery · CPC title

• G09G5/18

  Timing circuits for raster scan displays (specially adapted for television H04N {; synchronisation between the display unit and other display units, videodisc player G09G5/12}) · CPC title

• G09G2340/0435

  Change or adaptation of the frame rate of the video stream · CPC title