Measuring user interface performance consistency

Patent metadata

Field	Value
Publication number	US-10068508-B2
Application number	US-201314014427-A
Country	US
Kind code	B2
Filing date	Aug 30, 2013
Priority date	Aug 30, 2013
Publication date	Sep 4, 2018
Grant date	Sep 4, 2018

Abstract

Systems and techniques are provided for measuring consistency of animation and/or video rendering on a device, and providing a user with an indication of one or more consistency scores of the user's device. The consistency score indicates generally the consistency of user experience that is expected for the user device. In some cases, the consistency score is calculated based upon the differences in rendering times between adjacent frames in an animation, and/or the number of frames that have a render difference that differs from a standard or baseline value. A consistency score also may be based upon the framerate achievable by the device when rendering a video at a constant quality.

First claim

The invention claimed is:

1. A method for predicting how well a particular type of device will perform when executing an application, the method comprising:
obtaining, using a test system device, a plurality of time measurements indicating respective elapsed times between rendering of a plurality of corresponding adjacent frames, wherein the corresponding adjacent frames are rendered by a device of the particular type and are depicted by a display which is a part of the device;
determining, by the test system, a number of time measurements from the plurality of time measurements that are not within a threshold of a constant value;
determining, by the test system device and based on the number of time measurements, a consistency score for the particular type of device, the consistency score being indicative of a predicted performance level for the particular type of device while executing the application;
receiving, from a user device of the particular type, a request for the application; and
responsive to receiving the request for the application and prior to the application being installed at the user device, outputting, for display by the user device, an indication of the consistency score and an indication of the application.

2. The method of claim 1 , wherein obtaining the plurality of time measurements comprises:
recording, during the rendering of the plurality of corresponding adjacent frames by the device of the particular type, a plurality of corresponding timestamps; and
determining, based on the plurality of corresponding time stamps, the plurality of time measurements.

3. The method of claim 2 , further comprising;
causing the device of the particular type to execute a testing application, wherein the testing application causes the device of the particular type to render the plurality of corresponding adjacent frames.

4. The method of claim 3 , wherein the testing application further causes the device of the particular type to operate at a threshold workload while rendering the plurality of corresponding adjacent frames.

5. The method of claim 1 , wherein the plurality of corresponding adjacent frames is an animation.

6. The method of claim 5 , wherein the determining the consistency score further comprises determining the number of time measurements which deviate from the constant value.

7. The method of claim 1 , wherein the plurality of corresponding adjacent frames is a video.

8. The method of claim 7 , wherein determining the consistency score further comprises:
determining, based upon the plurality of time measurements, a framerate of the video rendered by the device of the particular type; and
determining the consistency score based on the framerate.

9. The method of claim 1 , further comprising:
measuring a framerate of video playback, by the device of the particular type, of a video; and
determining, based upon the framerate, a video consistency score.

10. The method of claim 9 , further comprising:
responsive to receiving the request for the application, determining that the application is configured to play the video; and
responsive to determining that the application is configured to play the video, providing the video consistency score to the user.

11. The method of claim 5 , further comprising:
responsive to receiving the request for the application, determining that the application is configured to generate the animation; and
responsive to determining that the application is configured to play the animation, providing the consistency score to the user.

12. The method of claim 9 , wherein the consistency score is further based upon the video consistency score.

13. An apparatus, comprising:
a test system device configured to:
obtain a plurality of time measurements indicating respective elapsed times between rendering of a plurality of corresponding adjacent frames, wherein the corresponding adjacent frames are rendered by a device of the particular type and are depicted by a display which is a part of the device;
determine a number of time measurements from the plurality of time measurements that are not within a threshold of a constant value;
determine, based on the number of time measurements, a consistency score for the particular type of device, the consistency score being indicative of a predicted performance level for the particular type of device while executing a particular application;
receive, from a user device of the particular type, a request for the particular application; and
responsive to receiving the request for the application and prior to the particular application being installed at the user device, output, for display by the user device, an indication of the consistency score and an indication of the particular application.

14. A non-transitory computer-readable medium, comprising:
processor-executable instructions stored thereon and configured to cause a processor to become a special-purpose device configured to:
obtain, using a test system device, a plurality of time measurements indicating respective elapsed times between rendering of a plurality of corresponding adjacent frames, wherein the corresponding adjacent frames are rendered by a device of the particular type and are depicted by a display which is a part of the device;
determine a number of time measurements from the plurality of time measurements that are not within a threshold of a constant value;
determine, based on the number of time measurements, a consistency score for the particular type of device, the consistency score being indicative of a predicted performance level for the particular type of device while executing a particular application;
receive, from a user device of the particular type, a request for the particular application; and
responsive to receiving the request for the application and prior to the particular application being installed at the user device, output, for display by the user device, an indication of the consistency score and an indication of the particular application.

15. The method of claim 1 , further comprising:
responsive to receiving the request for the application, determining, based on the consistency score, whether to include the application as an option for installation at the user device, wherein the application is included if the consistency score satisfies a threshold and is not included if the consistency score does not satisfy the threshold, and wherein the application is not included if the consistency score does not satisfy the threshold,
wherein outputting the indication of the consistency score and the indication of the application is in response to determining that the consistency score satisfies the threshold.

16. The method of claim 1 , wherein the consistency score and the number of time measurements that are not within the threshold of the constant value are inversely related.

17. The apparatus of claim 13 , wherein the test system device is further configured to obtain the plurality of time measurements by at least being configured to:
cause the device of the particular type to execute a testing application, wherein the testing application causes the device of the particular type to render the plurality of corresponding adjacent frames and to operate at a threshold workload while rendering the plurality of corresponding adjacent frames;
record, during the rendering of the plurality of corresponding adjacent frames by the device of the particular type, a plurality of corresponding timestamps; and
determine, based on the plurality of corresponding time stamps, the plur

Assignees

• Google Inc
• Google Llc

Inventors

• Nagarajan Guru
• Scott Stuart Murray

Classifications

• G06F11/3419

  by assessing time · CPC title

• G06F2201/81

  Threshold · CPC title

• G06F2201/835

  Timestamp · CPC title

• G06F11/34

  Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation {; Recording or statistical evaluation of user activity, e.g. usability assessment} · CPC title

• G09G2330/12

  Test circuits or failure detection circuits included in a display system, as permanent part thereof · CPC title