Measurement of remote display responsiveness to application display changes

Patent metadata

Field	Value
Publication number	US-9674263-B2
Application number	US-201314137560-A
Country	US
Kind code	B2
Filing date	Dec 20, 2013
Priority date	Jul 14, 2011
Publication date	Jun 6, 2017
Grant date	Jun 6, 2017

Abstract

One method for managing remote display performance includes operations for embedding pixel data in a file of an application executing on a server, and detecting an open window of a graphical user interface (GUI) associated with the application. The pixel data is used to create a pixel strip in the window, while the GUI is being displayed on a remote display of a remote client. Update information for the GUI being displayed on the remote display is transmitted from the server to the remote client, the update information corresponding to the change in the presentation of the open window on the server. Further, a change in a presentation of the open window is detected, and a pixel strip received at the remote display is identified. A performance metric for the remote display is calculated based on the received pixel strip when compared to the expected values for the pixel strip.

First claim

What is claimed is:

1. A method comprising:
embedding pixel data in a file associated with an application executing on a server, wherein the pixel data is embedded in the file using data native to the application such that the file with the embedded pixel data can be opened by the application;
detecting an open window of a graphical user interface (GUI) caused by the application opening the file, wherein the pixel data embedded in the file is used to create a pixel strip in a fraction of the open window, wherein a color of one or more pixels in the pixel strip is dependent on a page of the file and an offset within the page, the GUI being displayed on a remote display executing on a remote client;
detecting a change in a presentation of the open window;
transmitting, from the server to the remote client, update information for the GUI being displayed on the remote display, the update information corresponding to the change in the presentation of the open window on the server;
identifying the pixel strip received at the remote display resulting from the change in the presentation; and
calculating a performance metric of the remote display based on the received pixel strip, wherein operations of the method are executed by a processor, wherein calculating the performance metric further includes:
identifying an expected value of one or more pixels associated with the received pixel strip; and
comparing a received value of the one or more pixels in the received pixel strip to the expected value.

2. The method as recited in claim 1 , wherein the file is a spreadsheet, wherein the color gradient is based on a row within the spreadsheet.

3. The method as recited in claim 1 , further including:
sending, from the server to the client, timing information about the change in the presentation of the open window.

4. The method as recited in claim 3 , wherein calculating the performance metric further includes:
measuring response time to the change in the presentation on the remote display based on the timing information and the received pixel strip.

5. The method as recited in claim 1 , wherein the remote display is one of a remote display for a virtual machine or a remote display being displayed on a frame of a local display coupled to a computing device.

6. The method as recited in claim 1 , wherein the change in the presentation of the open window is caused by a scroll window operation or a resize window operation.

7. The method as recited in claim 1 , wherein the color of the one or more pixels is computed based on the following formula:
color( p i )=color_ fx ( pn,po );
wherein p i is a pixel, color_ƒx is a function, pn is a page number, and po is the offset within page pn.

8. A method comprising:
displaying a remote display on a remote client, the remote display including representation of a graphical user interface (GUI) executing on a server, the GUI being operable to display an open window for an application executing on the server;
receiving data regarding a change in a presentation of the open window caused by the application opening a file, wherein pixel data is embedded in the file associated with the application using data native to the application, wherein the pixel data embedded in the file is used to create a pixel strip in a fraction of the open window, wherein a color of one or more pixels in the pixel strip is dependent on a page of the file and an offset within the page;
identifying the pixel strip received at the remote display resulting from the change in the presentation; and
calculating a performance metric for the remote display based on the received pixel strip, wherein operations of the method are executed by a processor, wherein calculating the performance metric further includes:
identifying an expected value of one or more pixels associated with the received pixel strip; and
comparing a received value of the one or more pixels in the received pixel strip to the expected value.

9. The method as recited in claim 8 , wherein the pixel data is a background image within a document.

10. The method as recited in claim 8 , wherein the pixel data is one or more images inserted in one or more cells of a spreadsheet.

11. The method as recited in claim 8 , wherein the pixel strip is one or more of a horizontal band or a vertical band.

12. The method as recited in claim 8 , wherein operations of the method are performed by a computer program when executed by one or more processors, the computer program being embedded in a non-transitory computer-readable storage medium.

13. The method as recited in claim 8 , wherein the color of the one or more pixels is computed based on the following formula:
color( p i )=color_ fx ( pn,po );
wherein p i is a pixel, color_ƒx is a function, pn is a page number, and po is the offset within page pn.

14. A non-transitory computer-readable storage medium storing a computer program, the computer-readable storage medium comprising:
program instructions for embedding pixel data in a file associated with an application executing on a server, wherein the pixel data is embedded in the file using data native to the application such that the file with the embedded pixel data can be opened by the application;
program instructions for detecting an open window of a graphical user interface (GUI) caused by the application opening the file, wherein the pixel data embedded in the file is used to create a pixel strip in a fraction of the open window, wherein a color of one or more pixels in the pixel strip is dependent on a page of the file and an offset within the page, the GUI being displayed on a remote display executing on a remote client;
program instructions for detecting a change in a presentation of the open window;
program instructions for transmitting, from the server to the client, update information corresponding to the change in the presentation of the open window, the update information including at least a portion of the pixel strip;
wherein, in response to receiving the update information, the client is configured to:
identify the pixel strip received at the remote display resulting from the change in the presentation; and
calculate a performance metric for the remote display based on the received pixel strip, wherein calculating the performance metric further includes:
identifying an expected value of one or more pixels associated with the received pixel strip; and
comparing a received value of the one or more pixels in the received pixel strip to the expected value.

15. The computer-readable storage medium as recited in claim 14 , wherein the file is a spreadsheet, wherein the color gradient is based on a row within the spreadsheet.

16. The computer-readable storage medium as recited in claim 14 , further including:
program instructions for sending timing information about the change in the presentation of the open window.

17. The non-transitory computer-readable storage medium as recited in claim 14 , wherein the color of the one or more pixels is computed based on the following formula:
color( p i )=color_ fx ( pn,po );
wherein p i is a pixel, color_ƒx is a function, pn is a page number, and po is the offset within page pn.

Assignees

• Vmware Inc

Inventors

• Spracklen Lawrence
• Agrawal Banit
• Bidarkar Rishi

Classifications

• G09G2360/08

  Power processing, i.e. workload management for processors involved in display operations, such as CPUs or GPUs · CPC title

• G09G2340/04

  Changes in size, position or resolution of an image · CPC title

• G06F40/18

  of spreadsheets (form-filling G06F40/174) · CPC title

• G09G5/34

  for rolling or scrolling · CPC title

• H04N21/25825

  involving client display capabilities, e.g. screen resolution of a mobile phone (optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06) · CPC title