Verification of shared display integrity in a desktop sharing system

Patent metadata

Field	Value
Publication number	US-9348614-B2
Application number	US-201213414432-A
Country	US
Kind code	B2
Filing date	Mar 7, 2012
Priority date	Mar 7, 2012
Publication date	May 24, 2016
Grant date	May 24, 2016

Abstract

A system and related operating methods that achieve shared screen verification are presented here. One operating method begins by establishing a desktop sharing session between a publisher device and a viewer device, during which the publisher device renders a publisher display and the viewer device renders a viewer display that corresponds to the publisher display. The method continues by capturing first framebuffer data for a frame of the publisher display, capturing second framebuffer data for the corresponding frame of the viewer display. The method processes the first framebuffer data and/or the second framebuffer data to obtain processed framebuffer data having a consistent display resolution. Thereafter, the method compares the processed second framebuffer data to the processed first framebuffer data to obtain a measure of quality.

First claim

What is claimed is:

1. A method of shared screen verification, comprising:
establishing a desktop sharing session between a publisher device and a viewer device, during which the publisher device renders a publisher display and the viewer device renders a viewer display that corresponds to the publisher display;
capturing, at a server device, first framebuffer data for a frame of the publisher display, wherein the first framebuffer data is captured from a first framebuffer at the publisher device and the first framebuffer data corresponds to pixel-based information used to render the frame at the publisher display;
separately capturing, at the server device, second framebuffer data for a frame of the viewer display, wherein video content of the frame of the viewer display corresponds to video content of the frame of the publisher display, wherein the second framebuffer data is captured from a second framebuffer at the viewer device and the second framebuffer data corresponds to pixel-based information used to render the frame at the viewer display;
based on the first framebuffer data differing in resolution from the second framebuffer data, adjusting, at the server device, resolution of the first framebuffer data, the second framebuffer data, or both the first framebuffer data and the second framebuffer data to generate processed first framebuffer data and processed second framebuffer data that exhibit a consistent display resolution so that the processed first framebuffer data and the processed second framebuffer data are capable of being compared to each other;
defining one or more pixel regions of the frame that identify a common display area for the publisher display and the viewer display, wherein the defining comprises: identifying a first N-by-M pixel region of the processed first framebuffer data, wherein N is a nonzero positive integer, and wherein M is a nonzero positive integer: and identifying a second N-by-M pixel region of the processed second framebuffer data, wherein the first N-by-M pixel region and the second N-by-M pixel region correspond to a common display area for the publisher display and the viewer display; and
determining, at the server device based on a matching analysis of the processed second framebuffer data for the defined pixel regions of the frame and the processed first framebuffer data for the defined pixel regions of the frame, a score that indicates shared screen display quality of the defined pixel regions of the frame rendered on the viewer display and the publisher display, wherein the score indicates an extent to which the second N-by-M pixel region of the processed second framebuffer data for the defined pixel regions of the frame match the first N-by-M pixel region of the processed first framebuffer data for the defined pixel regions of the frame.

2. The method of claim 1 , wherein a desktop sharing application is executed by a processor to support the desktop sharing session, and further comprising:
generating an output that indicates the shared screen display quality of the defined pixel regions of the frame rendered on the viewer display and the publisher display.

3. The method of claim 1 , wherein:
the first framebuffer of the publisher device comprises a first video framebuffer; and
capturing the first framebuffer data comprises: receiving the first framebuffer data from the first video framebuffer.

4. The method of claim 1 , wherein:
the second framebuffer of the viewer device comprises a second video framebuffer; and
separately capturing the second framebuffer data comprises: receiving the second framebuffer data from the second video framebuffer.

5. A method of shared screen verification, comprising:
establishing a desktop sharing session between a publisher device and a viewer device, during which the publisher device renders a publisher display and the viewer device renders a viewer display that corresponds to the publisher display;
capturing, from a video framebuffer of the publisher device, first framebuffer data for a frame of the publisher display, wherein the first framebuffer data corresponds to pixel-based information used to render the frame at the publisher display;
separately capturing, from a video framebuffer of the viewer device, second framebuffer data for a frame of the viewer display, wherein video content of the frame of the viewer display corresponds to video content of the frame of the publisher display, wherein the second framebuffer data corresponds to pixel-based information used to render the frame at the viewer display;
based on the first framebuffer data differing in resolution from the second framebuffer data, adjusting resolution of the first framebuffer data, the second framebuffer data, or both the first framebuffer data and the second framebuffer data to generate processed first framebuffer data and processed second framebuffer data, wherein the processed first framebuffer data and the processed second framebuffer data exhibit a consistent display resolution so that the processed first framebuffer data and the processed second framebuffer data are capable of being compared to each other;
defining one or more pixel regions of the frame that identify a common display area for the publisher display and the viewer display, comprising: identifying a first N-by-M pixel region of the processed first framebuffer data, wherein N is a nonzero positive integer, and wherein M is a nonzero positive integer; and identifying a second N-by-M pixel region of the processed second framebuffer data, wherein the first N-by-M pixel region and the second N-by-M pixel region correspond to a common display area for the publisher display and the viewer display; and
determining, based on a matching analysis of the processed second framebuffer data for the defined pixel regions of the frame and the processed first framebuffer data for the defined pixel regions of the frame, a score that indicates shared screen display quality of the defined pixel regions of the frame rendered on the viewer display and the publisher display, wherein the score indicates an extent to which the first N-by-M pixel region of the processed first framebuffer data matches the second N-by-M pixel region of the processed second framebuffer data.

6. The method of claim 5 , wherein a desktop sharing application is executed by a processor to support the desktop sharing session, and further comprising:
generating an output that indicates the shared screen display quality of the defined pixel regions of the frame rendered on the viewer display and the publisher display.

7. The method of claim 5 , wherein:
capturing the first framebuffer data comprises obtaining the first framebuffer data at the viewer device;
separately capturing the second framebuffer data comprises: obtaining the second framebuffer data at the viewer device; and
the adjusting resolution and determining are performed at the viewer device.

8. The method of claim 7 , wherein:
establishing the desktop sharing session comprises: establishing a first data communication connection between the publisher device and the viewer device;
the method further comprises: establishing a second data communication connection between the publisher device and the viewer device; and
the viewer device uses the second data communication connection to obtain the first framebuffer data.

9. The method of claim 5 , wherein:
capturing the first framebuffer data comprises: obtaining the first framebuffer data at a server device that is communicatively coupled between the publisher device and the viewer device;
separately capturing the second framebuffer data comprises: obtaining the second framebuffer data at the server device; and
the adjusting resolu

Assignees

• Patil Dipak
• Salesforce Com Inc

Inventors

• Patil Dipak

Classifications

• G06F9/4445 Primary

  Physics · mapped topic

• G09G2370/02

  Networking aspects · CPC title

• G06F9/452 Primary

  Remote windowing, e.g. X-Window System, desktop virtualisation (protocols for virtual reality H04L67/131) · CPC title

• G06F3/1462 Primary

  with means for detecting differences between the image stored in the host and the images displayed on the remote displays · CPC title

• G09G2340/04

  Changes in size, position or resolution of an image · CPC title