Methods and systems for accessing and controlling a remote desktop of a remote machine in real time by a web browser at a client device via HTTP API utilizing a transcoding server

Patent metadata

Field	Value
Publication number	US-10237327-B2
Application number	US-201314078972-A
Country	US
Kind code	B2
Filing date	Nov 13, 2013
Priority date	Dec 10, 2010
Publication date	Mar 19, 2019
Grant date	Mar 19, 2019

Abstract

Examples of methods, systems, apparatus, and machine-readable storage media are provided to facilitate access and control of a remote desktop of a remote machine by a web browser at a client device through a transcoding server without installing proprietary plug-ins or protocols on the client device. A transcoding server may translate user input requests from a web browser into input calls compatible with a remote desktop display protocol. The transcoding server may receive remote desktop drawing commands from the remote machine and translate the remote desktop drawing commands into web browser drawing updates compatible with the web browser. A transcoding server may communicate with a web browser via HTTP and communicate with a remote machine via a remote desktop display protocol. A web browser may be an HTML5 browser. A transcoding server may send drawing coordinates to the web browser via an HTTP header and may use long polling.

First claim

The invention claimed is:

1. A method of facilitating accessing and controlling a remote desktop of a remote machine in real time by a web browser at a client device via a hypertext transfer protocol (HTTP) utilizing a transcoding server, the method comprising:
receiving a connection request from the web browser;
authenticating, by the transcoding server, the connection between the remote machine and the client device;
establishing the connection between the remote machine and the client device;
rendering, by the transcoding server, the remote desktop;
transmitting the rendering to the web browser;
receiving, at the transcoding server, a remote desktop drawing command from the remote machine via the client device based on an image of the remote desktop of the remote machine, wherein the remote desktop drawing command is compatible with a remote desktop display protocol utilized by the remote machine, wherein the remote desktop drawing command comprises a pointer to a memory location where bitmap data associated with the image is located;
interfacing with the remote machine via a remote desktop client adapter of the transcoding server, wherein the remote desktop client adapter provides a common interface between the client device and a drawing commands queue, wherein the drawing commands queue stores one or more off-screen images and serves as a drawing coordinates pool;
translating, at the transcoding server, the remote desktop drawing command into a web browser drawing update that is compatible with the web browser, wherein translating the remote desktop drawing command into the web browser drawing update comprises:
translating the remote desktop drawing command into a Java graphics drawing command;
updating a portion of a Java bitmap using the Java graphics drawing command, wherein the updated portion represents a portion of an entire image of the remote desktop;
creating an image file from the Java bitmap;
generating drawing coordinates from the image file; and
generating the web browser drawing update including the image file and the drawing coordinates for the image file;

facilitating providing the web browser drawing update from the transcoding server to the web browser of the client device utilizing HTTP during a remote desktop session between the client device and the remote machine;
wherein the remote desktop display protocol is a push protocol; and
wherein HTTP is a pull protocol.

2. The method of claim 1 , wherein the web browser drawing update comprises an image file and drawing coordinates for the image file that are recognizable and processable by the web browser.

3. The method of claim 1 , wherein the translating comprises:
translating the remote desktop drawing command into a Java graphics drawing command;
updating a portion of a Java bitmap using the Java graphics drawing command, wherein the updated portion of the Java bitmap represents a portion of an entire image of the remote desktop;
creating an image file from the Java bitmap; and
generating drawing coordinates for the image file,
wherein the web browser drawing update comprises the image file and the drawing coordinates for the image file,
wherein the facilitating providing comprises placing the drawing coordinates into an HTTP header,
wherein utilizing HTTP comprises using an HTTP handler,
wherein the transcoding server is a Java transcoding server that is configured to provide an application framework for hosting one or more web applications.

4. The method of claim 1 , wherein the translating comprises:
translating the remote desktop drawing command into a graphics drawing command that is compatible with the transcoding server, wherein the graphics drawing command includes coordinates;
extracting the coordinates from the graphics drawing command;
updating at least a portion of an off-screen bitmap based on the graphics drawing command, wherein the at least a portion of the off-screen bitmap is associated with the coordinates,
wherein the off-screen bitmap is based on the image of the remote desktop;
creating an image file based on the at least a portion of the off-screen bitmap; and
wherein the web browser drawing update comprises the image file and the coordinates.

5. The method of claim 1 , wherein the web browser is an HTML5 compatible web browser.

6. The method of claim 1 , further comprising: receiving a user input request from the web browser, using HTTP;
translating the user input request into an input command compatible with the remote desktop display protocol; and
providing the input command to the remote desktop client for accessing and controlling the remote desktop of the remote machine during the remote desktop session,
wherein the web browser drawing update comprises an image file and drawing coordinates for the image file that are recognizable and processable by the web browser,
wherein the image file and the drawing coordinates represent a portion of an entire image of the remote desktop that has been changed in response to the input command.

7. The method of claim 6 , wherein the user input request comprises at least one of a mouse event, a keyboard event, and a touch event.

8. The method of claim 1 , wherein the remote desktop drawing command comprises remote desktop drawing command parameters and bitmap data received from a remote desktop server of the remote machine,
wherein the translating comprises one or more of: calculating new drawing command parameters based on the remote desktop drawing command parameters; adjusting the remote desktop drawing command parameters; and making adjustments to the bitmap data.

9. The method of claim 1 , wherein the remote desktop drawing command comprises remote desktop drawing command parameters and bitmap data received from a remote desktop server of the remote machine,
wherein the translating comprises making adjustments to the bitmap data,
wherein the making adjustments comprises converting a 16-bit red-green-blue (RGB) 5-6-5 color format into a 32-bit alpha-red-green-blue (ARGB) 8-8-8-8 format.

10. The method of claim 1 , wherein the transcoding server is an intermediary between the remote machine and the client device, wherein the transcoding server is physically separate from the remote machine, and wherein the transcoding server comprises a long polling handler that is operable to receive and handle HTTP requests from the web browser.

11. A machine-readable non-transitory storage medium encoded with instructions executable by a processing system to perform a method of facilitating accessing and controlling a remote desktop of a remote machine in real time by a web browser at a client device via a hypertext transfer protocol (HTTP) utilizing a transcoding server, the instructions comprising code for:
receiving a connection request from the web browser;
authenticating, by the transcoding server, the connection between the remote machine and the client device;
establishing the connection between the remote machine and the client device;
rendering, by the transcoding server, the remote desktop;
transmitting the rendering to the web browser;
receiving, at the transcoding server, a remote desktop drawing command from the remote machine via the client device based on an image of the remote desktop of the remote machine, wherein the remote desktop drawing command is compatible with a remote desktop display protocol utilized by the remote machine and wherein the remote desktop drawing command comprises a pointer to a memory location where bitmap data associated with the image is located;
interfacing with the remote machine via a remote desktop client adapter of the transcoding server, wherein the remote deskt

Assignees

• Wyse Technology Llc

Inventors

• Kominac Stevan
• Stanley Jeremy Michael
• Schwebke Curtis J

Classifications

• H04L67/08

  specially adapted for terminal emulation, e.g. Telnet · CPC title

• G06F9/452

  Remote windowing, e.g. X-Window System, desktop virtualisation (protocols for virtual reality H04L67/131) · CPC title

• H04L67/02 Primary

  based on web technology, e.g. hypertext transfer protocol [HTTP] · CPC title

• H04L67/025 Primary

  for remote control or remote monitoring of applications · CPC title

• G06F9/4445

  Physics · mapped topic