Remoting application across a network using draw commands with an isolator application

Patent metadata

Field	Value
Publication number	US-11675930-B2
Application number	US-202016781854-A
Country	US
Kind code	B2
Filing date	Feb 4, 2020
Priority date	Feb 4, 2019
Publication date	Jun 13, 2023
Grant date	Jun 13, 2023

Abstract

A client device instantiates an isolator application. A request to instantiate a remote application in a server device is sent by the isolator application instance. The isolator application instance receives, from the remote application instance, draw commands and position information that correspond to the draw commands. The isolator application instance renders one or more portions of output based on the draw commands and the position information.

First claim

What is claimed is:

1. A method, comprising:
instantiating an instance of an application on a client device, the application preconfigured to interface with and display output of a remote application instance;
providing, from the application instance on the client device to a server, a request to instantiate the remote application instance on the server;
obtaining, by the application instance on the client device and from the remote application instance on the server, first draw commands and first position information that corresponds to the first draw commands, the first draw commands and the first position information being associated with an output of the remote application instance; and
rendering, by the application instance on the client device, one or more portions of the output of the remote application instance based on the obtained first draw commands and the obtained first position information.

2. The method of claim 1 , further comprising:
detecting, by the application instance on the client device, an input causing a user interface of the application instance on the client device to be out of view of a display of the client device; and
providing, from the application instance on the client device and to the remote application instance on the server, an indicator of the detected input, the detected input causing the remote application instance to cease generating output to provide to the application instance on the client device.

3. The method of claim 1 , further comprising:
detecting, by the application instance on the client device, an input from a user of the client device;
providing, from the application instance on the client device and to the remote application instance on the server, an indicator of the detected input;
obtaining, by the application instance on the client device and from the remote application instance on the server, content in the one or more portions of the output of the remote application instance; and
storing, by the application instance on the client device, the obtained content in a clipboard buffer of the client device to enable the client device to paste the stored content in one or more other applications instantiated on the client device.

4. The method of claim 1 , further comprising:
detecting, by the application instance on the client device, an input from a user of the client device, the detected input including a user selection from a sub-menu that the application instance provides responsive to user selection of a portion of an application menu of the application instance, one or more of the application menu or the sub-menu being visible to and available to the user before providing the request to instantiate the remote application on the server;
providing, from the application instance on the client device and to the remote application instance on the server, an indicator of the detected input;
obtaining, by the application instance on the client device and from the remote application instance on the server, second draw commands and second position information that corresponds to the second draw commands, the second draw commands and the second position information indicating a set of user interface controls in the sub-menu associated with functions that are presently available; and
rendering, by the application instance on the client device, one or more portions of the output of the remote application instance based on the obtained second draw commands and the second obtained position information.

5. The method of claim 1 , further comprising:
forwarding an application programming interface (API) call of an extension on the application instance on the client device to the remote application instance on the server to proxy the API call between the extension and the remote application instance.

6. The method of claim 1 , further comprising:
detecting, by the application instance on the client device, an input from a user of the client device;
evaluating, by the application instance on the client device, the input based on context information available on the client device;
determining, by the application instance on the client device, that the input includes an attempt to provide sensitive information to the remote application instance on the server based on the evaluation; and
preventing, by the application instance on the client device, the input from being provided to the remote application instance on the server based on the determination.

7. The method of claim 1 , further comprising:
detecting, by the application instance on the client device, an input instruction to paste content from a local clipboard buffer in the output of the remote application instance from a user of the client device;
providing, from the application instance on the client device and to the remote application instance on the server, an indicator of the detected input instruction to paste content in the output of the remote application instance;
obtaining, by the application instance on the client device and from the remote application instance on the server, second draw commands and second position information that corresponds to the second draw commands, the second draw commands and the second position information being associated with a modified output of the remote application instance based on the detected input instruction; and
rendering, by the application instance on the client device, one or more portions of the modified output of the remote application instance based on the obtained second draw commands and the second obtained position information.

8. The method of claim 1 , further comprising:
detecting, by the application instance on the client device, an input from a user of the client device, the detected input including a user interaction with an address bar;
providing, from the application instance on the client device and to the remote application instance on the server, an indicator of the detected input;
obtaining, by the application instance on the client device and from the remote application instance on the server, content in the one or more portions of the output of the remote application instance, the content including an indication to the application instance on the client device of information to dynamically populate the address bar; and
automatically populating, by the application instance on the client device, the address bar based on the information in the one or more portions of the output of the remote application instance.

9. A non-transitory computer-readable medium that stores instructions that, when executed by one or more processors, cause the one or more processors to perform actions, the actions comprising:
instantiating an instance of an application on a client device, the application preconfigured to interface with and display output of a remote application instance;
providing, from the application instance on the client device to a server, a request to instantiate the remote application instance on the server;
obtaining, by the application instance on the client device and from the remote application instance on the server, first draw commands and first position information that corresponds to the first draw commands, the first draw commands and the first position information being associated with an output of the remote application instance; and
rendering, by the application instance on the client device, one or more portions of the output of the remote application instance based on the obtained first draw commands and the obtained first position information.

10. The non-transitory computer-readable medium of claim 9 , wherein the actions further comprise:
detecting, by the application instance on the client dev

Assignees

• Cloudflare Inc

Inventors

• Buzbee Benjamin
• Koenig Killian
• Sundberg Trevor
• Conrad Michael
• Remington Darren
• Harnett David

Classifications

• G06F21/6245

  Protecting personal data, e.g. for financial or medical purposes · CPC title

• G06F21/53

  by executing in a restricted environment, e.g. sandbox or secure virtual machine · CPC title

• G06F21/629 Primary

  to features or functions of an application · CPC title

• G06F21/71

  to assure secure computing or processing of information · CPC title

• G06F9/452 Primary

  Remote windowing, e.g. X-Window System, desktop virtualisation (protocols for virtual reality H04L67/131) · CPC title