Text input synchronization for remote applications

Patent metadata

Field	Value
Publication number	US-12067174-B2
Application number	US-202117481746-A
Country	US
Kind code	B2
Filing date	Sep 22, 2021
Priority date	Aug 17, 2021
Publication date	Aug 20, 2024
Grant date	Aug 20, 2024

Abstract

In some embodiments, a method includes: receiving, by a first computing device, text composed using a composition window of a second computing device; entering, by the first computing device, the composed text into a text input of an application executing on the first computing device; determining, by the first computing device, one or more attributes of a cursor of the text input, the one or more attributes of the cursor including at least a position of the cursor; and sending, by the first computing device, the one or more attributes of the cursor to the second computing device, the second computing device configured to display the application and to position the composition window relative to the displayed application based on the position of the cursor determined by the first computing device.

First claim

The invention claimed is:

1. A method comprising:
receiving, by a first computing device, text composed using a composition window rendered initially and locally by a second computing device distinct from the first computing device;
entering, by the first computing device, the composed text into a text input of an application executing on the first computing device;
determining, by the first computing device, one or more attributes of a cursor of the text input, the one or more attributes of the cursor including at least a position of the cursor; and
sending, by the first computing device, the one or more attributes of the cursor to the second computing device, the second computing device configured to display the application and to position the composition window relative to the displayed application based on the position of the cursor determined by the first computing device.

2. The method of claim 1 , wherein the composition window is part of an input method editor (IME) executing on the second computing device, wherein the composition window is configured to receive a sequence of characters entered using an input device of the second computing device and to generate characters not natively available on the input device of the second computing device using the received sequence of characters, wherein the composed text received by the first computing device corresponds to the generated characters not natively available on the input device of the second computing device.

3. The method of claim 2 , wherein the second computing device is configured to position a candidates window relative to the displayed application at a composition window position based on the position of the cursor sent by the first computing device and received by the second computing device, wherein the candidates window is also part of the IME executing on the second computing device.

4. The method of claim 1 , further comprising:
receiving, by the first computing device, a start composition request from the second computing device, the start composition request specifying a composition session identifier; and
initiating, by the first computing device and in response to the start composition request, a composition session with the second computing device, the composition session associated with the application executing on the first computing device and associated with the composition session identifier.

5. The method of claim 1 , further comprising:
receiving, by the first computing device, a cursor attribute request for the one or more attributes of the cursor,
wherein the sending of the one or more attributes of the cursor to the second computing device is responsive to the receiving the cursor attribute_request for the one or more attributes of the cursor.

6. The method of claim 1 , further comprising:
responsive to detecting a change in the position of the cursor, sending the changed position of the cursor to the second computing device.

7. The method of claim 1 , wherein the one or more attributes of the cursor includes a height of the cursor, wherein the second computing device is configured to adjust a font size of the composition window based on the height of the cursor.

8. The method of claim 1 , wherein the application is a web application and the text input is an HTML element of the web application.

9. The method of claim 1 , wherein the application is executing within a virtual machine (VM) on the first computing device.

10. The method of claim 1 , further comprising:
rendering, locally via the second computing device, the composition window;
displaying, by the second computing device, the composition window in conjunction with at least one element rendered by the first computing device;
receiving, via an input device of the second computing device, one or more keystrokes corresponding to one or more characters;
entering the one or more characters into the composition window as composed text; and
transmitting, by the second computing device, the composed text to the first computing device.

11. The method of claim 1 , wherein:
receiving, by the first computing device, the text comprises receiving, by the first computing device, a message comprising a composition session identifier and the text;
the text input of the application executing on the first computing device is associated with the composition session identifier; and
sending, by the first computing device, the one or more attributes of the cursor to the second computing device comprises sending, by the first computing device, the composition session identifier and the one or more attributes of the cursor to the second computing device.

12. The method of claim 11 , wherein the receiving of the text composed using the second computing device includes receiving the composed text over a text input synchronization channel of a remote display protocol, wherein the composition session identifier is associated with the text input synchronization channel.

13. The method of claim 12 , wherein the remote display protocol includes a keyboard channel separate from the text input synchronization channel over which the composed text is received.

14. A method comprising:
sending, by a first computing device distinct from a second computing device, text composed using an initially and locally rendered composition window of the first computing device to the second computing device, the second computing device configured to enter the composed text into a text input of an application executing on the second computing device and to determine one or more attributes of a cursor of the text input, the one or more attributes of the cursor including at least a position of the cursor;
receiving, by the first computing device, the one or more attributes of the cursor from the second computing device, the first computing device displaying the application executing on the second computing device; and
positioning, by the first computing device, the composition window relative to the displayed application based on the position of the cursor determined by the second computing device.

15. The method of claim 14 , wherein the composition window is part of an input method editor (IME) executing on the first computing device, wherein the composition window is configured to receive a sequence of characters entered using an input device of the first computing device and to generate characters not natively available on the input device of the first computing device using the received sequence of characters, wherein the composed text sent to the second computing device corresponds to the generated characters not natively available on the input device of the first computing device.

16. The method of claim 15 , further comprising:
positioning, by the first computing device, a candidates window relative to the displayed application at a composition window position based on the position of the cursor sent by the second computing device and received by the first computing device, wherein the candidates window is also part of the IME executing on the first computing device.

17. The method of claim 14 , wherein the sending of the text composed using the first computing device includes sending the composed text over a text input synchronization channel of a remote display protocol.

18. The method of claim 17 , wherein the remote display protocol includes a keyboard channel separate from the text input synchronization channel over which the composed text is received.

19. The method of claim 14 , further comprising:
sending

Assignees

• Citrix Systems Inc

Inventors

• Yiming Wang
• Yin Tao
• Lin Cungang
• Wu Hao
• Li Sujie

Classifications

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• G06F3/1454

  involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay · CPC title

• G06F3/018

  Input/output arrangements for oriental characters · CPC title

• G06F3/0236 Primary

  using selection techniques to select from displayed items · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title