Translation of touch input into local input based on a translation profile for an application

Patent metadata

Field	Value
Publication number	US-9632693-B2
Application number	US-201214384249-A
Country	US
Kind code	B2
Filing date	May 29, 2012
Priority date	May 29, 2012
Publication date	Apr 25, 2017
Grant date	Apr 25, 2017

Abstract

Examples disclosed herein relate to translation of touch input into local input based on a translation profile for an application. Examples include translating touch input into local input based on a translation profile for an application in focus, if the translation profile is accessible. Examples further include providing the touch input to an operating system if no translation profile for the application in focus is accessible and the operating system is able to utilize touch input.

First claim

What is claimed is:

1. A non-transitory machine-readable storage medium encoded with instructions executable by a processor of a local computing device, the storage medium comprising instructions to:
provide, to a remote computing device with a network interface of the local computing device, remote display information useable to display at least a portion of a graphical user interface (GUI) of the local computing device;
receive, with the network interface, touch input identifying a touch event sensed with a touch-sensitive display at the remote computing device when displaying the at least a portion of the GUI;
determine an application in focus at the local computing device at the time of the touch event;
determine whether an application translation profile associated with the application in focus is accessible to the local computing device, wherein the application translation profile associated with the application in focus is one of a plurality of application translation profiles, each application translation profile in the plurality having a corresponding application;
in response to a determination that the application translation profile associated with the application in focus is accessible, translate at least the received touch input into local input useable by an operating system (OS) of the local computing device based on the application translation profile associated with the application in focus, wherein the application translation profile maps the touch input to a mouse or keyboard input that emulates the result of the touch input;
determine whether the OS is able to utilize touch input;
in response to a determination that no translation profile associated with the application in focus is accessible and a determination the OS is unable to utilize touch input, translate the received touch input into local input useable by the OS based on a general translation profile associated with the OS, wherein the plurality of application translation profiles have priority over the general translation profile; and
in response to the determination that no translation profile associated with the application in focus is accessible and a determination that the OS is able to utilize touch input, provide the received touch input to the OS without use of the plurality of application translation profiles and without use of the general translation profile.

2. The storage medium of claim 1 , further comprising:
instructions to determine a device type of the remote computing device,
wherein the application translation profile associated with the application in focus is associated with the determined device type, and is one of a plurality of translation profiles associated with the application in focus, wherein each of the plurality of translation profiles associated with the application in focus is associated with a different device type.

3. The storage medium of claim 1 , wherein:
the instructions to translate based on the application translation profile comprise:
instructions to identify a touch action of the application translation profile corresponding to at least the received touch input; and
instructions to provide to the OS the local input mapped to the identified touch action in the application translation profile associated with the application in focus; and

the local input includes information emulating output of at least one input device whose output is useable by the OS.

4. The storage medium of claim 3 , wherein the local input includes information emulating a sequence of keystrokes output by a keyboard, the sequence defined to invoke a given function in the application in focus.

5. The storage medium of claim 3 , wherein the identified touch action may include information identifying a sequence of touch input defining a touch gesture, the sequence of touch input including the received touch input.

6. A local computing device comprising:
a memory encoded with a set of executable instructions;
a processor to execute the instructions, wherein the instructions, when executed, cause the processor to:
provide, to a remote computing device, information useable to display at least a portion of a graphical user interface (GUI) of the local computing device;
receive touch input identifying a touch event sensed with a display of the remote computing device when displaying the at least a portion of the GUI;
translate, based on an application translation profile for an application in focus at the local computing device at the time of the touch event, a touch action including at least the received touch input into local input that an operating system (OS) of the local computing device is able to natively process if the first translation profile is accessible to the local computing device and maps the touch action to local input, wherein the translation profile maps the touch input to a mouse or keyboard input that emulates the result of the touch input, and wherein the application translation profile for the application in focus is one of a plurality of application translation profiles, each application translation profile in the plurality having a corresponding application;
translate, based on a general translation profile associated with the OS, at least the received touch input into local input the OS is able to natively process if the OS is not able to natively process touch input and no translation profile for the application in focus is accessible, wherein the plurality of application translation profiles have priority over the general translation profile; and
provide the touch input to the OS without use of the plurality of application translation profiles and without use of the general translation profile if no translation profile for the application in focus is accessible and the OS is able to natively process touch input.

7. The local computing device of claim 6 , wherein the instructions, when executed, further cause the processor to:
receive touch input from both the remote computing device and at least one other remote computing device in the same format;
identify the application in focus at the time of the touch event in response to receiving the touch input from the remote computing device; and
determine that the application translation profile for the identified application in focus is accessible to the local computing device if the first translation profile is included among the plurality of application translation profiles, the plurality of application translation profiles stored at the local computing device.

8. The local computing device of claim 7 , wherein:
the plurality of application translation profiles includes another translation profile for another application of the local computing device;
each of the plurality of application translation profiles includes a mapping of at least one touch action to local input; and
the application translation profile for the application in focus and the other application translation profile each map a given touch action to different local input.

9. The local computing device of claim 8 , the instructions, when executed, further cause the processor to:
receive a translation profile alteration request specifying one of the plurality of application translation profiles; and
alter the specified translation profile in accordance with the received request.

10. The local computing device of claim 6 , wherein the application translation profile for the application in focus includes a mapping of a given touch action to local input implementing a macro for the application associated with the first translation profile.

11. The local computing device of claim 8 , the instructions, when executed, further cause the processor to:

Assignees

• Nylund Mark Edward
• Lukasik Derek
• Walls Jeffrey Joel
• Hewlett Packard Development Co Lp

Inventors

• Nylund Mark Edward
• Lukasik Derek
• Walls Jeffrey Joel

Classifications

• G06F3/0488 Primary

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F9/452

  Remote windowing, e.g. X-Window System, desktop virtualisation (protocols for virtual reality H04L67/131) · CPC title

• H04L67/025

  for remote control or remote monitoring of applications · CPC title