Multi-touch interface gestures for keyboard and/or mouse inputs

Patent metadata

Field	Value
Publication number	US-9639186-B2
Application number	US-201213362854-A
Country	US
Kind code	B2
Filing date	Jan 31, 2012
Priority date	Aug 30, 2010
Publication date	May 2, 2017
Grant date	May 2, 2017

Abstract

A mouse-and-keyboard based user interface is updated based on gestures made on a touch screen that is displaying the mouse-and-keyboard based user interface. The user interface update process includes the steps of receiving one or more touch events in response to a gesture made on the touch screen, translating the touch events to a mouse-and-keyboard based command, transmitting the mouse-and-keyboard based command to an operating system, and receiving an updated display in response thereto.

First claim

We claim:

1. A method of interpreting gestures made on a touch screen that is displaying a mouse-and-keyboard based user interface (UI), comprising:
receiving a press-and-hold event in combination with a tap event in response to gestures made on the touch screen, wherein the press-and-hold event is detected in response to a user placing and holding a finger in contact with the touch screen beyond a first threshold amount of time, and wherein the tap event occurs after the press-and-hold event is detected;
translating the received events to a mouse right-click command responsive to determining that the press-and-hold event in combination with the tap event was performed in less than a second threshold of time and determining that a location of the tap event is greater than a threshold distance from the location of the press-and-hold event;
transmitting the mouse right-click command to an operating system; and
receiving from the operating system, in response to the transmitted mouse right-click command, an updated mouse-and-keyboard based UI.

2. The method of claim 1 , wherein the operating system is executing on a remote machine.

3. The method of claim 1 , wherein the operating system is a guest operating system executing in a virtual machine.

4. The method of claim 1 , wherein the updated mouse-and-keyboard based UI includes a display of a context menu at a location of the press-and-hold event.

5. A computing device comprising:
a touch screen; and
a processing unit configured to:
receive a press-and-hold event in combination with a tap event in response to gestures made on the touch screen, wherein the press-and-hold event is detected in response to a user placing and holding a finger in contact with the touch screen beyond a first threshold amount of time, and wherein the tap event occurs after the press-and-hold event is detected;
translating the received events to a mouse right-click command responsive to determining that the press-and-hold event in combination with the tap event was performed in less than a second threshold amount of time and determining that a location of the tap event is greater than a threshold distance from the location of the press-and-hold event;
transmitting the mouse right-click command to an operating system; and
receiving from the operating system, in response to the transmitted mouse right-click command, an updated mouse-and-keyboard based UI.

6. The computing device of claim 5 , wherein the operating system is configured to execute on a remote machine.

7. The computing device of claim 5 , wherein the operating system is a guest operating system executing in a virtual machine.

8. The computing device of claim 5 , wherein the updated mouse-and-keyboard based UI includes a display of a context menu at a location of the press-and-hold event.

9. A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform a method, the method comprising:
receiving a press-and-hold event in combination with a tap event in response to gestures made on the touch screen, wherein the press-and-hold event is detected in response to a user placing and holding a finger in contact with the touch screen beyond a first threshold amount of time, and wherein the tap event occurs after the press-and-hold event is detected;
translating the received events to a mouse right-click command responsive to determining that the press-and-hold event in combination with the tap event was performed in less than a second threshold amount of time and determining that a location of the tap event is greater than a threshold distance from the location of the press-and-hold event;
transmitting the mouse right-click command to an operating system; and
receiving from the operating system, in response to the transmitted mouse right-click command, an updated mouse-and-keyboard based UI.

10. The non-transitory computer-readable medium of claim 9 , wherein the operating system is executing on a remote machine.

11. The non-transitory computer-readable medium of claim 9 , wherein the operating system is a guest operating system executing in a virtual machine.

12. The non-transitory computer-readable medium of claim 9 , wherein the updated mouse-and-keyboard based UI includes a display of a context menu at a location of the press-and-hold event.

Assignees

• Thompson Robert Lee
• Hua Xueliang
• Zhang Zheng
• Casares Juan
• Shao Wenlong
• Zhang li-zhu
• Vmware Inc

Inventors

• Thompson Robert Lee
• Hua Xueliang
• Zhang Zheng
• Casares Juan
• Shao Wenlong
• Zhang li-zhu

Classifications

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/038 Primary

  Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry · CPC title

• G06F2203/0383

  Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN · CPC title

• G06F2203/04805

  Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection · CPC title

• G06F2203/04808

  Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen · CPC title