Pointer unification

Patent metadata

Field	Value
Publication number	US-9483155-B2
Application number	US-201213615272-A
Country	US
Kind code	B2
Filing date	Sep 13, 2012
Priority date	Sep 13, 2012
Publication date	Nov 1, 2016
Grant date	Nov 1, 2016

Abstract

Embodiments relate to a computing device having storage, a processor, a display, a first human input device, and a second human input device, where the first human input device is in a first category of human input devices and the second human input device is in a second category of human input devices. The computing device may perform a process involving executing a windowing environment that manages windows of applications executing on the computing device. The windowing environment may receive raw inputs from the first and second human input devices and in turn generate input pointers for the raw inputs, respectively. The input pointers may be or include instances of an input pointer class implemented by the windowing environment, the pointer class used by the windowing environment for arbitrary different types of human input pointer devices including the first human input device and the second human input device.

First claim

The invention claimed is:

1. A method of managing pointer devices for a windowing environment executing on a computer, the windowing environment managing windows of arbitrary applications executing on the computer, the method comprising:
providing an application programming interface (API) available to the arbitrary applications to obtain pointer messages from the windowing environment, the pointer messages comprising respective object instances of a generic pointer message class implemented by the windowing environment, the generic pointer message class defining a point property and a pointer device category property, wherein the generic pointer message class is not configured to be specific to any pointer device category, wherein each of the pointer messages comprises a point value in the point property and, in the pointer device category property, a pointer device category identifier that identifies a pointer device category of a pointer input device that sensed a point corresponding to the point value therein;
generating a first pointer message by receiving a corresponding first point sensed by a first pointer input device connected and/or integrated with the computer, and, based on the first point, forming the first pointer message by including therein a first point value derived by the windowing environment from the first point and by selecting for the pointer device category property of the first pointer message a first pointer device category identifier identifying a first pointer device category to which the first pointer device belongs;
generating a second pointer message by receiving a corresponding second point sensed by a second pointer input device connected and/or integrated with the computer, and, based on the second point, forming the second pointer message by including therein a second point value derived by the windowing environment from the second point and by selecting for the pointer device category property of the second pointer message a second pointer device category identifier identifying a second pointer device category to which the second pointer belongs; and
passing, by the windowing environment, to any given one of applications, the first and second pointer messages respectively corresponding to the first and second input points.

2. A method according to claim 1 , wherein the windowing environment maps input points of any arbitrary category of input pointer device to pointer messages that are instances of the generic pointer message class such that an application coded to handle pointer messages is able to interact with any arbitrary category of pointer input device via such pointer messages.

3. A method according to claim 1 , wherein the first pointer device category is a mouse device category, wherein the second device category is a touch device category, wherein the first pointer device comprises a mouse, wherein the second pointer device comprises a touch-sensitive surface.

4. A method according to claim 3 , wherein the generic pointer message class is used by the windowing system to provide pointer messages that are instances of the generic pointer message class for arbitrary categories of input pointer devices connected with the computer.

5. A method according to claim 1 , further comprising passing, by the applications, some of the pointer messages or data therefrom to gesture processing objects executing on the computer and receiving, by the applications, from the gesture processing objects, indicia of gestures recognized by the gesture processing objects according to the pointer messages or the data therefrom.

6. A method according to claim 1 , wherein the generic pointer message class further defines a device identifier property, and the applications use the device identifier property to obtain device identifiers of the first and second pointer input devices.

7. A method according to claim 6 , wherein the device identifiers are passed by the applications to the windowing environment which responds with properties of or objects representing the first and second pointer input devices.

8. A method according to claim 1 wherein the windowing environment further implements a pointer device class, the method further comprising the given one of the applications receiving a third pointer message, wherein the first, second, and third pointer messages all comprise object instances of the generic pointer message class, the generic pointer message class further comprising a device property comprising an instance of the pointer device class, the instance of the pointer device class having values that are specific to a corresponding pointer human device.

9. One or more computer-readable storage medium storing information to enable a computing device to perform a process, the computing device comprising a processor, a display, a first pointer device, and a second pointer device, where the first pointer device is in a first category of pointer devices and the second pointer device is in a second category of pointer devices, the process comprising:
executing a windowing environment that manages windows of applications executing on the computing device;
receiving, by the windowing environment, first raw input points outputted from the first pointer device and second raw input points outputted from the second pointer device;
generating, by the windowing environment, first input pointers comprised of points respectively corresponding to the first raw input points, and second input pointers respectively corresponding to the second raw input points, respectively, the first and second input pointers comprising instances of a same input pointer data type or a same message type implemented by the windowing environment, wherein the input pointer data type or message type is generic with respect to categories of pointer devices including at least the first and second categories of pointer devices, and wherein each input pointer comprises a category identifier identifying a category of pointer devices selected according to a pointer device that outputted a corresponding raw input point, the input pointer data type or message type used by the windowing environment to convey points outputted by pointer devices of arbitrary different categories of pointer devices; and
passing the input pointers to the applications.

10. One or more computer-readable storage medium according to claim 9 , wherein some of the input pointers correspond to a first contact of the first pointer device and some of the input pointers correspond to a second contact of the first pointer device, the first and second contact concurrently contacting the first pointer device.

11. One or more computer-readable storage medium according to claim 10 , the process further comprising a first application receiving some of the input pointers and a second application receiving some of the input pointers, and wherein the first application uses a first received input pointer to obtain a first pointer device object representing the first pointer device and uses a second received input pointer to obtain a second pointer device object representing the second pointer device.

12. One or more computer-readable storage medium according to claim 9 , wherein the first pointer device comprises a mouse and the second pointer device comprises a touch surface, the process further comprising a first application passing a pointer input corresponding to the mouse to a first gesture detection module and passing a pointer input corresponding to the touch surface to a second gesture detection module, the gesture detection modules recognizing corresponding gestures and providing indicia thereof to the first application, wherein the category iden

Assignees

• Wu Joyce
• Menon Krishnan
• Young Mariel
• Durojaiye Olumuyiwa
• Townsend Reed
• Torset Todd
• Batricevic Uros
• Aneja Vipul
• Microsoft Technology Licensing Llc

Inventors

• Wu Joyce
• Menon Krishnan
• Young Mariel
• Durojaiye Olumuyiwa
• Townsend Reed
• Torset Todd
• Batricevic Uros
• Aneja Vipul

Classifications

• G06F9/451

  Execution arrangements for user interfaces · CPC title

• G06F3/0416

  Control or interface arrangements specially adapted for digitisers · CPC title

• G06F3/0481 Primary

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• G06F2203/04104

  Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger · CPC title

• G06F3/038 Primary

  Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry · CPC title