Text entry by training touch models

Patent metadata

Field	Value
Publication number	US-9636582-B2
Application number	US-201113088420-A
Country	US
Kind code	B2
Filing date	Apr 18, 2011
Priority date	Apr 18, 2011
Publication date	May 2, 2017
Grant date	May 2, 2017

Abstract

Embodiments present a game in which an ordered plurality of characters is presented for entry by a user with a touch screen, a physical keyboard, or other key input layout. The game advances to each successive character when the user presses the intended character or a character adjacent thereto. Contact areas are determined for each press, and in some embodiments the contact areas are overlaid on the keyboard. The contact areas are used to adjust user-specific touch models to improve text entry by the user. In some embodiments, the contact areas indicate areas for improvement by the user. Game completion statistics are calculated including speed and accuracy.

First claim

What is claimed is:

1. A system for obtaining data to train a touch model associated with a mobile computing device, said system comprising:
a memory area associated with a mobile computing device, said memory area storing a user-specific touch model associated with the mobile computing device;
a touch screen for receiving input; and
a processor programmed to:
display a keyboard in a first partition of the touch screen;
display an ordered plurality of characters in a second partition of the touch screen, said ordered plurality of characters being a subset of characters of the displayed keyboard;
receive a sequence of touch screen inputs, each input in the sequence intended to correspond to one of the displayed ordered plurality of characters and intended to be inputted in the same order as the displayed ordered plurality of characters;
as each touch screen input is received,
determine a contact area associated with each of the received touch screen inputs,
compare each determined contact area to the portion of the displayed keyboard associated with the corresponding character in the ordered plurality of characters to define a distance, and
visually alter display of the corresponding character based on a comparison of the defined distance with a threshold distance; and

update the user-specific touch model stored in the memory area based on the determined contact area of each of the touch screen inputs.

2. The system of claim 1 , wherein the second partition of the touch screen, displaying the ordered plurality of characters, is a part of the same touch screen that displays the keyboard in the first partition of the touch screen.

3. The system of claim 1 , wherein the processor is further programmed to:
calculate a speed and accuracy of the received sequence of touch screen inputs relative to the displayed ordered plurality of characters; and
generate a score based at least on the calculated speed and accuracy.

4. The system of claim 1 , wherein the displayed ordered plurality of characters comprises one or more of the following: a word, a phrase, a sentence, symbols, graphic elements, abbreviations, and emoticons.

5. The system of claim 1 , wherein updating the user-specific touch model comprises adjusting a center of each character of the displayed keyboard based on the determined contact area of the touch screen input for the corresponding intended character.

6. The system of claim 1 , wherein the processor is further programmed to identify entry characteristics for providing the sequence of touch screen inputs, said entry characteristics comprising one or more of the following: one finger input, two finger input, input while walking, input while sitting, and input while standing.

7. A method comprising:
displaying a key input layout in a first partition of a touch screen of a computing device;
displaying an ordered plurality of characters in a second partition of the touch screen before receiving touch screen input from the user, the ordered plurality of characters being a subset of characters of the displayed key input layout;
receiving a sequence of touch screen inputs each intended to correspond to one of the displayed ordered plurality of characters;
determining a contact area associated with each of the received touch screen inputs;
comparing each determined contact area to the portion of the displayed key input layout associated with the corresponding character in the ordered plurality of characters to define a distance;
visually altering display of the corresponding character based on a comparison of the defined distance with a threshold distance; and
defining a user-specific touch model associated with the computing device based on said comparing and said altering,
wherein the first partition and the second partition are on a same side of the computing device.

8. The method of claim 7 , wherein the computing device has a manufacturer model number associated therewith, and wherein defining the user-specific touch model comprises altering a generic touch model associated with the manufacturer model number.

9. The method of claim 7 , wherein determining the contact area comprises determining one or more of the following: an X-Y coordinate, a shape of a contact surface, a pressure reading, a key down event corresponding to a finger press, and a key up event corresponding to a finger release.

10. The method of claim 7 , further comprising advancing to a next corresponding character in the ordered plurality of characters if the determined contact area overlaps and/or is adjacent to the portion of the displayed key input layout associated with the corresponding character.

11. The method of claim 10 , wherein advancing to the next corresponding character comprises one or more of the following: removing display of the corresponding character from the touch screen, and visually distinguishing display of the next corresponding character from the other characters in the ordered plurality of characters.

12. The method of claim 7 , further comprising:
calculating an accuracy of the received sequence of touch screen inputs relative to the displayed ordered plurality of characters; and
calculating a speed based on receipt of the received sequence of touch screen inputs and the calculated accuracy.

13. The method of claim 12 , further comprising providing the ordered plurality of characters, corresponding determined contact areas, calculated speed, and calculated accuracy to a cloud service for analysis.

14. The method of claim 13 , the cloud service aggregating, from a plurality of the computing devices, crowd-sourced data including the ordered plurality of characters, corresponding determined contact areas, calculated speed, and calculated accuracy, and analyzing the aggregated crowd-sourced data to determine an aggregate speed and an aggregate accuracy per make and model of the plurality of computing devices.

15. The method of claim 14 , said cloud service analyzing the aggregated crowd-sourced data to identify problems per make and model of the plurality of computing devices and/or per user.

16. The method of claim 12 , further comprising selecting another ordered plurality of characters based on the calculated accuracy to improve the calculated accuracy.

17. The method of claim 12 , wherein the key input layout represents a first key input layout, wherein the defined user-specific touch model represents a first touch model, wherein the calculated accuracy and the calculated speed represent performance of the first key input layout and first touch model, and further comprising:
comparing the performance of the first key input layout and first touch model with performance of a second key input layout and a second touch model; and
defining a third key input layout based on said comparing.

18. One or more computing devices storing computer-executable components, said components comprising:
a touch screen component that when executed causes at least one processor to:
display a key input layout in a partition of a touch screen of a mobile computing device,
provide an ordered plurality of characters, each of said ordered plurality of characters having a portion of the displayed key input layout associated therewith,
receive a sequence of touch screen inputs each intended to correspond to one of the provided ordered plurality of characters, and
determine a contact area associated with each of the received touch screen inputs;

a game component that when executed causes at least one processor to visually alter each of the provided

Assignees

• Rudchenko Dmytro
• Badger Eric Norman
• Paek Timothy Seung Yoon
• Microsoft Technology Licensing Llc

Inventors

• Rudchenko Dmytro
• Badger Eric Norman
• Paek Timothy Seung Yoon

Classifications

• A63F13/426

  involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun · CPC title

• H04M1/27475

  using interactive graphical means or pictorial representations · CPC title

• A63F13/422 Primary

  automatically for the purpose of assisting the player, e.g. automatic braking in a driving game · CPC title

• A63F2300/6027

  using adaptive systems learning from user actions, e.g. for skill level adjustment · CPC title

• A63F2300/6054

  by generating automatically game commands to assist the player, e.g. automatic braking in a driving game · CPC title