Managing real-time handwriting recognition

Patent metadata

Field	Value
Publication number	US-10346035-B2
Application number	US-201615275309-A
Country	US
Kind code	B2
Filing date	Sep 23, 2016
Priority date	Jun 9, 2013
Publication date	Jul 9, 2019
Grant date	Jul 9, 2019

Abstract

Methods, systems, and computer-readable media related to a technique for providing handwriting input functionality on a user device. A handwriting recognition module is trained to have a repertoire comprising multiple non-overlapping scripts and capable of recognizing tens of thousands of characters using a single handwriting recognition model. The handwriting input module provides real-time, stroke-order and stroke-direction independent handwriting recognition for multi-character handwriting input. In particular, real-time, stroke-order and stroke-direction independent handwriting recognition is provided for multi-character, or sentence level Chinese handwriting recognition. User interfaces for providing the handwriting input functionality are also disclosed.

First claim

What is claimed is:

1. A method, comprising:
at an electronic device having a one or more processors, a touch sensitive surface, and a display:
displaying a user input interface on the display including a message area and a stroke input area;
receiving a first set of strokes on the touch sensitive surface in the stroke input area;

determining a first single character based on the first set of strokes;
displaying the first single character in the message area;
receiving a second set of strokes on the touch sensitive surface in the stroke input area after receiving the first set of strokes and displaying the first single character;
determining revised first single character based on the first set of strokes and the second set of strokes; and
replacing the display of the first single character with the revised first single character.

2. The method of claim 1 , further comprising:
rendering the first set of strokes in the stroke input area; and
starting a fading process for the first set of strokes, wherein during the fading process, the rendering of the first set of strokes in the stroke input area becomes increasingly faded.

3. The method of claim 2 , wherein the fading process for the first set of strokes is started when a predetermined time period has elapsed after the first set of strokes is completed by the user.

4. The method of claim 2 , wherein the fading process for the first set of strokes is started when the user has started inputting the second set of strokes.

5. The method of claim 2 , wherein an end state of the fading process for the first set of strokes is a state with a predetermined minimum visibility for the first set of strokes.

6. The method of claim 2 , wherein an end state of the fading process for the first set of strokes is a state with zero visibility for the first set of strokes.

7. The method of claim 1 , wherein displaying the first single character occurs before receiving the second set of strokes.

8. The method of claim 1 , further comprising:
after receiving the second set of strokes and after displaying the revised first single character, receiving a third set of strokes on the touch sensitive surface in the stroke input area;
determining second single character based on the third set of strokes; and
displaying the second single character with the revised first single character.

9. The method of claim 1 , wherein the first set of strokes is a single continuous stroke.

10. The method of claim 1 , wherein the second set of strokes is a single continuous stroke.

11. The method of claim 1 , wherein the first single character includes a character not included in the revised first single character.

12. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a touch sensitive surface and a display, the one or more programs including instructions for:
displaying a user input interface on the display including a message area and a stroke input area;
receiving a first set of strokes on the touch sensitive surface in the stroke input area;
determining a first single character based on the first set of strokes;
displaying the first single character in the message area;
receiving a second set of strokes on the touch sensitive surface in the stroke input area after receiving the first set of strokes and displaying the first single character;
determining revised first single character based on the first set of strokes and the second set of strokes; and
replacing the display of the first single character with the revised first single character.

13. The non-transitory computer-readable storage medium of claim 12 , further including instructions for:
rendering the first set of strokes in the stroke input area; and
starting a fading process for the first set of strokes, wherein during the fading process, the rendering of the first set of strokes in the stroke input area becomes increasingly faded.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the fading process for the first set of strokes is started when a predetermined time period has elapsed after the first set of strokes is completed by the user.

15. The non-transitory computer-readable storage medium of claim 13 , wherein the fading process for the first set of strokes is started when the user has started inputting the second set of strokes.

16. The non-transitory computer-readable storage medium of claim 13 , wherein an end state of the fading process for the first set of strokes is a state with a predetermined minimum visibility for the first set of strokes.

17. The non-transitory computer-readable storage medium of claim 13 , wherein an end state of the fading process for the first set of strokes is a state with zero visibility for the first set of strokes.

18. The non-transitory computer-readable storage medium of claim 12 , wherein displaying the first single character occurs before receiving the second set of strokes.

19. The non-transitory computer-readable storage medium of claim 12 , further including instructions for:
after receiving the second set of strokes and after displaying the revised first single character, receiving a third set of strokes on the touch sensitive surface in the stroke input area;
determining second single character based on the third set of strokes; and
displaying the second single character with the revised first single character.

20. The non-transitory computer-readable storage medium of claim 12 , wherein the first set of strokes is a single continuous stroke.

21. The non-transitory computer-readable storage medium of claim 12 , wherein the second set of strokes is a single continuous stroke.

22. The non-transitory computer-readable storage medium of claim 12 , wherein the first single character includes a character not included in the revised first single character.

23. An electronic device, comprising:
a touch sensitive surface;
a display;
one or more processors; and
a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying a user input interface on the display including a message area and a stroke input area;
receiving a first set of strokes on the touch sensitive surface in the stroke input area;

determining a first single character based on the first set of strokes;
displaying the first single character in the message area;
receiving a second set of strokes on the touch sensitive surface in the stroke input area after receiving the first set of strokes and displaying the first single character;
determining revised first single character based on the first set of strokes and the second set of strokes; and
replacing the display of the first single character with the revised first single character.

24. The electronic device of claim 23 , further including instructions for:
rendering the first set of strokes in the stroke input area; and
starting a fading process for the first set of strokes, wherein during the fading process, the rendering of the first set of strokes in the stroke input area becomes increasingly faded.

25. The electronic device of claim 24 , wherein the fading process for the first set of strokes is started when a predetermined time period has elapsed after the first set of strokes is completed by the

Assignees

• Apple Inc

Inventors

• Xia Mei-Qun
• Dolfing Jannes G
• Dixon Ryan S
• Groethe Karl M
• Misra Karan
• Bellegarda Jerome R
• Meier Ueli

Classifications

• G06F40/166

  Editing, e.g. inserting or deleting · CPC title

• G06F40/274

  Converting codes to words; Guess-ahead of partial word inputs · CPC title

• G06F3/018

  Input/output arrangements for oriental characters · CPC title

• G06F3/04883 Primary

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title