Handwriting recognition method and apparatus

Patent metadata

Field	Value
Publication number	US-10438080-B2
Application number	US-201615550974-A
Country	US
Kind code	B2
Filing date	Feb 11, 2016
Priority date	Feb 12, 2015
Publication date	Oct 8, 2019
Grant date	Oct 8, 2019

Abstract

A method of generating handwriting information about handwriting of a user includes determining a first writing focus and a second writing focus; sequentially shooting a first local writing area, which is within a predetermined range from a first writing focus, and a second local writing area, which is within a predetermined range from a second writing focus; obtaining first handwriting from the first local writing area and second handwriting from the second local writing area; combining the first handwriting with the second handwriting; and generating the handwriting information, based on a result of the combining.

First claim

The invention claimed is:

1. An apparatus for providing handwriting information about handwriting of a user, the apparatus comprising:
a camera; and
at least one processor configured to:
obtain a user input,
obtain sequentially, using the camera, a first local writing area which is within a predetermined range from a first writing focus, and a second local writing area which is within a predetermined range from a second writing focus,
identify the first writing focus and the second writing focus,
obtain first handwriting from the first local writing area,
obtain second handwriting from the second local writing area,
combine the first handwriting with the second handwriting, and
provide handwriting information, based on a result of the combining.

2. The apparatus of claim 1 , wherein the processor is further configured to:
trace a visual focus of the user, and
identify the first writing focus and the second writing focus, based on the traced visual focus.

3. The apparatus of claim 1 , wherein the processor is further configured to:
obtain information about a color of handwriting from the user, and
obtain the first handwriting from the first local writing area and the second handwriting from the second local writing area, based on information about the color of the handwriting.

4. The apparatus of claim 1 , wherein the processor is further configured to:
compare the first handwriting with the second handwriting,
identify changed handwriting between a captured image frame of the first local writing area and a captured image frame of the second local writing area, based on a result of the comparing, and
combine the changed handwriting, based on a result of the determining.

5. The apparatus of claim 4 , wherein the processor is further configured to:
determine whether a pause signal is detected, stop the handwriting obtaining and the handwriting combining, based on a result of the determining, and perform monitoring.

6. The apparatus of claim 5 , wherein the processor is further configured to:
determine whether a pause signal is received, based on whether the changed handwriting between the captured image frame of the first local writing area and the captured image frame of the second local writing area or the tip of the writing tool is detected, whether a changing angle of the head posture of the user exceeds a predetermined value, whether a distance between the visual focus of the user and the writing focus exceeds a predetermined value, and whether a pause instruction was received.

7. The apparatus of claim 1 , wherein
the handwriting information comprises at least one of time sequence information of local handwriting and layout information,
the handwriting information is stored in at least one format from among a document format, an image format, and a video format, and
the layout information comprises line break information and identifier information of at least one of a deleting identifier, a replacement identifier, a repeat characteristic identifier, an insertion identifier, a position adjusting identifier, and an emphasis identifier.

8. The apparatus of claim 1 , wherein the processor is further configured to:
obtain audio data generated while the first local writing area and the second local writing area are being sequentially obtained, and
provide the handwriting information such that the obtained audio data corresponds to the first handwriting and the second handwriting.

9. The apparatus of claim 8 , wherein the processor is further configured to:
provide the handwriting information such that audio data received between a shooting time of the first local area and a shooting time of the second local area corresponds to changed handwriting between a captured image frame of the first local writing area and a captured image frame of the second local writing area.

10. The apparatus of claim 1 , wherein the processor is further configured to:
apply an enhancement process to the obtained first handwriting and the obtained second handwriting,
the enhancement process is applicable when light brightness or definition during shooting does not meet a pre-defined requirement, when a thickness of the obtained first or second handwriting is smaller than a pre-defined value, or when a difference between a color of handwriting in a captured image and a background color is smaller than a predefined value, and
the enhancement process removes a stroke whose confidence evaluation value is lower than a threshold from among at least one stroke included in the first handwriting and the second handwriting.

11. A method of providing handwriting information about handwriting of a user, the method comprising:
identifying, by at least one processor of an apparatus, a first writing focus and a second writing focus;
obtaining sequentially, by the at least one processor, by using a camera of the apparatus, a first local writing area which is within a predetermined range from a first writing focus, and a second local writing area which is within a predetermined range from a second writing focus;
obtaining, by the at least one processor, first handwriting from the first local writing area and second handwriting from the second local writing area;
combining, by the at least one processor, the first handwriting with the second handwriting; and
providing, by the at least one processor, the handwriting information, based on a result of the combining.

12. The method of claim 11 , wherein identifying the first writing focus and the second writing focus comprises:
tracing a tip of a writing tool;
identifying a position of the tip of the writing tool; and
identifying the first writing focus and the second writing focus, based on the identified position of the tip of the writing tool.

13. The method of claim 11 , wherein obtaining the first handwriting from the first local writing area and the second handwriting from the second local writing area comprises obtaining the first handwriting from the first local writing area and the second handwriting from the second local writing area, based on a difference between a handwriting color and a color of a writing background.

14. The method of claim 11 , further comprising:
determining whether an ending signal is detected; and
ending the handwriting obtaining, the handwriting combining, and the providing of the handwriting information, based on a result of the determining.

15. A computer program product comprising a non-transitory computer readable storage medium comprising instructions to cause a computing device to perform a method of providing handwriting information about handwriting of a user, the method comprising:
identifying a first writing focus and a second writing focus;
obtaining sequentially a first local writing area which is within a predetermined range from a first writing focus, and a second local writing area which is within a predetermined range from a second writing focus;
obtaining first handwriting from the first local writing area and second handwriting from the second local writing area;
combining the first handwriting with the second handwriting; and
providing the handwriting information, based on a result of the combining.

16. The method of claim 15 , wherein obtaining the first handwriting from the first local writing area and the second handwriting from the second local writing area comprises obtaining the first handwriting from the first local writing area and the second handwriting from the second local writing area, based on a difference between a handwriting color and a color of a writing backg

Assignees

• Samsung Electronics Co Ltd

Inventors

• Shan Yuxiang
• Liu Chuanxiao
• Chen Youxin

Classifications

• G06V30/1423

  the instrument generating sequences of position coordinates corresponding to handwriting (preprocessing or recognising digital ink G06V30/32) · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06V10/235

  based on user input or interaction · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title