Kinematic and morpometric analysis of digitized handwriting tracings

Patent metadata

Field	Value
Publication number	US-10410041-B2
Application number	US-201515310637-A
Country	US
Kind code	B2
Filing date	May 12, 2015
Priority date	May 12, 2014
Publication date	Sep 10, 2019
Grant date	Sep 10, 2019

Abstract

The present invention is directed to a computer application for analyzing handwriting. The handwriting is digitized by being captured by a computing device such as a tablet. The application analyzes four components of the digitized handwriting. The initial component provides real-time writing speed feedback to the subject. The second fully automated component computes a variety of kinematic measures based on periods of time when the subject is writing versus the pen being off the tablet. A third component is able to concatenate pen strokes into user defined characters and assesses character and/or word spacing based on preset distances. For the fourth component, a 2-dimensional version of the large deformation diffeomorphic metric mapping (LDDMM) method is used to compare each character to a template character. Together, these components can be used to assess handwriting for a broad range of applications.

First claim

What is claimed is:

1. A non-transitory computer readable medium storing instructions comprising:
one or more instructions that, when executed by one or more processors, cause the one or more processors to:
provide, via an interface of a device, a worksheet to a subject,
the worksheet including one or more template writing characters;

provide instructions to the subject to reproduce the one or more template writing characters provided in the worksheet to produce one or more reproduced writing characters;
collect data related to the one or more reproduced writing characters,
the data including morphometric data related to the one or more reproduced writing characters:
the morphometric data related to the one or more writing characters including:
 an overall form associated with the one or more reproduced writing characters,
 a size associated with the one or more reproduced writing characters, and
 a pitch associated with the one or more reproduced writing characters;

analyze the morphometric data related to the one or more reproduced writing characters,
the morphometric data related to the one or more reproduced writing characters being compared to data associated with a corresponding predefined template character,
the overall form associated with the one or more reproduced writing characters being analyzed based upon large deformation diffeomorphic metric mapping (LDDMM) to determine a degree of letter deformation to match the one or more reproduced writing characters to the corresponding predefined template character; and

transmit an assessment of the one or more reproduced writing characters based upon analyzing the morphometric data,
the assessment including results of the analysis compared to population normalized measures.

2. The non-transitory computer readable medium of claim 1 , where the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:
set a user defined speed threshold at which the subject is to reproduce the one or more reproduced writing characters; and
notify the subject when a speed at which the subject reproduces the one or more reproduced writing characters exceeds the user defined speed threshold.

3. The non-transitory computer readable medium of claim 1 , where the data related to the one or more reproduced writing characters includes kinematics data, and
where the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:
analyze the kinematics data related to the one or more reproduced writing characters.

4. The non-transitory computer readable medium of claim 3 , where the kinematics data related to the one or more reproduced writing characters includes:
speed of producing the one or more reproduced writing characters,
one or more velocity inflections,
an acceleration to deceleration ratio,
ballisticity, and
a spectral power.

5. The non-transitory computer readable medium of claim 1 , where the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:
upload the data related to the one or more reproduced writing characters to a cloud-type server.

6. The non-transitory computer readable medium of claim 1 , where the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:
analyze kinematics data and the morphometric data in parallel.

7. The non-transitory computer readable medium of claim 1 , where the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:
provide instructions to the subject to use a stylus.

8. The non-transitory computer readable medium of claim 1 , where the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:
provide instructions to a user associated with the device to enter data related to the subject.

9. The non-transitory computer readable medium of claim 1 , where the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:
analyze the morphometric data to determine letter to letter spacing and letter to guideline spacing, the letter to letter spacing and letter to guideline spacing being compared to a predefined spacing template.

10. A computing device, comprising:
a user interface;
one or more memories; and
one or more processors, communicatively coupled to the one or more memories to:
provide, via the user interface, a worksheet to a subject, the worksheet including one or more template writing characters;
provide instructions to the subject to reproduce the one or more template writing characters presented in the worksheet;
receive data related to the one or more reproduced writing characters, the data being associated with morphometric data, the morphometric data including:
an overall form associated with the one or more reproduced writing characters,
a size associated with the one or more reproduced writing characters, and
a pitch associated with the one or more reproduced writing characters;

analyze the morphometric data related to the one or more reproduced writing characters, the morphometric data related to the one or more reproduced writing characters being compared to data associated with a corresponding predefined template character, the overall form associated with the one or more reproduced writing characters being analyzed based upon large deformation diffeomorphic metric mapping (LDDMM) to determine a degree of letter deformation required to match the one or more reproduced writing characters to the corresponding predefined template character; and
produce an assessment of the one or more reproduced writing characters, the assessment including results of the analysis compared to population normalized measures.

11. The computing device of claim 10 , where the one or more processors are further to:
set a user defined speed threshold at which the subject is to reproduce the one or more reproduced writing characters; and
notify the subject when a speed at which the subject reproduces the one or more reproduced writing characters exceeds the user defined speed threshold.

12. The computing device of claim 10 , where the data related to the one or more reproduced writing characters includes kinematics data, and
where the one or more processors are further to:
analyze the kinematics data related to the one or more reproduced writing characters.

13. The computing device of claim 12 , where the kinematics data includes:
speed of producing the one or more reproduced writing characters,
one or more velocity inflections,
an acceleration to deceleration ratio,
ballisticity, and
spectral power.

14. The computing device of claim 10 , where the one or more processors are further to:
upload the data related to the one or more reproduced writing characters to a cloud-type server.

15. The computing device of claim 10 , where the one or more processors are further to:
analyze kinematics data and the morphometric data in parallel.

16. The computing device of claim 10 , where the one or more processors are further to:
analyze the morphometric data to determine letter to letter spacing and letter to guideline spacing, the letter to letter spacing and letter to guideline spacing being compared to a predefined spacing template.

17. A method, comprising:
providing, via an interface of a device, a worksheet to a subject, the works

Assignees

• Univ Johns Hopkins
• Kennedy Krieger Inst Inc

Inventors

• Mostofsky Stewart
• Dirlikov Benjamin
• Miller Michael I
• Younes Elie Laurent

Classifications

• A61B5/6898

  Portable consumer electronic devices, e.g. music players, telephones, tablet computers · CPC title

• A61B5/7246

  using correlation, e.g. template matching or determination of similarity · CPC title

• G09B11/04

  Guide sheets or plates; Tracing charts (templets for drawing purposes B43L13/20) · CPC title

• A61B5/1124

  Determining motor skills · CPC title

• A61B5/168

  Evaluating attention deficit, hyperactivity · CPC title