Sketch recognition system

Patent metadata

Field	Value
Publication number	US-9064147-B2
Application number	US-201414219176-A
Country	US
Kind code	B2
Filing date	Mar 19, 2014
Priority date	Dec 3, 2010
Publication date	Jun 23, 2015
Grant date	Jun 23, 2015

Abstract

Handwriting interpretation tools, such as optical character recognition (OCR), have improved over the years such that OCR is a common tool in business for interpreting typed text and sometimes handwritten text. OCR does not apply well to non-text-only diagrams, such as chemical structure diagrams. A method according to an embodiment of the present invention of interpreting a human-drawn sketch includes determining a local metric indicating whether a candidate symbol belongs to a certain classification based on a set of features. The set of features includes, as a feature, scores generated from feature images of the candidate symbol. Also included is determining a joint metric of multiple candidate symbols based on their respective classifications and interpreting the sketch as a function of the local and joint metrics. Sketches can be chemical composition, biological composition, electrical schematic, mechanical, or any other science- or engineering-based diagrams for which human-drawn symbols have well-known counterparts.

First claim

What is claimed is:

1. A method of detecting corners in a stroke of a hand-drawn sketch, the method comprising:
by a processor,
for each vertex in a set of vertices of a stroke, calculating a likelihood metric that the vertex is a corner;
identifying a least likely vertex based on its likelihood metric;
classifying the least likely vertex using segmentation parameters learned from training data;
determining whether the least likely vertex is classified as a corner;
if th…

Assignees

• Massachusetts Inst Technology

Inventors

• Ouyang Tom Yu
• Davis Randall

Classifications

• G06K9/00422

  Physics · mapped topic

• G06K9/00416 Primary

  Physics · mapped topic

• G06K9/00476

  Physics · mapped topic

• G06V30/36 Primary

  Physics · mapped topic

• G06V30/422

  Physics · mapped topic