Method for freehand sketch training

Patent metadata

Field	Value
Publication number	US-11645939-B2
Application number	US-201916701012-A
Country	US
Kind code	B2
Filing date	Dec 2, 2019
Priority date	Nov 30, 2018
Publication date	May 9, 2023
Grant date	May 9, 2023

Abstract

A computer-based method and system for teaching educational sketching includes receiving a user-generated image created in response to a learning assignment and comparing the user-generated image to a solution image to identify one or more errors in the user-generated image relative to the solution image, where the errors may include additional image elements and missing image elements. Comparing is performed by providing a solution region corresponding to an acceptable variation from the solution image and identifying one or more errors based on a presence or absence of at least a portion of a corresponding element of the user-generated image within the solution region. If errors are identified and a non-passing status is determined, a hint is displayed to the user. The hint may be the correct elements of the user-generated image, a portion of the solution image, or a combination thereof.

First claim

The invention claimed is:

1. A method of providing guidance to a user of a computer-implemented educational sketching system, the method comprising:
(a) receiving in a computing device via a device interface a user-generated image created by the user in response to a learning assignment, wherein the computing device generates a graphical display comprising groupings of pixels within the graphical display, each grouping of pixels comprising an element of the user-generated image;
(b) comparing the user-generated image to a solution image stored within the computing device to identify one or more errors in the user-generated image relative to the solution image, wherein the one or more errors comprise one or more of additional image elements and missing image elements, wherein the comparing comprises, for each element of the solution image:
(i) providing a solution region comprising an area encompassing each element of the solution image, the solution region corresponding to an acceptable variation from the solution image; and
(ii) identifying one or more errors based on a presence or absence of at least a portion of a corresponding element of the user-generated image within the solution region;

(c) if one or more errors are identified, determining a magnitude of each error and comparing the magnitude of the error to a threshold;
(d) indicating a non-passing status if the magnitude of the error exceeds the threshold;
(e) if non-passing status is indicated, generating at least one graphical hint for display to the user, the at least one graphical hint comprising one or more of: (i) at least a portion of the error within the user-generated image, (ii) at least a portion of correct elements of the user-generated image, and (iii) at least a portion of the solution image;
(f) generating a prompt to the user to input a new user-generated image;
(g) repeating steps (a) through (f) until a passing status is achieved; and
(h) displaying an indication of the passing status of the user-generated image on the graphical display.

2. The method of claim 1 , wherein the device interface is selected from the group consisting of a touchscreen, a computer mouse, a trackball, a camera, an image scanner, and a motion sensor.

3. The method of claim 2 , wherein the display device comprises the device interface, and wherein the device interface is a touchscreen.

4. The method of claim 1 , wherein the user-generated image comprises one or more user-generated elements, each user-generated element comprising a corresponding contiguous grouping of pixels, wherein the solution region comprises a set of pixels, wherein the error is identified as a missing image element when a portion of the user-generated element is not present within the set of pixels.

5. The method of claim 1 , wherein the user-generated image comprises one or more user-generated elements, each user-generated element comprising a corresponding contiguous grouping of pixels, wherein the solution region comprises a set of pixels, wherein the error is identified as an additional image element when a portion of the user-generated elements is present outside of the pixel region.

6. The method of claim 1 , wherein the solution image comprises one or more dashed lines and the solution region comprises a dashed line solution region, wherein the error is identified as an excessively long dash when the user-generated element corresponding to the dashed line has one or more dashes within the dashed line solution region having a magnitude that exceeds a threshold for an acceptable dash.

7. The method of claim 1 , wherein the solution image comprises one or more dashed lines, wherein the solution region comprises a dashed line solution region, wherein the error is identified as an excessively long gap when the user-generated element corresponding to the dashed line has one or more gaps with a magnitude that exceeds a threshold for an acceptable gap.

8. The method of claim 1 , wherein the at least one hint comprises a visually encoded image displaying a solution image having visually distinguishable indicators corresponding to one or more of correct, missing and additional user-generated elements.

9. The method of claim 8 , wherein the visually perceptible indicators comprise color coded lines, wherein a different color corresponds to each of correct, missing, and additional elements.

10. The method of claim 1 , wherein the at least one hint comprises a visually encoded image displaying the user-generated image with additional visually distinguishable indicators of missing and/or additional components.

11. The method of claim 10 , wherein the visually perceptible indicators comprise color coded lines, wherein a different color corresponds to each of correct, missing, and additional lines.

12. The method of claim 1 , wherein the at least one hint comprises portions of the solution image corresponding to the correct elements of the user-generated image.

13. The method of claim 12 , wherein the at least one hint further comprises visually distinguishable image elements corresponding to portions of the solution image that are missing from the user-generated image.

14. The method of claim 12 , wherein the at least one hint further comprises visually distinguishable image elements corresponding to portions of the user-generated image that are not part of the solution image.

15. An interactive sketch education system comprising:
a computing device having a device processor and a device memory;
a device interface associated with the computing device, the device interface configured for entry of a user-generated image created by a user in response to a learning assignment, wherein the device processor has associated therewith a set of non-transitory instructions configured to cause the device processor to execute the steps of:
(a) receiving the user-generated image and generating a graphical display thereof comprising groupings of pixels, each grouping of pixels comprising an element of the user-generated image;
(b) comparing the user-generated image to a solution image stored within the device memory to identify one or more errors in the user-generated image relative to the solution image, wherein the one or more errors comprise one or more of additional image elements and missing image elements, wherein the comparing comprises, for each element of the solution image:
(i) providing a solution region comprising an area encompassing each element of the solution image, the solution region corresponding to an acceptable variation from the solution image; and
(ii) identifying one or more errors based on a presence or absence of at least a portion of a corresponding element of the user-generated image within the solution region;

(c) if one or more errors are identified, determining a magnitude of each error and comparing the magnitude of each error to a corresponding threshold;
(d) indicating a non-passing status if the magnitude of each error exceeds the threshold;
(e) if non-passing status is indicated, generating at least one graphical hint for display to the user, the at least one graphical hint comprising one or more of: (i) at least a portion of the error within the user-generated image, iii) at least a portion of correct elements of the user-generated image, and (iii) at least a portion of the solution image;
(f) generating a prompt to the user to input a new user-generated image;
(g) repeating steps (a) through (f) until a passing status is achieved; and
(h) displaying an indication of the passing status of the user-generated image on the graphical display.

16.

Assignees

• Univ California
• Nat Science Foundation

Inventors

• Delson Nathan

Classifications

• G09B5/02

  with visual presentation of the material to be studied, e.g. using film strip · CPC title

• G09B7/04 Primary

  characterised by modifying the teaching program in response to a wrong answer, e.g. repeating the question or supplying a further explanation · CPC title

• G06T7/0002

  Inspection of images, e.g. flaw detection · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G09B5/06

  with both visual and audible presentation of the material to be studied · CPC title