Geometrically and parametrically modifying user input to assist drawing

Patent metadata

Field	Value
Publication number	US-9305382-B2
Application number	US-201414171760-A
Country	US
Kind code	B2
Filing date	Feb 3, 2014
Priority date	Feb 3, 2014
Publication date	Apr 5, 2016
Grant date	Apr 5, 2016

Abstract

Methods for providing drawing assistance to a user sketching an image include geometrically correcting and parametrically adjusting user strokes to improve their placement and appearance. As a user draws a stroke, the stroke is geometrically corrected by moving the stroke toward a feature of the image the user is intending to draw. To further improve the user strokes, parametric adjustments are made to the geometrically-corrected stroke to emphasize “correctly” drawn lines and de-emphasize “incorrectly” drawn lines.

First claim

We claim:

1. A method of providing drawing assistance to a user sketching an image by geometrically correcting and parametrically adjusting user strokes comprising:
detecting a stroke drawn by a user on a touch screen of a client device;
comparing the stroke to a guidance map of the image to identify a feature in the guidance map to which the stroke corresponds;
geometrically correcting the stroke to create a geometrically-corrected stroke;
determining, by the client device, one or more deviations of the geometrically-corrected stroke from the identified feature in the guidance map;
parametrically adjusting the geometrically-corrected stroke by emphasizing or de-emphasizing the geometrically-corrected stroke based on the deviations of the geometrically-corrected stroke from the identified feature in the guidance map; and
rendering the parametrically adjusted, geometrically-corrected stroke on the touch screen of the client device in place of the stroke drawn by the user.

2. The method as recited in claim 1 , wherein parametrically adjusting the geometrically-corrected stroke comprises emphasizing portions of the geometrically-corrected stroke with deviations less than a pre-determined threshold.

3. The method as recited in claim 2 , wherein emphasizing the geometrically-corrected stroke comprising increasing one or more of the width, opacity, or density of the geometrically-corrected stroke.

4. The method as recited in claim 1 , wherein parametrically adjusting the geometrically-corrected stroke comprises de-emphasizing portions of the geometrically-corrected stroke with deviations more than a pre-determined threshold.

5. The method as recited in claim 4 , wherein de-emphasizing the geometrically-corrected stroke comprising decreasing one or more of the width, darkness, opacity, or density of the geometrically-corrected stroke.

6. The method as recited in claim 1 , wherein determining, by the client device, the one or more deviations of the geometrically-corrected stroke from the identified feature in the guidance map comprises determining differences in position and curvature between the geometrically-corrected stroke and the identified feature in the guidance map.

7. The method as recited in claim 1 , further comprising rendering the parametrically adjusted, geometrically-corrected stroke as the user draws the stroke.

8. The method as recited in claim 1 , further comprising generating the guidance map by applying an edge detection filter to the image.

9. The method as recited in claim 8 , wherein the edge detection filter comprises an extended Difference-of-Gaussians filter.

10. The method as recited in claim 8 , wherein comparing the stroke to the guidance map of the image to identify the feature in the guidance map to which the stroke corresponds comprises determining an edge of the guidance map nearest to the stroke.

11. The method as recited in claim 1 , further comprising:
determining a variation of the stroke from the feature of the guidance map; and
at least partially maintaining the variation when geometrically correcting the stroke.

12. A system comprising:
at least one hardware processor; and
at least one non-transitory computer readable storage medium storing instructions thereon that, when executed by the at least one hardware processor, cause the system to:
detect a stroke drawn by a user;
compare the stroke to a guidance map of the image to identify a feature in the guidance map to which the stroke corresponds;
geometrically correct the stroke to create a geometrically-corrected stroke;
determine deviations of the geometrically-corrected stroke from the identified feature in the guidance map;
parametrically adjust the geometrically-corrected stroke by emphasizing or de-emphasizing the geometrically-corrected stroke based on the deviations of the geometrically-corrected stroke from the identified feature in the guidance map; and
render the parametrically adjusted, geometrically-corrected stroke on a screen of the system in place of the stroke drawn by the user.

13. The system as recited in claim 12 , wherein the instructions, when executed by the at least one hardware processor, cause the system to:
emphasize the geometrically-corrected stroke by increasing one or more of the width, opacity, darkness, or density of the geometrically-corrected stroke; and
de-emphasize the geometrically-corrected stroke by decreasing one or more of the width, opacity, darkness, or density of the geometrically-corrected stroke.

14. The system as recited in claim 13 , wherein the instructions, when executed by the at least one hardware processor, further cause the system to determine the deviations of the geometrically-corrected stroke from the identified feature in the guidance map by determining differences in position and curvature between the geometrically-corrected stroke and the identified feature in the guidance map.

15. The system as recited in claim 14 , wherein the instructions, when executed by the at least one hardware processor, further cause the system to:
determine a variation of the stroke from the feature of the guidance map; and
at least partially maintain the variation in the geometrically-corrected stroke.

16. The system as recited in claim 15 , wherein the instructions, when executed by the at least one hardware processor, further cause the system to render the parametrically-adjusted, geometrically-corrected stroke in real-time as the user draws the stroke.

17. A method of providing drawing assistance to a user sketching an image by geometrically correcting and parametrically adjusting user strokes:
identifying input points defining an input stroke drawn by a user over an image provided on a screen of a client device;
identifying guidance points from a guidance map of the image for the input points defining the input stroke;
determining, by one or more hardware processors of the client device, geometrically-corrected points for the input points based on the guidance points;
generating a geometrically-corrected stroke by fitting a line to the geometrically-corrected points;
determining, by the one or more hardware processors, deviations for the geometrically-corrected points based on a difference in position and curvature between the geometrically-corrected points and the guidance points;
de-emphasizing a first portion of the geometrically-corrected stroke corresponding to geometrically-corrected points with deviations greater than a pre-determined threshold; and
rendering the de-emphasized and geometrically-corrected stroke on the screen of the client device in place of the stroke drawn by the user.

18. The method as recited in claim 17 , further comprising emphasizing a second portion of the geometrically-corrected stroke corresponding to geometrically-corrected points with deviations less than the pre-determined threshold.

19. The method as recited in claim 18 , further comprising:
emphasizing a second portion of the geometrically-corrected stroke by increasing one or more of the width, opacity, darkness, or density of the second portion of the geometrically-corrected stroke; and
wherein de-emphasizing the first portion of the geometrically-corrected stroke comprises decreasing one or more of the width, opacity, darkness, or density of the first portion of the geometrically-corrected stroke.

20. The method as recited in claim 17 , wherein determining the geometrically-corrected points for the input points based on the guidance points comprises:
reducing a differe

Assignees

• Adobe Systems Inc

Inventors

• Winnemoeller Holger
• Xie Jun
• Li Wilmot Wei-Mau
• Hertzmann Aaron Phillip

Classifications

• G06T11/23 Primary

  using straight lines or curves · CPC title

• G06F3/01

  Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) · CPC title

• G06T2207/20012

  Locally adaptive · CPC title

• G06T11/203 Primary

  Physics · mapped topic

• G06T2207/20024

  Filtering details · CPC title