Generation of salient contours using live video

Patent metadata

Field	Value
Publication number	US-2016358034-A1
Application number	US-201615242080-A
Country	US
Kind code	A1
Filing date	Aug 19, 2016
Priority date	Mar 12, 2015
Publication date	Dec 8, 2016
Grant date	—

Abstract

In various implementations, a computing device is configured to provide a live preview of salient contours generated on a live digital video feed. In particular, a designer can use a computing device with a camera, such as a smart phone, to view a real-time preview of salient contours generated from edges detected in frames of a live digital video feed prior to capture, thereby eliminating the unpredictability of salient contours generated from a previously captured image. In some implementations, the salient contours are overlaid on a greyscale conversion of the live digital video feed for improved processing and visual contrast. Other implementations modify aspects of edge-detecting or post-processing filters for improved performance on mobile computing devices.

First claim

What is claimed is:

1 . A non-transitory computer storage medium storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations for previewing salient contours, the operations comprising:
providing for display a first preview, the first preview including a first frame of a digital video feed having overlaid thereon at least one detected edge and corresponding adjacent gradients detected from the first frame of the digital video feed; inverting the digital video feed in response to a received user input; and providing for display a second preview, the second preview including a second frame of the digital video feed and having overlaid thereon a modified at least one detected edge and corresponding adjacent gradients detected from the second frame of the inverted digital video feed.

2 . The non-transitory computer storage medium of claim 1 , wherein the digital video feed is live.

3 . The non-transitory computer storage medium of claim 1 , wherein the first frame and the second frame are each provided for display in greyscale.

4 . The non-transitory computer storage medium of claim 3 , wherein the at least one detected edge and corresponding adjacent gradients, and the modified at least one detected edge and corresponding adjacent gradients, are each provided for display utilizing a bright, solid color to clearly contrast with the respective frame.

5 . The non-transitory computer storage medium of claim 1 , wherein the at least one detected edge and the modified at least one detected edge are each detected utilizing an edge-detecting filter.

6 . The non-transitory computer storage medium of claim 5 , wherein the corresponding adjacent gradients are detected utilizing a plurality of filters configured to collectively preserve at least some color gradient information corresponding to at least some pixels adjacent to either one of the at least one detected edge and the modified at least one detected edge to detect the corresponding adjacent gradients.

7 . The non-transitory computer storage medium of claim 1 , wherein the first preview and the second preview are each a preview of salient contours to be generated from a respective frame of the digital video feed.

8 . A non-transitory computer storage medium storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations for previewing salient contours, the operations comprising:
providing for display a first preview, the first preview including a first frame of a digital video feed having overlaid thereon at least one detected edge and corresponding adjacent gradients detected with a plurality of filters; adjusting at least one of the filters in response to a received user input; and providing for display a second preview, the second preview including a second frame of the digital video feed having overlaid thereon a modified at least one detected edge and corresponding adjacent gradients detected with the plurality of filters having the at least one adjusted filter.

9 . The non-transitory computer storage medium of claim 8 , the at least one detected edge being detected utilizing an edge-detecting filter.

10 . The non-transitory computer storage medium of claim 8 , the plurality of filters being configured to collectively preserve at least some gradient information corresponding to at least some pixels adjacent to the at least one detected edge to detect the corresponding adjacent gradients.

11 . The non-transitory computer storage medium of claim 10 , the plurality of filters including a first filter operable to generate at least some progressive gradients adjacent to the at least one detected edge.

12 . The non-transitory computer storage medium of claim 11 , the first filter being a Gaussian blur filter.

13 . The non-transitory computer storage medium of claim 11 , the plurality of filters further including a second filter operable to intensify contrast in color values associated with the at least some progressive gradients generated by the first filter.

14 . The non-transitory computer storage medium of claim 13 , the second filter being a modified threshold filter configured to intensify color values.

15 . A non-transitory computer storage medium storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations for capturing salient contours, the operations comprising:
detecting, in a frame of a digital video, at least one edge and adjacent gradients; and providing for display the frame of the digital video having overlaid thereon the at least one detected edge and corresponding adjacent gradients; capturing the at least one detected edge and the corresponding adjacent gradients in response to a received user input; and converting the captured at least one detected edge and corresponding adjacent gradients into at least one smooth vector graphic.

16 . The non-transitory computer storage medium of claim 15 , wherein the at least one detected edge is detected utilizing an edge-detecting filter.

17 . The non-transitory computer storage medium of claim 16 , wherein the corresponding adjacent gradients is detected utilizing a plurality of filters configured to collectively preserve at least some gradient information corresponding to at least some pixels adjacent to the at least one detected edge to detect the corresponding adjacent gradients.

18 . The non-transitory computer storage medium of claim 17 , wherein the plurality of filters include a first filter operable to generate at least some progressive gradients adjacent to the at least one detected edge.

19 . The non-transitory computer storage medium of claim 18 , wherein the plurality of filters further include a second filter operable to intensify contrast in color values associated with the at least some progressive gradients generated by the first filter.

20 . The non-transitory computer storage medium of claim 17 , the plurality of filters including a Gaussian blur filter and a modified threshold filter.

Assignees

• Adobe Systems Inc

Inventors

• Jain Atishay
• Mehta Shamit Kumar
• Garg Stakshi Jindal
• Dowd Geoffrey Charles
• Behzadi Arian
• Andolina Joseph Michael
• Ericksen David

Classifications

• G06V10/462

  Salient features, e.g. scale invariant feature transforms [SIFT] · CPC title

• G06T7/13 Primary

  Edge detection · CPC title

• H04N23/633

  for displaying additional information relating to control or operation of the camera · CPC title

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• H04N23/632

  for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters · CPC title