Generation of salient contours using live video

Patent metadata

Field	Value
Publication number	US-2016267346-A1
Application number	US-201514645581-A
Country	US
Kind code	A1
Filing date	Mar 12, 2015
Priority date	Mar 12, 2015
Publication date	Sep 15, 2016
Grant date	—

Abstract

In various implementations, a computing device is configured to provide a live preview of salient contours generated on a live digital video feed. In particular, a designer can use a computing device with a camera, such as a smart phone, to view a real-time preview of salient contours generated from edges detected in frames of a live digital video feed prior to capture, thereby eliminating the unpredictability of salient contours generated from a previously captured image. In some implementations, the salient contours are overlaid on a greyscale conversion of the live digital video feed for improved processing and visual contrast. Other implementations modify aspects of edge-detecting or post-processing filters for improved performance on mobile computing devices.

First claim

What is claimed is:

1 . A non-transitory computer storage medium storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations for providing a live preview of salient contours associated with live digital video feed, the operations comprising:
processing a first frame of a plurality of frames in a live digital video feed through an edge-detecting filter to generate a first output, the first output including at least one edge detected within the first frame; processing the first output through a plurality of filters to generate a second output, the plurality of filters configured to collectively preserve at least some color gradient information corresponding to at least some pixels adjacent the at least one edge; and presenting the first frame with the second output as an overlay thereon, the overlay including the at least some color gradient information and providing a live preview of salient contours to be generated from the first frame.

2 . The medium of claim 1 , wherein a first filter in the plurality of filters is operable to generate at least some progressive color gradients adjacent the at least one edge.

3 . The medium of claim 2 , wherein the first filter is a Gaussian blur filter.

4 . The medium of claim 2 , wherein a second filter in the plurality of filters is operable to intensify contrast in color values associated with the progressive color gradients.

5 . The medium of claim 4 , wherein the second filter is a modified threshold filter configured to intensify color values instead of polarize color values.

6 . The medium of claim 1 , further comprising receiving the first frame of a plurality of frames in a live digital video feed, wherein the receiving of the first frame is substantially concurrent with a live optical input received from a digital camera lens.

7 . The medium of claim 1 , wherein the edge-detecting filter employs a modified eXtended Difference-of-Gaussians (xDoG) filter configured to use integer data-types instead of float data-types when processing for suitable operability with mobile computing devices.

8 . A computer-implemented method for providing a live preview of salient contours associated with a live digital video feed comprising:
processing a first frame of a plurality of frames in a live digital video feed through an edge-detecting filter to generate a first output, the first output being in greyscale and including at least one edge detected within the first frame; processing the first output through a plurality of filters to generate a second output, the plurality of filters configured to collectively preserve at least some greyscale gradient information corresponding to at least some pixels adjacent the at least one edge; and presenting the first frame with the second output as an overlay thereon, the overlay including the at least some greyscale gradient information and providing a live preview of salient contours to be generated from the first frame.

9 . The medium of claim 8 , wherein a first filter in the plurality of filters is operable to generate at least some progressive greyscale gradients adjacent the at least one edge.

10 . The medium of claim 9 , wherein the first filter is a Gaussian blur filter.

11 . The medium of claim 9 , wherein a second filter in the plurality of filters is operable to intensify contrast in greyscale values associated with the progressive greyscale gradients.

12 . The medium of claim 11 , wherein the second filter is a modified threshold filter configured to intensify greyscale values instead of polarize greyscale values to black and white.

13 . The medium of claim 8 , further comprising receiving the first frame of a plurality of frames in a live digital video feed, wherein the receiving of the first frame is substantially concurrent with a live optical input received from a digital camera lens.

14 . The medium of claim 8 , wherein the overlay is presented using a bright, solid color to clearly contrast with the first frame.

15 . A computerized system for providing a live preview of salient contours associated with a live digital video feed comprising:
one or more processors; and one or more computer storage media storing computer-usable instructions that, when used by the one or more processors, cause the one or more processors to: receive a first frame of a plurality of frames in a live digital video feed; process a first instance of the first frame through an edge-detecting filter to generate a first output, the first output including at least one edge detected within the first instance of the first frame; process the first output through a plurality of filters to generate a second output, the plurality of filters configured to collectively preserve at least some color gradient information corresponding to at least some pixels adjacent the at least one edge; present a second instance of the first frame with the second output as an overlay thereon, the overlay including the at least some color gradient information and providing a live preview of salient contours to be generated from the first frame, and wherein the first frame and overlay are presented substantially concurrently with receipt of the first frame of the live digital video feed.

16 . The computerized system of claim 15 , wherein the overlay is presented using a bright, solid color to clearly contrast with the second instance of the first frame

17 . The computerized system of claim 15 , wherein a first filter in the plurality of filters is operable to generate at least some progressive color gradients adjacent the at least one edge.

18 . The medium of claim 17 , wherein the first filter is a Gaussian blur filter.

19 . The medium of claim 17 , wherein a second filter in the plurality of filters is operable to intensify contrast in color values associated with the progressive color gradients.

20 . The medium of claim 19 , wherein the second filter is a modified threshold filter configured to intensify color values instead of polarize color values.

Assignees

• Adobe Systems Inc

Inventors

• Jain Atishay
• Mehta Shamit Kumar
• Garg Stakshi Jindal
• Dowd Geoffrey Charles
• Behzadi Arian
• Andolina Joseph Michael
• Ericksen David

Classifications

• G06V10/462

  Salient features, e.g. scale invariant feature transforms [SIFT] · CPC title

• G06T7/13 Primary

  Edge detection · CPC title

• H04N23/633

  for displaying additional information relating to control or operation of the camera · CPC title

• H04N23/632

  for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters · CPC title

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title