Advanced video editing techniques using sampling patterns

Patent metadata

Field	Value
Publication number	US-11594256-B2
Application number	US-202117323208-A
Country	US
Kind code	B2
Filing date	May 18, 2021
Priority date	Aug 30, 2017
Publication date	Feb 28, 2023
Grant date	Feb 28, 2023

Abstract

Systems and methods provide for advanced video editing techniques using sampling patterns. In one example, a computing device can receive a selection of a clip of a video and a sampling pattern. The computing device can determine a respective number of frames to sample from the clip for each interval of time over a length of time for a new clip. For example, the computing device can determine a function corresponding the pattern that relates time and the number of frames to sample, a histogram corresponding to the pattern, or a definite integral corresponding to the pattern, among other approaches. The computing device can extract these numbers of frames from the clip and generate the new clip from the extracted frames. The computing device can present the new clip as a preview and send the new clip to other computing devices.

First claim

What is claimed is:

1. A method comprising:
determining, by a computing device, individual numbers of frames to sample from a first video clip for a plurality of intervals of time based on a pattern for sampling the first video clip, the determining comprising evaluating a histogram corresponding to the pattern over the plurality of intervals of time, the histogram relating a time value and a number of frames to sample from the first clip at the time value, the pattern being associated with a video effect being applied to the first video clip;
extracting, by the computing device, a plurality of frames of the first clip using the individual numbers of frames; and
generating, by the computing device, a second clip based on the plurality of frames.

2. The method of claim 1 , wherein the number of frames at the time value is less than a frame rate of the first video and the histogram causes the first video to be sub-sampled at the time value.

3. The method of claim 1 , wherein the number of frames at the time value is greater than a frame rate of the first video and the histogram causes given frames of the first video at the time value to be interpolated.

4. The method of claim 3 , wherein the given frames of the first video at the time value are interpolated by repeating one or more of the given frames.

5. The method of claim 3 , wherein the given frames of the first video at the time value are interpolated by merging at least two of the given frames.

6. The method of claim 1 , further comprising:
displaying a selection bar and a selection slider; and
determining a selection of the first clip from the video based on a position of the selection slider relative to the selection bar.

7. The method of claim 6 , further comprising:
determining a relative length of the selection slider with respect to the selection bar based on a relationship between a first length of time of the first clip and a second length of time of the video.

8. The method of claim 1 , further comprising:
receiving an adjustment factor for determining a second length of time of the second clip relative to a first length of time of the first clip, wherein the plurality of intervals of time occur within the second length of time.

9. The method of claim 1 , further comprising:
displaying a plurality of predetermined sampling patterns; and
receiving the pattern from one of the plurality of predetermined sampling patterns.

10. The method of claim 1 , further comprising:
displaying a drawing interface; and
receiving the pattern as a drawing from the drawing interface.

11. The method of claim 1 , further comprising:
generating a third clip by reversing the plurality of frames; and
presenting the second clip and the third clip on a display of the computing device.

12. The method of claim 1 , further comprising:
receiving, at the computing device, a user input identifying a selection of a second pattern for sampling the first clip;
determining second individual numbers of frames to sample from the first clip for a second plurality of intervals of time using the second pattern;
extracting a second plurality of frames of the first clip using the second individual number of frames; and
generating a third clip using the second plurality of frames.

13. A device comprising:
one or more processors; and
memory including instructions that, upon execution by the one or more processors, cause the device to perform operations comprising:
determining individual numbers of frames to sample from a first video clip for a plurality of intervals of time based on a pattern for sampling the first video clip, the determining comprising evaluating a histogram corresponding to the pattern over the plurality of intervals of time, the histogram relating a time value and a number of frames to sample from the first clip at the time value, the pattern being associated with a video effect being applied to the first video clip;
extracting a plurality of frames of the first clip using the individual numbers of frames; and
generating a second clip based on the plurality of frames.

14. The device of claim 13 , wherein the number of frames at the time value is less than a frame rate of the first video and the histogram causes the first video to be sub-sampled at the time value.

15. The device of claim 13 , wherein the number of frames at the time value is greater than a frame rate of the first video and the histogram causes given frames of the first video at the time value to be interpolated.

16. The device of claim 15 , wherein the given frames of the first video at the time value are interpolated by repeating one or more of the given frames.

17. The device of claim 15 , wherein the given frames of the first video at the time value are interpolated by merging at least two of the given frames.

18. The device of claim 13 , wherein the operations further comprise:
displaying one or more user interface elements on a touchscreen of the device; and
receive, at the touchscreen, a length of time for the second clip from the one or more user interface elements, wherein the plurality of intervals of time occur within the length of time.

19. The device of claim 13 , wherein the operations further comprise:
receiving, at a touchscreen of the device, a selection of a second pattern for sampling the first clip;
determining second individual numbers of frames to sample from the first clip for a second plurality of intervals of time using the second pattern;
extracting a second plurality of frames of the first clip using the second individual number of frames; and
generating a third clip using the second plurality of frames.

20. A non-transitory computer-readable storage medium storing instructions that, upon execution by one or more processors of a device, cause the device to perform operations comprising:
determining individual numbers of frames to sample from a first video clip for a plurality of intervals of time based on a pattern for sampling the first video clip, the determining comprising evaluating a histogram corresponding to the pattern over the plurality of intervals of time, the histogram relating a time value and a number of frames to sample from the first clip at the time value, the pattern being associated with a video effect being applied to the first video clip;
extracting a plurality of frames of the first clip using the individual numbers of frames; and
generating a second clip based on the plurality of frames.

Assignees

• Snap Inc

Inventors

• Boyd Nathan Kenneth
• Doty Devin

Classifications

• G06V20/46

  Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames · CPC title

• H04N21/44008

  involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title

• G06V20/49

  Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes · CPC title

• G11B27/031 Primary

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title

• H04N21/8549

  Creating video summaries, e.g. movie trailer {(retrieval in video databases by using presentations in form of a video summary G06F16/739)} · CPC title