Automatic generation of time-lapse videos

Patent metadata

Field	Value
Publication number	US-2016343402-A1
Application number	US-201514719170-A
Country	US
Kind code	A1
Filing date	May 21, 2015
Priority date	May 21, 2015
Publication date	Nov 24, 2016
Grant date	—

Abstract

Embodiments of the present invention provide systems, methods, and computer storage media directed to operations to facilitate generation of time-lapse videos. In accordance with embodiments described herein, frames of a photographic input are analyzed to detect activity occurring across frame pairs. The photographic input, such as video input, is input for which a time-lapse video is to be generated. Activity detected across frame pairs is used to automatically select a plurality of the frames for use in generating the time-lapse video. At least a portion of the frames selected in accordance with the activity detected across frame pairs is used to generate the time-lapse video.

First claim

What is claimed is:

1 . One or more computer storage media storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations to facilitate generation of time-lapse videos, the method comprising:
analyzing frames of a photographic input to detect activity occurring across frame pairs, the photographic input being input for which a time-lapse video is to be generated; utilizing activity detected across frame pairs to automatically select a plurality of the frames to use in generating the time-lapse video; and generating the time-lapse video using at least the plurality of frames selected in accordance with the activity detected across frame pairs.

2 . The one or more computer storage media of claim 1 , wherein each of the frame pairs comprises a pair of consecutive frames within the photographic input.

3 . The one or more computer storage media of claim 1 , wherein the photographic input comprises video input.

4 . The one or more computer storage media of claim 1 , wherein the activity comprises a movement of one or more interest points occurring across frame pairs.

5 . The one or more computer storage media of claim 1 , wherein the activity comprises a color change or luminance change occurring across frame pairs.

6 . The one or more computer storage media of claim 1 , wherein the plurality of frames are selected when the activity detected across frame pairs exceeds a change threshold.

7 . The one or more computer storage media of claim 1 further comprising providing the generated time-lapse video to a user device.

8 . The one or more computer storage media of claim 1 further comprising causing display of the generated time-lapse video via a display screen.

9 . A computer-implemented method to facilitate generation of time-lapse videos, the method comprising:
analyzing each pair of consecutive frames within a video input to detect a change of motion between consecutive frames related to one or more interest points within the consecutive frames; using the changes of motion between consecutive frames to select one or more frames to generate a time-lapse video; and generating the time-lapse video using at least the selected one or more frames.

10 . The method of claim 9 , wherein the one or more interest points correspond with one or more objects in motion in the video input.

11 . The method of claim 9 , wherein a point tracking algorithm is used to track the one or more interest points and calculate the change of motion between consecutive frames.

12 . The method of claim 9 , wherein the changes of motion between consecutive frames is used to select the one or more frames by comparing the changes of motion to a change threshold, wherein the one or more frames are selected when the changes of motion exceed the change threshold.

13 . The method of claim 9 further comprising providing the time-lapse video for presentation.

14 . A computer-implemented method to facilitate generation of time-lapse videos, the method comprising:
for each pair of consecutive frames associated with a photographic input, determining an extent of activity, wherein the extent of activity comprises a first activity associated with movement of one or more interest points across a pair of consecutive frames and a second activity associated with a color change across the pair of consecutive frames; aggregating the extent of activity for the pairs of consecutive frames to determine a global extent of activity across the photographic input; utilizing the global extent of activity across the photographic input to identify a threshold of change; comparing the threshold of change to the extent of activity for the pairs of consecutive frames to select one or more frames of the photographic input for using to generate a time-lapse video; and extracting and compiling the one or more selected frames to generate the time-lapse video.

15 . The method of claim 14 , wherein the threshold of change comprises the global extent of activity divided by one less than a number of frames to output in the time-lapse video.

16 . The method of claim 15 , wherein the number of frames to output in the time-lapse video is provided by a user or derived based on input provided by a user.

17 . The method of claim 14 , wherein the one or more frames are selected in association with a sum of extents of activity for pairs of consecutive frames equals or exceeds the threshold of change.

18 . The method of claim 14 further comprising selecting at least one frame from the photographic input for use in generating the time-lapse video when a predetermined extent of frames are surpassed without a selection of a frame for the time-lapse video.

19 . The method of claim 14 further comprising receiving a desired length for the time-lapse video and generating the time-lapse video in accordance with the desired length.

20 . The method of claim 14 further comprising causing display of the time-lapse video.

Assignees

• Adobe Systems Inc

Inventors

• Singhal Puneet
• Shah Abhishek

Classifications

• G06T7/408

  Physics · mapped topic

• G11B27/005 Primary

  Reproducing at a different information rate from the information rate of recording (for television signals H04N5/783) · CPC title

• H04N5/915

  for field- or frame-skip recording or reproducing · CPC title

• G06K9/00765

  Physics · mapped topic

• G11B27/031

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title