Systems and methods for generating time-lapse videos

Patent metadata

Field	Value
Publication number	US-12211520-B2
Application number	US-202318364637-A
Country	US
Kind code	B2
Filing date	Aug 3, 2023
Priority date	May 14, 2018
Publication date	Jan 28, 2025
Grant date	Jan 28, 2025

Abstract

Video content may be captured by an image capture device during a capture duration. The video content may include video frames that define visual content viewable as a function of progress through a progress length of the video content. Rotational position information may characterize rotational positions of the image capture device during the capture duration. Time-lapse video frames may be determined from the video frames of the video content based on a spatiotemporal metric. The spatiotemporal metric may characterize spatial smoothness and temporal regularity of the time-lapse video frames. The spatial smoothness may be determined based on the rotational positions of the image capture device corresponding to the time-lapse video frames, and the temporal regularity may be determined based on moments corresponding to the time-lapse video frames. Time-lapse video content may be generated based on the time-lapse video frames.

First claim

What is claimed is:

1. An image capture device for generating time-lapse videos, the image capture device comprising:
a housing;
an image sensor carried by the housing and configured to generate an image output signal conveying image information based on light that becomes incident thereon, the image information defining video frames;
an optical element carried by the housing and configured to guide light within a field of view to the image sensor; and
one or more physical processors configured by machine-readable instructions to:
determine time-lapse video frames from the video frames for generation of time-lapse video content, wherein the time-lapse video frames are determined based on regularity and/or consistency in spatial positions of the housing during capture of the video frames and based on regularity and/or consistency in time at which the video frames are captured, wherein determination of the time-lapse video frames from the video frames is limited by a lower skipping bound and an upper skipping bound, the lower skipping bound defining a minimum number of video frames for skipping and the upper skipping bound defining a maximum number of video frames for skipping in the determination of the time-lapse video frames from the video frames, the lower skipping bound and the upper skipping bound establishing a range of the video frames from which next time-lapse video frame is determined, wherein the determination of the time-lapse video frames from the video frames being limited by the lower skipping bound and the upper skipping bound includes the video frames outside the range of video frames not being captured by the image capture device; and
generate the time-lapse video content based on the time-lapse video frames.

2. The image capture device of claim 1 , wherein the time-lapse video frames are determined based on regularity and/or consistency in spatial positions of the housing during capture of the video frames to increase spatial smoothness of the time-lapse video frames.

3. The image capture device of claim 2 , wherein the spatial smoothness is determined further based on one or more transformations applied to the time-lapse video frames.

4. The image capture device of claim 1 , wherein temporal regularity of the time-lapse video frames is determined based on the moments corresponding to the time-lapse video frames, and the time-lapse video frames are determined to respect one or more constraints on the temporal regularity of the time-lapse video frames.

5. The image capture device of claim 4 , wherein the temporal regularity of the time-lapse video frames includes an extent of uniformity in temporal spacing of the moments corresponding to the time-lapse video frames.

6. The image capture device of claim 4 , wherein the temporal regularity of the time-lapse video frames includes an extent of match between perceived speed-up provided by the time-lapse video frames and desired speed-up for the time lapse video content.

7. The image capture device of claim 1 , wherein the one or more physical processors are, to determine the time-lapse video frames, further configured to:
select a set of video frames; and
stabilize at least some of the set of video frames.

8. The image capture device of claim 1 , wherein the time-lapse video content is generated based on storage of one or more sets of video frames in a frame selection buffer and a stabilization buffer.

9. The image capture device of claim 8 , wherein the frame selection buffer includes first memory to store video frames for use in determining the time-lapse video frames and the stabilization buffer includes second memory to store video frames for use in stabilizing the time-lapse video frames.

10. A method for generating time-lapse videos, the method performed by an image capture device, the image capture device including one or more processors, an image sensor, and an optical element, the image sensor configured to generate an image output signal conveying image information based on light that becomes incident thereon, the image information defining video frames, the optical element configured to guide light within a field of view to the image sensor, the method comprising:
determining time-lapse video frames from the video frames for generation of time-lapse video content, wherein the time-lapse video frames are determined based on regularity and/or consistency in spatial positions of the image capture device during capture of the video frames and based on regularity and/or consistency in time at which the video frames are captured, wherein determination of the time-lapse video frames from the video frames is limited by a lower skipping bound and an upper skipping bound, the lower skipping bound defining a minimum number of video frames for skipping and the upper skipping bound defining a maximum number of video frames for skipping in the determination of the time-lapse video frames from the video frames, the lower skipping bound and the upper skipping bound establishing a range of the video frames from which next time-lapse video frame is determined, wherein the determination of the time-lapse video frames from the video frames being limited by the lower skipping bound and the upper skipping bound includes the video frames outside the range of video frames not being captured by the image capture device; and
generating the time-lapse video content based on the time-lapse video frames.

11. The method of claim 10 , wherein the time-lapse video frames are determined based on regularity and/or consistency in spatial positions of the image capture device during capture of the video frames to increase spatial smoothness of the time-lapse video frames.

12. The method of claim 11 , wherein the spatial smoothness is determined further based on one or more transformations applied to the time-lapse video frames.

13. The method of claim 10 , wherein temporal regularity of the time-lapse video frames is determined based on the moments corresponding to the time-lapse video frames, and the time-lapse video frames are determined to respect one or more constraints on the temporal regularity of the time-lapse video frames.

14. The method of claim 13 , wherein the temporal regularity of the time-lapse video frames includes an extent of uniformity in temporal spacing of the moments corresponding to the time-lapse video frames.

15. The method of claim 13 , wherein the temporal regularity of the time-lapse video frames includes an extent of match between perceived speed-up provided by the time-lapse video frames and desired speed-up for the time lapse video content.

16. The method of claim 10 , wherein determining the time-lapse video frames includes:
selecting a set of video frames; and
stabilizing at least some of the set of video frames.

17. The method of claim 10 , wherein the time-lapse video content is generated based on storage of one or more sets of video frames in a frame selection buffer and a stabilization buffer.

18. The method of claim 17 , wherein the frame selection buffer includes first memory to store video frames for use in determining the time-lapse video frames and the stabilization buffer includes second memory to store video frames for use in stabilizing the time-lapse video frames.

19. An image capture device for generating time-lapse videos, the image capture device comprising:
a housing;
an image sensor carried by the housing and configured to generate an image output signal conveying image information based on light that becomes incident thereon, the image informatio

Assignees

• Gopro Inc

Inventors

• Derbanne Thomas
• Douady Cesar
• Karpushin Maxim

Classifications

• H04N23/6812

  based on additional sensors, e.g. acceleration sensors · CPC title

• H04N23/683

  performed by a processor, e.g. controlling the readout of an image memory · CPC title

• G11B27/34

  Indicating arrangements  {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} · CPC title

• G11B27/13

  the information being derived from movement of the record carrier, e.g. using tachometer · CPC title

• G11B27/031

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title