System and method of generating video from video clips based on moments of interest within the video clips

Patent metadata

Field	Value
Publication number	US-10748577-B2
Application number	US-201816229866-A
Country	US
Kind code	B2
Filing date	Dec 21, 2018
Priority date	Oct 20, 2015
Publication date	Aug 18, 2020
Grant date	Aug 18, 2020

Abstract

Videos may be automatically generated using a set of video clip. Individual moments of interest may be identified within individual video clips of a set of video clips. A moment of interest may correspond to a point in time within a video clip. The point in time may be associated with one or more values of one or more attributes of the video clip. Individual moments of interest may be associated with individual portions of a video. The video may be generated using the set of video clips based on the associations.

First claim

What is claimed is:

1. A system configured for generating videos from video clips, the system comprising:
one or more physical processors configured by machine-readable instructions to:
identify one or more moments of interest within individual video clips of a set of video clips for generating a video edit, the set of video clips comprising a first video clip and a second video clip such that a first moment of interest is identified within the first video clip and a second moment of interest is identified within the second video clip:
provide story themes for user selection, wherein individual ones of the story themes are defined by different sets of rules for automatically generating the video edit, the story themes including a first story theme and a second story theme different from the first story theme, the first story theme defined by a first set of rules for automatically generating the video edit and the second story theme defined by a second set of rules for automatically generating the video edit, the first set of rules being different from the second set of rules, the first set of rules and the second set of rules including different rules to identify different temporal spans of the set of video clips to be included within the video edit such that the first set of rules includes a first rule used to identify a first temporal span of the first video clip to be included within the video edit and the second set of rules includes a second rule used to identify a second temporal span of the first video clip different from the first temporal span to be included within the video edit;
based on user selection of the first story theme, automatically, and without additional user selection further defining the video edit, generate the video edit based on the one or more moments of interest within the individual video clips and the first set of rules for automatically generating the video edit; and
based on user selection of the second story theme, automatically, and without additional user selection further defining the video edit, generate the video edit based on the one or more moments of interest within the individual video clips and the second set of rules for automatically generating the video edit, the video edit generated based on the second set of rules different from the video edit generated based on the first set of rules.

2. The system of claim 1 , wherein the first moment of interest within the first video clip is identified based on a user-initiated identification of the first moment of interest.

3. The system of claim 2 , wherein the user-initiated identification of the first moment of interest is provided during capture of the first video clip or post capture of the first video clip.

4. The system of claim 1 , wherein the one or more physical processors are, to generate the video edit based on the user selection of the first story theme, further configured by the machine-readable instructions to:
identify a first segment of the first video clip, the first segment being associated with the first moment of interest, the first segment comprising a temporal span of the first video clip based on the first rule of the first set of rules;
identify a second segment of the second video clip, the second segment being associated with the second moment of interest, the second segment comprising a temporal span of the second video clip based on the first rule of the first set of rules;
provide the first segment as a first video portion of the video edit; and provide
the second segment as a second video portion of the video edit.

5. The system of claim 4 , wherein the one or more physical processors are, to provide the first segment as the first video portion of the video edit, further configured by the machine-readable instructions to change a temporal length of one or both of the first segment or the first video portion such that that the first segment and the first video portion have the same temporal length.

6. The system of claim 5 , wherein:
the first set of rules and the second set of rules include different rules for selection of supplemental audio to be added to the video edit such that the first set of rules includes a third rule used to select first supplemental audio to be added to the video edit and the second set of rules includes a fourth rule used to select second supplemental audio different from the first supplemental audio to be added to the video edit; and
the one or more physical processors are, to generate the video edit based on the user selection of the first story theme, further configured by the machine-readable instructions to provide the first supplemental audio to replace or add to audio of one or both of the first video clip or the second video clip in the video edit based on the third rule of the first set of rules.

7. The system of claim 6 , wherein:
the first set of rules and the second set of rules include different rules for synchronization of the supplemental audio to be added to the video edit such that the first set of rules includes a fifth rule used to synchronize a transition between an end of the first video portion of the video edit and a start of the second video portion of the video edit with the supplemental audio and the second set of rules includes a sixth used to synchronize the transition differently between the end of the first video portion of the video edit and the start of the second video portion of the video edit with the supplemental audio; and
the one or more physical processors are, to provide the supplemental audio based on the user selection of the first story theme, further configured by the machine-readable instructions to synchronize the transition between the end of the first video portion of the video edit and the start of the second video portion of the video edit with the first supplemental audio based on fifth rule of the first set of rules.

8. The system of claim 7 , wherein the supplemental audio comprises a song, and the synchronization of the transition between the end of the first video portion and the start of the second video portion of the video edit with the supplemental audio comprises a synchronization of the transition with a beat of the song.

9. The system of claim 7 , wherein the supplemental audio comprises a song, and the synchronization of the transition between the end of the first video portion and the start of the second video portion of the video edit with the supplemental audio comprises a synchronization of the transition with an orchestrated transition of the song.

10. The system of claim 6 , wherein quantities and lengths of video portions of the video edit are determined based on the supplemental audio.

11. A method of generating videos from video clips, the method being implemented in a computer system comprising one or more physical processor and storage media storing machine-readable instructions, the method comprising:
identifying one or more moments of interest within individual video clips of a set of video clips for generating a video edit, the set of video clips comprising a first video clip and a second video, including identifying a first moment of interest within the first video clip and a second moment of interest within the second video clip:
providing story themes for user selection, wherein individual ones of the story themes are defined by different sets of rules for automatically generating the video edit, the story themes including a first story theme and a second story theme different from the first story theme, the first story theme defined by a first set of rules for automatically generating the video edit and the second story theme defined by a second set of rules for automatical

Assignees

• Gopro Inc

Inventors

• Matias Joven
• Phan Ha

Classifications

• G06V20/47

  Detecting features for summarising video content · CPC title

• G06V20/48

  Matching video sequences · CPC title

• G06V20/41

  Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49) · CPC title

• G11B27/34

  Indicating arrangements  {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} · CPC title

• G11B27/031 Primary

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title