Automated seamless video loop

Patent metadata

Field	Value
Publication number	US-2018090172-A1
Application number	US-201615275120-A
Country	US
Kind code	A1
Filing date	Sep 23, 2016
Priority date	Sep 23, 2016
Publication date	Mar 29, 2018
Grant date	—

Abstract

Techniques and devices for creating an AutoLoop output video include performing pregate operations. The AutoLoop output video is created from a set of frames. Prior to creating the AutoLoop output video, the set of frames are automatically analyzed to identify one or more image features that are indicative of whether the image content in the set of frames is compatible with creating a video loop. Pregate operations assign one or more pregate scores for the set of frames based on the one or more identified image features, where the pregate scores indicate a compatibility to create the video loop based on the identified image features. Pregate operations automatically determine to create the video loop based on the pregate scores and generate an output video loop based on the loop parameters and at least a portion of the set of frames.

First claim

1 . A non-transitory program storage device, readable by one or more programmable control devices and comprising instructions stored thereon to cause the programmable control devices to:
obtain a set of frames; automatically analyze the set of frames to identify one or more image features, the image features indicative of whether image content in the set of frames is compatible with creating a video loop; assign, prior to determining a plurality of loop parameters for the video loop, one or more pregate scores for the set of frames based on the one or more identified image features, the one or more pregate scores indicative of a compatibility of the set of frames to create the video loop based on the one or more identified image features; automatically determine the loop parameters based on a determination that the pregate scores indicate the set of frames are compatible to create the video loop, wherein determining the loop parameters includes determining similarities between one or more pairs of frames of the set of frames; and generate an output video loop based on the loop parameters and at least a portion of the set of frames.

2 . The non-transitory program storage device of claim 1 , wherein the instructions further cause the programmable control devices to:
subsample, at a sampling rate, the set of frames to generate a second set of frames, wherein a number frames of the second set of frames is less than a number of frames of the set of frames; and generate the output video loop based on the second set of frames.

3 . The non-transitory program storage device of claim 1 , wherein the instructions further cause the programmable control devices to:
determine whether a number of frames in the set of frames exceeds a preprocessing threshold; reduce the number of frames within the set of frames to generate a subset of frames; and generate the output video loop based on the subset of frames.

4 . The non-transitory program storage device of claim 1 , wherein the instructions further cause the programmable control devices to:
identify a point-of-interest within the set of frames that is capable of being stabilized based on a stabilization operation; select a subset of the set of frames based on the point-of-interest; and generate the output video loop based on the subset of the set of frames.

5 . The non-transitory program storage device of claim 4 , wherein the instructions further cause the programmable control devices to remove frames from the output video loop that are unable to be stabilized based on the stabilization operation.

6 . The non-transitory program storage device of claim 1 , wherein the instructions to automatically analyze the set of frames comprise instructions that cause the programmable control devices to analyze the set of frames with one or more detectors.

7 . The non-transitory program storage device of claim 6 , wherein the one or more detectors include a junk detector, face detector, a scene classifier, and a motion feature.

8 . The non-transitory program storage device of claim 1 , wherein the instructions to assign one or more pregate scores comprise instructions that cause the programmable control devices to implement a rule-based pregate classifier.

9 . The non-transitory program storage device of claim 1 , wherein the loop parameters include a start frame, a loop period, and a crossfade.

10 . A computer-implemented method for generating a video loop, comprising:
obtaining a set of frames; automatically analyzing the set of frames to identify one or more image features, the image features indicative of whether image content in the set of frames is compatible with creating a video loop; assigning, prior to determining a plurality of loop parameters for the video loop, one or more pregate scores for the set of frames based on the one or more identified image features, the one or more pregate scores indicative of a compatibility of the set of frames to create the video loop based on the one or more identified image features; automatically determining the loop parameters based on a determination that the pregate scores indicate the set of frames are compatible to create the video loop, wherein determining the loop parameters includes determining similarities between one or more pairs of frames of the set of frames; and generating an output video loop based on the loop parameters and at least a portion of the set of frames.

11 . The computer-implemented method of claim 10 , further comprising:
subsampling, at a sampling rate, the set of frames to generate a second set of frames, wherein a number frames of the second set of frames is less than a number of frames of the set of frames; and generating the output video loop based on the second set of frames.

12 . The computer-implemented method of claim 10 , further comprising:
determining whether a number of frames in the set of frames exceeds a preprocessing threshold; reducing the number of frames within the set of frames to generate a subset of frames; and generating the output video loop based on the subset of frames.

13 . The computer-implemented method of claim 10 , further comprising:
identifying a point-of-interest within the set of frames that is capable of being stabilized based on a stabilization operation; selecting a subset of the set of frames based on the point-of-interest; and generating the output video loop based on the subset of the set of frames.

14 . The computer-implemented method of claim 13 , further comprising removing frames from the output video loop that are unable to be stabilized based on the stabilization operation.

15 . The computer-implemented method of claim 10 , wherein automatically analyzing the set of frames comprises analyzing the set of frames with one or more detectors, wherein the one or more detectors include a junk detector, face detector, a scene classifier, and a motion feature.

16 . An electronic device comprising:
an image sensor, a memory operatively coupled to the image sensor, and one or more processors operatively coupled to the memory and the image sensor, wherein the one or more processors are programmed to:
obtain a set of frames;
automatically analyze the set of frames to identify one or more image features, the image features indicative of whether image content in the set of frames is compatible with creating a video loop;
assign, prior to determining a plurality of loop parameters for the video loop, one or more pregate scores for the set of frames based on the one or more identified image features, the one or more pregate scores indicative of a compatibility of the set of frames to create the video loop based on the one or more identified image features;
automatically determine the loop parameters based on a determination that the pregate scores indicate the set of frames are compatible to create the video loop, wherein determining the loop parameters includes determining similarities between one or more pairs of frames of the set of frames; and
generate an output video loop based on the of loop parameters and at least a portion of the set of frames.

17 . The electronic device of claim 16 , wherein the one or more processors are further programmed to:
subsample, at a sampling rate, the set of frames to generate a second set of frames, wherein a number frames of the second set of frames is less than a number of frames of the set of frames; and generate the output video loop based on the second set of frames.

18 . The electronic device of claim 16 , wherein the

Assignees

• Apple Inc

Inventors

• Bradley Arwen V
• Noble Samuel G
• Van Der Merwe Rudolph
• Klivington Jason
• Mitchell Douglas P

Classifications

• G11B27/19

  by using information detectable on the record carrier · CPC title

• G11B27/34

  Indicating arrangements  {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} · CPC title

• G11B27/031

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title

• G11B27/007 Primary

  reproducing continuously a part of the information, i.e. repeating · CPC title

• G11B27/034

  on discs (G11B27/036, G11B27/038 take precedence) · CPC title