Automatic video segment selection method and apparatus

Patent metadata

Field	Value
Publication number	US-2018190002-A1
Application number	US-201815911106-A
Country	US
Kind code	A1
Filing date	Mar 3, 2018
Priority date	May 13, 2016
Publication date	Jul 5, 2018
Grant date	—

Abstract

Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically extracting and creating an animated Graphics Interchange Format (GIF) file from a media file. The disclosed systems and methods identify a number of GIF candidates from a video file, and based on analysis of each candidate's attributes, features and/or qualities, at least one GIF candidate is automatically selected for rendering.

First claim

1 - 20 . (canceled)

21 . A method comprising:
determining, by a computing device, an n-dimensional feature vector for each segment of a plurality of segments of a video file, the feature vector determination for the segment of the plurality comprising parsing the segment to identify information associated with context and content features of the segment, the feature vector being based on the context and content information; determining, by the computing device, a Graphics Interchange Format (GIF) suitability score for each segment of the plurality, the GIF suitability score determination for the segment of the plurality being based on the segment's feature vector, the segment's GIF suitability score being a measure of the segment's suitability for inclusion in an animated GIF file; automatically selecting, by the computing device, a number of segments of the plurality, each selected segment's GIF suitability score indicating that the selected segment is more suitable for inclusion in the animated GIF file than each unselected segment's GIF suitability score; communicating, by the computing device, information identifying the number of segments, of the plurality of segments of the video file, to a client computing device of a user for display via a graphical user interface at the client computing device; receiving, by the computing device from the client computing device, input indicative of a set of segments selected, by the user, from the number of segments for creation of an animated GIF file; and automatically creating, by the computing device, the animated GIF file using the set of segments selected by the user.

22 . The method of claim 21 , further comprising:
determining, by the computing device, the plurality of segments within the video file, the segment determination comprising parsing the video file to identify transition frames within the video file, each segment of the plurality comprising video frames of the video file existing between a pair of identified transition frames.

23 . The method of claim 22 , determination of the plurality of segments within the video file further comprising:
identifying a segment of the plurality that is longer than a predetermined threshold segment length; and identifying a number of transitions in the identified segment using a multiple change point detection (MCPD) algorithm.

24 . The method of claim 21 , further comprising:
receiving, at the computing device and via the graphical user interface, a request from a user for creation of the animated GIF file from a video file, communication of the information identifying the number of segments being performed in response to receiving the request from the user.

25 . The method of claim 21 , further comprising:
communicating, via the computing device, the animated GIF file to the client computing device of the user for display at the client computing device.

26 . The method of claim 21 , the computing device and the client computing device are the same device.

27 . The method of claim 21 , the computing device is a server computing device, of a recommendation system, in communication with the client computing device.

28 . The method of claim 21 , further comprising:
receiving, by the computing device, a request, from the client computing device, to search a plurality of animated GIF files, each animated GIF file having a quality measure determined using the GIF suitability score of at least one segment included in the animated GIF file, the request comprising a number of search terms; generating, by the computing device and using the number of search terms from the request and the quality measure of at least one animated GIF file considered in generating the search results, the search results comprising a number of animated GIF files of the plurality; and providing, by the computing device, the search results comprising the number of animated GIF files to the client computing device.

29 . The method of claim 28 , the quality measure of an animated GIF file of the plurality being determined using the GIF suitability score of one segment of the animated GIF file:

30 . The method of claim 28 , the quality measure of an animated GIF file of the plurality being a combination of the GIF suitability score of each segment of the animated GIF file:

31 . The method of claim 28 , the quality measure of an animated GIF file of the plurality being an average GIF suitability score determined using the GIF suitability score of each segment of the animated GIF file:

32 . The method of claim 28 , the quality measure of an animated GIF file of the plurality being used in ranking at least some of the number of animated GIF files in the search results.

33 . The method of claim 32 , a popularity score associated with at least one animated GIF file of the number of animated GIF files in the search results being used in ranking the number of animated GIF files in the search results:

34 . The method of claim 33 , the popularity score of the at least one animated GIF file of the number being determined using information comprising at least one of a number of likes and a number of reblogs.

35 . A non-transitory computer-readable storage medium tangibly encoded with computer-executable instructions that when executed by a processor associated with a computing device perform a method comprising:
determining an n-dimensional feature vector for each segment of a plurality of segments of a video file, the feature vector determination for the segment of the plurality comprising parsing the segment to identify information associated with context and content features of the segment, the feature vector being based on the context and content information; determining a Graphics Interchange Format (GIF) suitability score for each segment of the plurality, the GIF suitability score determination for the segment of the plurality being based on the segment's feature vector, the segment's GIF suitability score being a measure of the segment's suitability for inclusion in an animated GIF file; automatically selecting a number of segments of the plurality, each selected segment's GIF suitability score indicating that the selected segment is more suitable for inclusion in the animated GIF file than each unselected segment's GIF suitability score; communicating information identifying the number of segments, of the plurality of segments of the video file, to a client computing device of a user for display via a graphical user interface at the client computing device; receiving, from the client computing device, input indicative of a set of segments selected, by the user, from the number of segments for creation of an animated GIF file; and automatically creating the animated GIF file using the set of segments selected by the user.

36 . A computing device comprising:
a processor; a non-transitory storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising:
determining logic executed by the processor for determining an n-dimensional feature vector for each segment of a plurality of segments of a video file, the feature vector determination for the segment of the plurality comprising parsing the segment to identify information associated with context and content features of the segment, the feature vector being based on the context and content information;
determining logic executed by the processor for determining a Graphics Interchange Format (GIF) suitability score for each segment of the plurality, the GIF suitability score determinat

Assignees

• Oath Inc

Inventors

• Song Yale
• Gygli Michael
• Cao Liangliang

Classifications

• G06V20/46 Primary

  Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames · CPC title

• G06T13/80 Primary

  Two-dimensional [2D] animation, e.g. using sprites · CPC title

• G06N3/088

  Non-supervised learning, e.g. competitive learning · CPC title

• G06N3/08

  Learning methods · CPC title

• G06F18/214

  Generating training patterns; Bootstrap methods, e.g. bagging or boosting · CPC title