Systems and methods for generating and presenting publishable collections of related media content items

Patent metadata

Field	Value
Publication number	US-10417799-B2
Application number	US-201514706921-A
Country	US
Kind code	B2
Filing date	May 7, 2015
Priority date	May 7, 2015
Publication date	Sep 17, 2019
Grant date	Sep 17, 2019

Abstract

A plurality of media content items associated with a user and stored locally can be identified. Information associated with the plurality can be acquired. The information can include time data, location data, and/or social graph data. It can be determined, based on the information, that a collection of media content items, out of the plurality, are related. A layout customized for the collection can be generated. Moreover, the collection of media content items that are determined to be related can be identified. The collection can be presented as a collage based on the layout customized for the collection. Contextual information associated with the collage can be acquired. The contextual information can include time data, location data, and/or social graph data. A particular virtual overlaying template can be selected based on the contextual information. The collage can be presented in conjunction with the particular virtual overlaying template.

First claim

What is claimed is:

1. A computer-implemented method comprising:
identifying, by a computing system, a plurality of media content items associated with a user and stored locally;
acquiring, by the computing system, information associated with the plurality of media content items, the information including at least one of time data, location data, or social graph data;
determining, by the computing system, based on the information, that a collection of media content items, out of the plurality of media content items, are related;
generating, by the computing system, a layout customized for the collection of media content items, wherein the layout comprises a plurality of frames, and a quantity and orientation of the plurality of frames is customized based on the quantity of media content items in the collection of media content items and orientations of the media content items in the collection of media content items;
generating, by the computing system, a collage comprising the collection of media content items based on the layout, wherein the collage presents each media content item of the collection of media content items within the layout customized for the collection of media content items; and
receiving, by the computing system, a command from the user to publish the collage to a social networking system, wherein
the collection of media content items comprises a first video,
the plurality of frames in the layout customized for the collection of media content items comprises a first frame for presenting the first video, and
presentation of the collage to a viewing user via the social networking system causes the first video to automatically play within the first frame of the layout while additional media content items of the collection of media content items are simultaneously presented in other frames of the plurality of frames.

2. The computer-implemented method of claim 1 , further comprising:
determining that one or more media content items in the plurality of media content items have less than a specified threshold confidence of being relevant for publishing; and
preventing the one or more media content items from being included in the collection of media content items.

3. The computer-implemented method of claim 1 , further comprising:
applying one or more object recognition processes with respect to the collection to recognize one or more objects depicted in at least one media content item in the collection; and
placing the at least one media content item in a larger frame of the collage relative to other frames in which other media content items in the collage are placed.

4. The computer-implemented method of claim 3 , wherein the one or more object detection processes include at least one of a face detection process, a face recognition process, or an image classification process.

5. The computer-implemented method of claim 3 , wherein, prior to placing the at least one media content item in the larger frame of the collage, the one or more object detection processes recognizes, in the at least one media content item, at least one of: 1) a threshold quantity of objects or 2) a face of a friend having at least a specified threshold social affinity level with respect to the user.

6. The computer-implemented method of claim 1 , wherein determining that the collection of media content items are related further comprises:
identifying, out of the plurality of media content items, at least one of: 1) a first set of media content items that are acquired within an allowable time deviation from one another in the first set based on the time data, 2) a second set of media content items that are acquired within an allowable locational deviation from one another in the second set based on the location data, or 3) a third set of media content items that have at least a threshold level of social commonality relative to one another in the third set based on the social graph data; and
including at least one of the first set, the second set, or the third set in the collection of media content items.

7. The computer-implemented method of claim 1 , wherein the collection of media content items further comprises at least one of an image, a series of images acquired within a particular time frame, or an audio.

8. The computer-implemented method of claim 7 , wherein the collection of media content items includes a series of images acquired within a particular time frame, and presentation of the collage via the social networking system further causes an animation of the series of images to automatically play within a second frame of the layout while additional media content items of the collection of media content items are simultaneously presented in other frames of the plurality of frames.

9. The computer-implemented method of claim 7 , further comprising:
applying one or more image analysis processes with respect to the series of images;
determining, based on the one or more image analysis processes, that one or more images out of the series of images have less than a threshold level of image similarity with respect to other images in the series of images; and
removing the one or more images from the series of images.

10. A system comprising:
at least one processor; and
a memory storing instructions that, when executed by the at least one processor, cause the system to perform:
identifying a plurality of media content items associated with a user and stored locally;
acquiring information associated with the plurality of media content items, the information including at least one of time data, location data, or social graph data;
determining, based on the information, that a collection of media content items, out of the plurality of media content items, are related;
generating a layout customized for the collection of media content items, wherein the layout comprises a plurality of frames, and a quantity and orientation of the plurality of frames is customized based on the quantity of media content items in the collection of media content items and orientations of the media content items in the collection of media content items;
generating a collage comprising the collection of media content items based on the layout, wherein the collage presents each media content item of the collection of media content items within the layout customized for the collection of media content items; and
receiving a command from the user to publish the collage to a social networking system, wherein
the collection of media content items comprises a first video,
the plurality of frames in the layout customized for the collection of media content items comprises a first frame for presenting the first video, and
presentation of the collage to a viewing user via the social networking system causes the first video to automatically play within the first frame of the layout while additional media content items of the collection of media content items are simultaneously presented in other frames of the plurality of frames.

11. The system of claim 10 , wherein the instructions cause the system to further perform:
determining that one or more media content items in the plurality of media content items have less than a specified threshold confidence of being relevant for publishing; and
preventing the one or more media content items from being included in the collection of media content items.

12. The system of claim 10 , wherein the instructions cause the system to further perform:
applying one or more object recognition processes with respect to the collection to recognize one or more objects depicted in at least one media content item in the collection; and
placing the at lea

Assignees

• Facebook Inc

Inventors

• Tran Thai Gia
• Tauziet Christophe Marcel Rene
• Liu Judy
• Lin Jeffrey
• Bar Tomer
• Zhu Kejia

Classifications

• G06F16/48

  Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually · CPC title

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title