Customized animation from video

Patent metadata

Field	Value
Publication number	US-2023138677-A1
Application number	US-202117514370-A
Country	US
Kind code	A1
Filing date	Oct 29, 2021
Priority date	Oct 29, 2021
Publication date	May 4, 2023
Grant date	—

Abstract

Methods and systems are disclosed for generating a custom sticker. In one embodiment, a messaging application implemented on a first device receives a video and input that draws a selection of a region of the video. The messaging application generates a graphical element comprising the region of the video drawn by the input and applies one or more visual effects to the graphical element to create a custom graphic. The custom graphic with the one or more visual effects is sent from the first device to a second device.

First claim

What is claimed is:

1 . A method comprising:
receiving, by a messaging application implemented on a first device, a video; receiving, by the messaging application, input that draws a selection of a region of the video; generating, by the messaging application, a graphical element comprising the region of the video drawn by the input; applying, by the messaging application, one or more visual effects to the graphical element to create a custom graphic; and sending the custom graphic with the one or more visual effects from the first device to a second device.

2 . The method of claim 1 , wherein receiving the video comprises:
capturing a video with a camera of the first device; and receiving a selection of a subset of frames of the video that has been captured by the camera.

3 . The method of claim 1 , wherein the video is received from an external source.

4 . The method of claim 1 , further comprising:
displaying, by the messaging application, a menu of options comprising a crop option, a visual effects option, and an animation option, the menu of options being displayed together with the video.

5 . The method of claim 4 , further comprising:
receiving a first selection of the crop option; and displaying a plurality of crop styles comprising a freehand style, a predefined shape, and an automatic region extraction.

6 . The method of claim 5 , further comprising:
receiving a second selection of the freehand style; in response to the second selection, detecting freehand input that draws a shape that defines the region of the video; and in response to detecting that the shape has been completely drawn when an ending point has reached a starting point of the shape, extracting the region of the video to include in the graphical element.

7 . The method of claim 5 , wherein the video includes a real-world object and one or more augmented reality elements applied to the real-world object, further comprising:
receiving a second selection of the automatic region extraction; in response to the second selection, identifying a portion of the video that comprises the real-world object and the one or more augmented reality elements; and extracting the region of the video that encompasses the real-world object and the one or more augmented reality elements.

8 . The method of claim 1 , further comprising:
capturing a given video that depicts a real-world environment; and applying one or more augmented reality elements to a real-world object depicted in the real-world environment of the given video, wherein the received video comprises the given video that includes with the one or more augmented reality elements, and wherein the region of the video drawn by the input comprises a portion of the given video that depicts the real-world object and the one or more augmented reality elements.

9 . The method of claim 1 , wherein the one or more visual effects comprises an outline, text, a sticker, or a media item.

10 . The method of claim 1 , further comprising:
displaying, by the messaging application, a new video depicting a real-world environment; and adding, to the new video, the custom graphic comprising the region of the video drawn by the input and the one or more visual effects.

11 . The method of claim 10 , further comprising receiving input for rotating the custom graphic added to the new video.

12 . The method of claim 10 , further comprising receiving input for adjusting a two-dimensional position of the custom graphic within the new video.

13 . The method of claim 1 , further comprising:
determining that a first number of custom graphics have been created by a user account associated with the messaging application; comparing the first number of custom graphics created by the user account to a first threshold; and in response to determining that the first number of custom graphics created by the user account transgresses the first threshold, enabling advanced visual effects to be applied to the graphical element.

14 . The method of claim 13 , wherein the advanced visual effects comprise at least one of a geofilter or a caption style.

15 . The method of claim 13 , further comprising:
comparing the first number of custom graphics created by the user account to a second threshold that is larger than the first threshold; and in response to determining that the first number of custom graphics created by the user account transgresses the second threshold, generating an option to purchase access to an augmented reality experience creation application.

16 . The method of claim 1 , further comprising:
determining that a plurality of users have viewed or shared a previously generated custom graphic that has been created by a user account associated with the messaging application; determining that a quantity of users in the plurality of users transgresses a threshold; and in response to determining that the quantity of users in the plurality of users transgresses the threshold, enabling advanced visual effects to be applied to the graphical element.

17 . The method of claim 1 , further comprising:
receiving a selection of one or more keywords; and associating the one or more keywords with the custom graphic, wherein the custom graphic is searched for by one or more other users based on the selected one or more keywords.

18 . The method of claim 1 , further comprising:
displaying, by the messaging application, attribution control information, the attribution control information comprising a first option to remain anonymous as a creator of the custom graphic and a second option to share limited information about a user who created the custom graphic; and associating attribution control information with the custom graphic based on whether the first option or the second option was selected.

19 . A system comprising:
a processor; and a memory component having instructions stored thereon that, when executed by the processor, cause the processor to perform operations comprising:
receiving, by a messaging application implemented on a first device, a video;
receiving, by the messaging application, input that draws a selection of a region of the video;
generating, by the messaging application, a graphical element comprising the region of the video drawn by the input;
applying, by the messaging application, one or more visual effects to the graphical element to create a custom graphic; and
sending the custom graphic with the one or more visual effects from the first device to a second device.

20 . A non-transitory computer-readable storage medium having stored thereon instructions that, when executed by a processor, cause the processor to perform operations comprising:
receiving, by a messaging application implemented on a first device, a video; receiving, by the messaging application, input that draws a selection of a region of the video; generating, by the messaging application, a graphical element comprising the region of the video drawn by the input; applying, by the messaging application, one or more visual effects to the graphical element to create a custom graphic; and sending the custom graphic with the one or more visual effects from the first device to a second device.

Assignees

• Snap Inc

Inventors

• Kwong Chelsea
• Rein Dorit

Classifications

• G06T11/23

  using straight lines or curves · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06T13/80 Primary

  Two-dimensional [2D] animation, e.g. using sprites · CPC title

• G06T13/40

  of characters, e.g. humans, animals or virtual beings · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title