Video processing method, video processing device, and storage medium

Patent metadata

Field	Value
Publication number	US-11412292-B2
Application number	US-202117234741-A
Country	US
Kind code	B2
Filing date	Apr 19, 2021
Priority date	Oct 17, 2016
Publication date	Aug 9, 2022
Grant date	Aug 9, 2022

Abstract

A video processing method, a video processing device, and a storage medium are provided. The video processing method includes: determining target image frames corresponding to a dynamic special effect in a video and determining an attribute of a special effect element corresponding to the dynamic special effect in each of the target image frames and coordinates of the special effect element. The video processing method also includes: rendering the special effect element on a drawing interface based on the attribute and the coordinates of the special effect element; filling the target image frames into the drawing interface as a background and forming drawing interface frames with the dynamic special effect; and outputting the drawing interface frames corresponding to each of the target image frames.

First claim

What is claimed is:

1. A video processing method, comprising:
identifying, by a computing device, a first and a second target image frames decoded from a video respectively at a first time and at a second time, the first time and the second time defining therebetween a time period;
allocating, by the computing device, a first special effect element for the first target image frame, and allocating a second special effect element for the second target image frame, wherein the first special effect element differs than the second special effect element, wherein the first special effect element and the special effect element collectively form a dynamic special effect, and wherein the time period refers to a time period on a time axis of the video corresponding to a life cycle of the dynamic special effect;
forming, by the computing device, a first drawing interface frame by filling the first target image frame and the first special effect element into a first drawing interface, and forming, by the computing device, a second drawing interface frame by filling the second target image frame and the second special effect element into a second drawing interface, wherein the first target image frame and the second target image frame are each employed as a background; and
outputting, by the computing device, the first and the second drawing interface frames respectively corresponding to the first and the second target image frames.

2. The method of claim 1 , further comprising:
presenting, by the computing device, the first and the second target image frames on a graphic interface;
presenting, by the computing device, an identifier identifying a dynamic special effect on the graphic interface, the dynamic special effect including the first and the second special effect elements; and
in response to receiving a selection of the identifier, determining, by the computing device, the first and the second special effect elements of the dynamic special effect are to be added to the first and the second target image frames.

3. The method of claim 1 , further comprising:
detecting, by the computing device, a contact between a fingertip of a user and the graphic interface;
identifying, by the computing device, a moving trace of the contact, the moving trace including a first position and a second position; and
identifying, by the computing device, an image frame corresponding to the first position as the first target image frame and an image frame corresponding to the second position as the second target image frame.

4. The method of claim 1 , further comprising:
detecting, by the computing device, a contact between a fingertip of a user and the graphic interface;
identifying, by the computing device, the first time corresponding to a start of the contact and the second time corresponding to a release of the contact; and
identifying, by the computing device, two image frames positioned within the time period of the video as the first and the second target image frames.

5. The method of claim 1 , further comprising:
after forming the first drawing interface frame, clearing, by the computing device, the first drawing interface to form the second drawing interface, wherein after the first drawing interface is cleared to form the second drawing interface, the second drawing interface frame is formed by filling the second target image frame into the second drawing interface.

6. The method of claim 1 , wherein the first and the second target image frames are positioned in the video between a first and a second non-target image frames, the method further comprising:
performing, by the computing device, video encoding, in a time sequence, of the first non-target image frame, the first and the second drawing interface frames, and the second non-target image frame, to form a video file.

7. The method of claim 1 , further comprising:
determining, by the computing device, a size of the first or the second target image frame is inconsistent with a size of a blank drawing interface;
normalizing, by the computing device, coordinates of the first or the second special effect element respectively based on size of the first or the second target image frame to form normalized coordinates; and
rendering, by the computing device, a position on the blank drawing interface corresponding to the normalized coordinates to form the first or the second special effect element.

8. The method of claim 1 , further comprising:
identifying, by the computing device, a feature or an object in the video; and
determining, by the computing device, an image frame identified as having the feature or the object as the first or the second target image frame.

9. A video processing device, comprising: a memory storing computer program instructions; and a processor coupled to the memory and configured to execute the computer program instructions and perform:
identifying a first and a second target image frames decoded from a video respectively at a first time and at a second time, the first time and the second time defining therebetween a time period;
allocating a first special effect element for the first target image frame, and allocating a second special effect element for the second target image frame, wherein the first special effect element differs than the second special effect element, wherein the first special effect element and the special effect element collectively form a dynamic special effect, and wherein the time period refers to a time period on a time axis of the video corresponding to a life cycle of the dynamic special effect;
forming a first drawing interface frame by filling the first target image frame and the first special effect element into a first drawing interface, and forming a second drawing interface frame by filling the second target image frame and the second special effect element into a second drawing interface, wherein the first target image frame and the second target image frame are each employed as a background; and
outputting the first and the second drawing interface frames respectively corresponding to the first and the second target image frames.

10. The video processing device of claim 9 , wherein the processor is further configured to execute the computer program instructions and perform:
presenting the first and the second target image frames on a graphic interface;
presenting an identifier identifying a dynamic special effect on the graphic interface, the dynamic special effect including the first and the second special effect elements; and
in response to receiving a selection of the identifier, determining the first and the second special effect elements of the dynamic special effect are to be added to the first and the second target image frames.

11. The video processing device of claim 9 , wherein the processor is further configured to execute the computer program instructions and perform:
detecting a contact between a fingertip of a user and the graphic interface;
identifying a moving trace of the contact, the moving trace including a first position and a second position; and
identifying an image frame corresponding to the first position as the first target image frame and an image frame corresponding to the second position as the second target image frame.

12. The video processing device of claim 9 , wherein the processor is further configured to execute the computer program instructions and perform:
detecting a contact between a fingertip of a user and the graphic interface;
identifying the first time corresponding to a start of the contact and the second time corresponding to a release of the contact; and
identifying two image frames positioned with

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Wang Qianyi
• Gao Yu
• Wang Zhibin
• Li En
• Li Rong

Classifications

• G06T11/23

  using straight lines or curves · CPC title

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• H04N21/44012 Primary

  involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs · CPC title

• H04N21/234 Primary

  Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs · CPC title