Method, device, and storage medium for displaying a dynamic special effect

Patent metadata

Field	Value
Publication number	US-11012740-B2
Application number	US-201816231873-A
Country	US
Kind code	B2
Filing date	Dec 24, 2018
Priority date	Oct 17, 2016
Publication date	May 18, 2021
Grant date	May 18, 2021

Abstract

A video processing method, a video processing device, and a storage medium are provided. The video processing method includes: determining target image frames corresponding to a dynamic special effect in a video and determining an attribute of a special effect element corresponding to the dynamic special effect in each of the target image frames and coordinates of the special effect element. The video processing method also includes: rendering the special effect element on a drawing interface based on the attribute and the coordinates of the special effect element; filling the target image frames into the drawing interface as a background and forming drawing interface frames with the dynamic special effect; and outputting the drawing interface frames corresponding to each of the target image frames.

First claim

What is claimed is:

1. A video processing method, comprising:
determining, by a computing device, target image frames corresponding to a dynamic special effect in a video, the target image frames including a first and a second target image frames;
determining, by the computing device, an attribute and coordinates of a first special effect element corresponding to the dynamic special effect in the first target image frame, and determining, by the computing device, an attribute and coordinates of a second special effect element corresponding to the dynamic special effect in the second target image frame;
rendering, by the computing device, the first special effect element on a drawing interface based on the attribute and the coordinates of the first special effect element, and forming, by the computing device, a first drawing interface frame with the dynamic special effect by filling the first image frame into the drawing interface as a background;
after forming the first drawing interface frame, clearing the drawing interface;
after clearing the drawing interface, rendering, by the computing device, the second special effect element on the drawing interface based on the attribute and the coordinates of the second special effect element, and forming a second drawing interface frame with the dynamic special effect by filling the second target image frame into the drawing interface as a background; and
outputting, by the computing device, the first and the second drawing interface frames respectively corresponding to the first and the second target image frames.

2. The method according to claim 1 , further comprising:
determining, by the computing device based on a time period of the video corresponding to an operation, image frames corresponding to the time period in the video as the target image frames.

3. The method according to claim 1 , further comprising:
identifying, by the computing device, a feature in the video; and
determining, by the computing device, image frames identified as having the feature as the target image frames.

4. The method according to claim 1 , further comprising:
identifying, by the computing device, an object in the video; and
determining, by the computing device, image frames identified as having the object as the target image frames.

5. The method according to claim 1 , further comprising:
determining, by the computing device, a position of a touch operation added to the video; and
determining, by the computing device, the coordinates of the first or the second special effect element on the drawing interface based on the position of the touch operation in the video.

6. The method according to claim 1 , further comprising:
determining, by the computing device, a position of a specific action added to the video; and
determining, by the computing device, the coordinates of the first or the second special effect element on the drawing interface based on the position of the specific action.

7. The method according to claim 1 , further comprising:
determining, by the computing device, a position of a specific object added to the video; and
determining, by the computing device, the coordinates of the first or the second special effect element on the drawing interface based on the position of the specific object.

8. The method according to claim 1 , further comprising:
determining, by the computing device, a visual effect created in each of the target image frames based on the dynamic special effect; and
determining, by the computing device, the first or the second special effect element further according to the visual effect.

9. The method according to claim 1 , further comprising:
normalizing, by the computing device, the coordinates of the first or the second special effect element respectively based on a size of the first or the second target image frame.

10. A video processing device, comprising: a memory; and a processor coupled to the memory and configured to:
determine target image frames corresponding to a dynamic special effect in a video, the target image frames including a first and a second target image frames;
determine an attribute and coordinates of a first special effect element corresponding to the dynamic special effect in the first target image frame, and determine an attribute and coordinates of a second special effect element corresponding to the dynamic special effect in the second target image frame;
render on a drawing interface the first special effect element based on the attribute and the coordinates of the first special effect element, and form a first drawing interface frame with the dynamic special effect by filling the first image frame into the drawing interface as a background;
after forming the first drawing interface frame, clear the drawing interface;
after clearing the drawing interface, render the second special effect element on the drawing interface based on the attribute and the coordinates of the second special effect element, and form a second drawing interface frame with the dynamic special effect by filling the second target image frame into the drawing interface as a background; and
output the first and the second drawing interface frames respectively corresponding to the first and the second target image frames.

11. The video processing device according to claim 10 , wherein the processor is further configured to determine, based on a time period of the video corresponding to an operation, image frames corresponding to the time period in the video as the target image frames.

12. The video processing device according to claim 10 , wherein the processor is further configured to identify a feature in the video, and determine image frames identified to have the feature as the target image frames.

13. The video processing device according to claim 10 , wherein the processor is further configured to identify an object in the video, and determine image frames identified as having the object as the target image frames.

14. The video processing device according to claim 10 , wherein the processor is further configured to determine a position of a touch operation added to the video, and determine the coordinates of the first or the second special effect element on the drawing interface based on the position of the touch operation.

15. The video processing device according to claim 10 , wherein the processor is further configured to determine a position of a specific action added to the video, and determine the coordinates of the first or the second special effect element on the drawing interface based on the position of the specific action.

16. The video processing device according to claim 10 , wherein the processor is further configured to determine a position of a specific object added to the video, and determine the coordinates of the first or the second special effect element on the drawing interface based on the position of the specific object.

17. The video processing device according to claim 10 , wherein the processor is further configured to determine a visual effect correspondingly formed in each of the target image frames based on the dynamic special effect, and determine the first or the second special effect element further according to the visual effect.

18. The video processing device according to claim 10 , wherein the processor is further configured to normalize the coordinates of the first or the second special effect element respectively based on a size of the first or the second target image frame.

19. A non-transitory computer

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Wang Qianyi
• Gao Yu
• Wang Zhibin
• Li En
• Li Rong

Classifications

• G06T11/23

  using straight lines or curves · CPC title

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• H04N21/4312 Primary

  involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations · CPC title

• H04N21/44008

  involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title

• H04N21/4788

  communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)} · CPC title