Video processing method and device

Patent metadata

Field	Value
Publication number	US-12041294-B2
Application number	US-202118044122-A
Country	US
Kind code	B2
Filing date	Oct 9, 2021
Priority date	Oct 30, 2020
Publication date	Jul 16, 2024
Grant date	Jul 16, 2024

Abstract

Embodiments of the present disclosure provide a video processing method and device, a computer-readable storage medium, a computer program product and a computer program, where the method includes: acquiring a to-be-processed video frame and corresponding special effect setup information; sending the to-be-processed video frame and the corresponding special effect setup information to a server, so that the server adds a target special effect on the to-be-processed video frame according to the special effect setup information to obtain a target video frame corresponding to the to-be-processed video frame, and splices all obtained target video frames to generate a target video, after the first device finishes shooting; and receiving the target video sent by the server, and displaying the target video, which improves efficiency of adding special effects, thereby improving user experience.

First claim

What is claimed is:

1. A video processing method, wherein the method is applied to a first device, and the method comprises:
acquiring a to-be-processed video frame and corresponding special effect setup information;
sending the to-be-processed video frame and the corresponding special effect setup information to a server, so that the server adds a target special effect on the to-be-processed video frame according to the special effect setup information to obtain a target video frame corresponding to the to-be-processed video frame, and splices all obtained target video frames to generate a target video, after the first device finishes shooting; and
receiving the target video sent by the server, and displaying the target video.

2. The method according to claim 1 , wherein the method further comprises:
in response to a first trigger operation used to indicate addition of the target special effect, adding an initial special effect corresponding to the target special effect on the to-be-processed video frame.

3. The method according to claim 2 , wherein an adding position of the target special effect on the target video frame is determined by the server according to an adding position of the initial special effect on the to-be-processed video frame.

4. The method according to claim 2 , wherein the method further comprises:
in response to a received second trigger operation, determining interaction information, and performing corresponding interaction processing on the initial special effect on the to-be-processed video frame according to the interaction information.

5. The method according to claim 2 , wherein the method further comprises:
in response to a third trigger operation acted on the first device, performing corresponding moving processing on the initial special effect on the to-be-processed video frame according to the third trigger operation.

6. The method according to claim 2 , wherein the method further comprises:
acquiring ambient brightness, and performing corresponding adjusting processing on brightness of the initial special effect on the to-be-processed video frame according to the ambient brightness.

7. The method according to claim 1 , wherein the sending the to-be-processed video frame and the corresponding special effect setup information to the server comprises:
encoding the to-be-processed video frame, and packaging an encoded to-be-processed video frame and the special effect setup information corresponding to the to-be-processed video frame, to obtain a video package;
sending the video package to the server, so that the server parses the video package, to obtain the encoded to-be-processed video frame and the special effect setup information, and decodes the encoded to-be-processed video frame, to obtain the to-be-processed video frame.

8. The method according to claim 1 , wherein the special effect setup information comprises at least one of following information: an identifier of the target special effect, moving information of the first device, and interaction information determined according to a received trigger action.

9. A video processing method, wherein the method is applied to a server, and the method comprises:
acquiring a to-be-processed video frame and corresponding special effect setup information sent by a first device;
adding a target special effect on the to-be-processed video frame according to the special effect setup information, to obtain a target video frame corresponding to the to-be-processed video frame;
after the first device finishes shooting, splicing all obtained target video frames to generate a target video;
sending the target video to the first device.

10. The method according to claim 9 , wherein the special effect setup information comprises at least one of following information: an identifier of the target special effect, moving information of the first device, and interaction information determined according to a received trigger action.

11. The method according to claim 10 , wherein if the special effect setup information comprises the identifier of the target special effect, the adding the target special effect on the to-be-processed video frame according to the special effect setup information comprises:
acquiring the target special effect corresponding to the identifier of the target special effect;
adding the target special effect on the to-be-processed video frame.

12. The method according to claim 10 , wherein if the special effect setup information comprises the interaction information, the adding the target special effect on the to-be-processed video frame according to the special effect setup information, to obtain the target video frame corresponding to the to-be-processed video frame comprises:
acquiring the target special effect corresponding to the identifier of the target special effect;
adding the target special effect on the to-be-processed video frame, and performing corresponding interaction processing on the target special effect according to the interaction information, to obtain the target video frame corresponding to the to-be-processed video frame.

13. The method according to claim 10 , wherein if the special effect setup information comprises the moving information of the first device, the adding the target special effect on the to-be-processed video frame according to the special effect setup information, to obtain the target video frame corresponding to the to-be-processed video frame comprises:
acquiring the target special effect corresponding to the identifier of the target special effect;
adding the target special effect on the to-be-processed video frame, and performing corresponding moving processing on the target special effect according to the moving information of the first device.

14. The method according to claim 13 , wherein the moving information of the first device comprises a moving acceleration and a moving direction;
the performing corresponding moving processing on the target special effect according to the moving information of the first device comprises:
calculating a target position according to the moving acceleration and the moving direction, and moving the target special effect to the target position.

15. The method according to claim 9 , wherein after adding the target special effect on the to-be-processed video frame according to the special effect setup information, the method further comprises:
acquiring ambient brightness corresponding to the to-be-processed video frame sent by the first device;
performing corresponding adjusting processing on brightness of the target special effect according to the ambient brightness.

16. The method according to claim 9 , wherein the sending the target video to the first device comprises:
encoding the target video, and sending an encoded target video to the first device, so that the first device decodes the encoded target video to obtain the target video.

17. A video processing device, wherein the video processing device is applied to a first device, and the video processing device comprises:
at least one processor and a memory;
the memory stores a computer-executable instruction;
the at least one processor executes the computer-executable instruction stored in the memory, to cause the at least one processor to acquire a to-be-processed video frame and corresponding special effect setup information;
send the to-be-processed video frame and the corresponding special effect setup information to a server, so that the server adds a target special effect on the to-be-processed video frame according

Assignees

• Beijing Bytedance Network Tech Co Ltd

Inventors

• Li Xiaoqi
• Liu Haipeng
• Shen Yanhao
• Ni Guangyao
• Xie Xuanmeng

Classifications

• H04N21/4318

  by altering the content in the rendering process, e.g. blanking, blurring or masking an image region (image enhancement or restoration in general G06T5/00) · CPC title

• H04N21/23424 Primary

  involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement · CPC title

• H04N21/4312 Primary

  involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations · CPC title

• H04N21/2387

  Stream processing in response to a playback request from an end-user, e.g. for trick-play · CPC title