Video generation method and apparatus, electronic device, and storage medium

Patent metadata

Field	Value
Publication number	US-12033671-B2
Application number	US-202318352643-A
Country	US
Kind code	B2
Filing date	Jul 14, 2023
Priority date	Jan 15, 2021
Publication date	Jul 9, 2024
Grant date	Jul 9, 2024

Abstract

A video generation method includes receiving a first trigger operation of generating a video using target music; and in response to the first trigger operation and according to first music feature information of the target music, selecting candidate material matching the target music from a candidate material set of a user as target candidate material, and generating a target video according to the target candidate material. The target video uses the target music as background music.

First claim

What is claimed is:

1. A video generation method, comprising:
receiving a first trigger operation of generating a video using target music; and
in response to the first trigger operation, selecting candidate material matching the target music from a candidate material set of a user according to first music feature information of the target music, using the candidate material as target candidate material, and generating a target video according to the target candidate material, wherein the target video uses the target music as background music,
wherein selecting the candidate material matching the target music from the candidate material set of the user according to the first music feature information of the target music and using the candidate material as the target candidate material comprises:
acquiring second music feature information of background music of each of a plurality of video templates, selecting a video template from the plurality of video template, and using the video template as a target video template, wherein second music feature information in the selected video template matches the first music feature information of the target music; and
determining the target candidate material according to a correlation between a material theme of each candidate material in the candidate material set of the user and a template theme of the target video template, and
wherein the second music feature information comprises at least one of rhythm information and music style information of background music.

2. The method according to claim 1 , wherein the target video template comprises a plurality of material slots for filling material, and
after determining the target candidate material according to the correlation between the material theme of the each candidate material in the candidate material set of the user and the template theme of the target video template, the method further comprises: sequentially acquiring target candidate material satisfying a filling condition of the plurality of material slots of the target video template, using target candidate material corresponding to each material slot of the plurality of material slots as to-be-filled material in each material slot, and filling the to-be-filled material in each material slot of the target video template; and
generating the target video according to the target candidate material comprises: generating the target video according to the target video template filled with the to-be-filled material.

3. The method according to claim 2 , after filling the to-be-filled material in each material slot of the target video template, further comprising:
displaying a preview page and displaying at least one piece of to-be-synthesized material in the target video template in the preview page, wherein the at least one to-be-synthesized material comprises the to-be-filled material.

4. The method according to claim 3 , after displaying the preview page, further comprising:
receiving a second trigger operation applied to a template control in the preview page;
in response to the second trigger operation, displaying a template window, wherein a piece of template information of each of the plurality of video templates is displayed in the template window;
receiving a third trigger operation applied to a piece of template information corresponding to the third trigger operation and displayed in the template window; and
in response to the third trigger operation, switching the target video template to a video template to which the piece of template information corresponding to the third trigger operation belongs and updating the at least one to-be-synthesized material in the target video template.

5. The method according to claim 3 , wherein generating the target video according to the target video template filled with the to-be-filled material comprises:
in a case where a fourth trigger operation of a video synthesis control applied to the preview page is received, using the target music as the background music and synthesizing the at least one to-be-synthesized material as the target video according to sequences of the at least one to-be-synthesized material in the target video template.

6. The method according to claim 4 , wherein generating the target video according to the target video template filled with the to-be-filled material comprises:
in a case where a fourth trigger operation of a video synthesis control applied to the preview page is received, using the target music as the background music and synthesizing the at least one to-be-synthesized material as the target video according to sequences of the at least one to-be-synthesized material in the target video template.

7. The method according to claim 1 , before selecting the candidate material matching the target music from the candidate material set of the user and using the candidate material as the target candidate material, further comprising:
acquiring material in an album of the user, wherein the album comprises at least one of a local album or an associated cloud album; and
selecting a plurality of pieces of material from the album according to an aesthetic score of material to form the candidate material set of the user.

8. An electronic device, comprising:
at least one processor; and
a memory configured to store at least one program,
wherein when executing the at least one program, the at least one processor performs:
receiving a first trigger operation of generating a video using target music; and
in response to the first trigger operation, selecting candidate material matching the target music from a candidate material set of a user according to first music feature information of the target music, using the candidate material as target candidate material, and generating a target video according to the target candidate material, wherein the target video uses the target music as background music,
wherein the at least one processor is configured to select the candidate material matching the target music from the candidate material set of the user according to the first music feature information of the target music and use the candidate material as the target candidate material by:
acquiring second music feature information of background music of each of a plurality of video templates, selecting a video template from the plurality of video template, and using the video template as a target video template, wherein second music feature information in the selected video template matches the first music feature information of the target music; and
determining the target candidate material according to a correlation between a material theme of each candidate material in the candidate material set of the user and a template theme of the target video template, and
wherein the second music feature information comprises at least one of rhythm information and music style information of background music.

9. The electronic device according to claim 8 , wherein the target video template comprises a plurality of material slots for filling material, and
after determining the target candidate material according to the correlation between the material theme of the each candidate material in the candidate material set of the user and the template theme of the target video template, the at least one processor is further configured to perform: sequentially acquiring target candidate material satisfying a filling condition of the plurality of material slots of the target video template, using target candidate material corresponding to each material slot of the plurality of material slots as to-be-filled material in each material slot, and filling the to-be-filled material in each material slot of the target video te

Assignees

• Beijing Zitiao Network Technology Co Ltd

Inventors

• Mo Weishu

Classifications

• G11B27/34

  Indicating arrangements  {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} · CPC title

• G06F16/683

  using metadata automatically derived from the content · CPC title

• H04N21/47205

  for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally · CPC title

• H04N21/435

  Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream · CPC title

• H04N21/4394

  involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58) · CPC title