Method, apparatus, electronic device, and computer-readable medium for displaying special effects

Patent metadata

Field	Value
Publication number	US-12112414-B2
Application number	US-202117438782-A
Country	US
Kind code	B2
Filing date	Jun 18, 2021
Priority date	Oct 20, 2020
Publication date	Oct 8, 2024
Grant date	Oct 8, 2024

Abstract

The disclosure provides a method, an apparatus, an electronic device, and a computer readable medium for displaying special effects and relates to the technical field of special effect display. The method includes: obtaining musical features of music played in a special effect display interface; and displaying special effects on the special effect display interface based on the musical features. In the embodiment of the present disclosure, by obtaining musical features of music, and displaying special effects generated based on the musical features on the special effect display interface, the change of the display of the special effects is associated to the musical features, the display of the special effect is more diverse, and the special effects is combined with the musical features, thereby increasing the user's immersive experience.

First claim

What is claimed is:

1. An effect display method, applied to a terminal, comprising:
obtaining musical features of music played in an effect display interface, wherein the musical features comprise beats of the music and accented beats of the music, and the accented beats are beats whose tones are higher than a preset threshold;
displaying effects on the effect display interface based on the musical features, wherein said displaying effects on the effect display interface based on the musical features comprises starting to play the effects at a start point of at least one beat of the music, durations of the effects being durations of beats corresponding to the effects; and
starting to zoom out or zoom in, by the terminal, on a content displayed on the effect display interface at a start point of each of at least one accented beat of the music.

2. The effect display method according to claim 1 , wherein display time of the zooming in or zooming out of the content displayed on the effect display interface is related to durations of the accented beats.

3. The effect display method according to claim 1 , wherein the musical features comprise tones of the accented beats, and the method further comprises:
adjusting an amplitude of the zooming in or zooming out on the content displayed on the effect display interface based on a tone of each of the at least one accented beat.

4. The effect display method according to claim 3 , wherein the tone of each of the at least one accented beat is an average tone of each of the at least one accented beat, and said adjusting the amplitude of the zooming in or zooming out on the content displayed on the effect display interface based on the tone of each of the at least one accented beat comprises:
increasing the amplitude of the zooming in or zooming out on the content displayed on the effect display interface as a level of the average tone rises; and decreasing the amplitude of the zooming in or zooming out on the content displayed on the effect display interface as the level of the average tone drops.

5. The effect display method according to claim 1 , wherein the effects comprise at least one animation element layer and a color change layer, and the at least one animation element layer and the color change layer are fused by superimposition or color filtering.

6. The effect display method according to claim 5 , wherein the musical features comprise beats of the music, and said displaying the effects on the effect display interface based on the musical features comprises:
playing the effects at start points of the beats of the music, wherein for two adjacent beats of the beats, the at least one animation element layer of the effects corresponding to one beat of the two adjacent beats is different from the at least one animation element layer of the effects corresponding to the other beat of the two adjacent beats.

7. The effect display method according to claim 1 , further comprising:
obtaining a video or an image of a user,
fusing the video or image of the user with the effects to form an effect video; and
displaying the effect video through the effect display interface.

8. The effect display method according to claim 1 , wherein contents displayed on the effect display interface comprise: a video image layer, a color change layer, and an animation element layer.

9. The effect display method according to claim 1 , wherein durations of the effects are durations of corresponding beats.

10. The effect display method according to claim 1 , wherein the accented beats are beats whose tones are higher than a preset threshold.

11. An effect display apparatus, applied to a terminal, comprising:
a musical feature obtaining module configured to obtain musical features of music played in an effect display interface, wherein the musical features comprise beats of the music and accented beats of the music, and the accented beats are beats whose tones are higher than a preset threshold;
an effect displaying module configured to display effects on the effect display interface based on the musical features, wherein displaying effects on the effect display interface based on the musical features comprises starting to play the effects at a start point of at least one beat of the music, durations of the effects being durations of beats corresponding to the effects, and the effect displaying module is further configured to start to zoom out or zoom in on a content displayed on the effect display interface at a start point of each of at least one accented beat of the music.

12. The effect display apparatus according to claim 11 , wherein the musical features comprise tones of the accented beats, and the effect displaying module is configured to:
adjust an amplitude of the zooming in or zooming out on the content displayed on the effect display interface based on a tone of each of the at least one accented beat.

13. An electronic device, comprising:
a processor; and
a memory having at least one instruction, at least one program, a code set, or an instruction set stored thereon, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by the processor to implement the effect display method according to claim 1 .

14. The electronic device according to claim 13 , wherein display time of the zooming in or zooming out of the content displayed on the effect display interface is related to durations of the accented beats.

15. The electronic device according to claim 13 , wherein the effects comprise at least one animation element layer and a color change layer, and the at least one animation element layer and the color change layer are fused by superimposition or color filtering.

16. The electronic device according to claim 13 , further comprising:
obtaining a video or an image of a user;
fusing the video or image of the user with the effects to form an effect video; and
displaying the effect video through the effect display interface.

17. The electronic device according to claim 13 , wherein the musical features comprise tones of the accented beats, and the method further comprises:
adjusting an amplitude of the zooming in or zooming out on the content displayed on the effect display interface based on a tone of each of the at least one accented beat.

18. A non-transitory computer-readable medium having a computer program stored thereon, the computer program, when executed by a processor, causes the processor to:
obtain musical features of music played in an effect display interface, wherein the musical features comprise beats of the music and accented beats of the music, and the accented beats are beats whose tones are higher than a preset threshold;
display effects on the effect display interface based on the musical features, wherein displaying effects on the effect display interface based on the musical features comprises starting to play the effects at a start point of at least one beat of the music, durations of the effects being durations of beats corresponding to the effects; and
start to zoom out or zoom in on a content displayed on the effect display interface at a start point of each of at least one accented beat of the music.

19. The non-transitory computer-readable medium according to claim 18 , wherein the musical features comprise tones of the accented beats, and the computer program, when executed by the processor, causes the processor to:
adjust an amplitude of the zooming in or zooming out on the content displayed on the effe

Assignees

• Beijing Bytedance Network Tech Co Ltd

Inventors

• Yu Yan
• Zhao Sen
• Sun Lei
• Li Tao
• Qu Jia

Classifications

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G10H2220/005

  Non-interactive screen display of musical or status data · CPC title

• G10H2210/076

  for extraction of timing, tempo; Beat detection · CPC title

• G10H2210/051

  for extraction or detection of onsets of musical sounds or notes, i.e. note attack timings · CPC title

• G10H1/368

  displaying animated or moving pictures synchronized with the music or audio part · CPC title