Special effect processing method and apparatus

Patent metadata

Field	Value
Publication number	US-12040000-B2
Application number	US-202318366478-A
Country	US
Kind code	B2
Filing date	Aug 7, 2023
Priority date	Feb 7, 2021
Publication date	Jul 16, 2024
Grant date	Jul 16, 2024

Abstract

The present application provides a special effect processing method and apparatus. The method includes: generating an audio signal in response to a touch operation of a user in a process of playing a video; segmenting the audio signal into multiple audio frames; performing, according to attributes of the audio frames, special effect processing on a picture which is currently played in the video.

First claim

The invention claimed is:

1. A special effect processing method, comprising:
in a process of playing a video, in response to a touch operation of a user on a first music control and a second music control, generating an audio signal corresponding to the first music control and an audio signal corresponding to the second music control, and superimposing the audio signal corresponding to the first music control and the audio signal corresponding to the second music control to obtain an audio signal, wherein the first music control corresponds to a low-frequency timbre, and the second music control corresponds to a high-frequency timbre;
segmenting the obtained audio signal into multiple audio frames; and
performing, according to attributes of the audio frames, special effect processing on a picture which is currently played in the video.

2. The method according to claim 1 , wherein the attributes comprise frequency spectrums; and performing, according to the attributes of the audio frames, the special effect processing on the picture which is currently played in the video comprises:
controlling, according to a first energy value corresponding to a first preset interval on a frequency spectrum, whether to add animation to an operation control corresponding to the touch operation, wherein the operation control corresponding to the touch operation comprises the first music control and the second music control.

3. The method according to claim 2 , wherein controlling, according to the first energy value corresponding to the first preset interval on the frequency spectrum, whether to add the animation to the operation control corresponding to the touch operation comprises:
upon determining that the first energy value is greater than or equal to a preset energy value, adding the animation to the operation control corresponding to the touch operation.

4. The method according to claim 2 , wherein the first preset interval comprises first M frequencies from the lowest frequency to the highest frequency on the frequency spectrum, and the first energy value is a sum of energy values corresponding to the preset number of first frequencies, wherein M is a preset number.

5. The method according to claim 1 , wherein the attributes comprise frequency spectrums; and performing, according to the attributes of the audio frames, the special effect processing on the picture which is currently played in the video comprises:
controlling a full-screen floodlight effect by using a filter according to a second energy value corresponding to a second preset interval on a frequency spectrum.

6. The method according to claim 5 , wherein controlling the full-screen floodlight effect by using the filter according to the second energy value corresponding to the second preset interval on the frequency spectrum comprises:
determining, according to the second energy value and a preset mapping relationship, brightness corresponding to the second energy value, wherein the preset mapping relationship is a preset corresponding relationship between energy values and brightness;
adjusting a brightness intensity parameter of the filter to the brightness corresponding to the second energy value.

7. The method according to claim 5 , wherein the second preset interval comprises last N frequencies from the lowest frequency to the highest frequency on the frequency spectrum, and the second energy value is a sum of energy values corresponding to the preset number of last frequencies, wherein N is a preset number.

8. The method according to claim 1 ,
wherein generating the audio signal corresponding to the first music control and the audio signal corresponding to the second music control, and superimposing the audio signal corresponding to the first music control and the audio signal corresponding to the second music control to obtain the audio signal comprises:
performing looping rendering on notes corresponding to the first music control according to the timbre corresponding to the first music control to obtain the audio signal corresponding to the first music control;
performing looping rendering on notes corresponding to the second music control according to the timbre corresponding to the second music control to obtain the audio signal corresponding to the second music control;
superimposing the audio signal corresponding to the first music control and the audio signal corresponding to the second music control to obtain the audio signal.

9. The method according to claim 1 , wherein an operation control corresponding to the touch operation comprises: the first music control, the second music control, and a third music control, wherein the third music control corresponds to a first audio signal;
wherein generating the audio signal corresponding to the first music control and the audio signal corresponding to the second music control, and superimposing the audio signal corresponding to the first music control and the audio signal corresponding to the second music control to obtain the audio signal comprises:
performing looping rendering on notes corresponding to the first music control according to the timbre corresponding to the first music control to obtain the audio signal corresponding to the first music control;
performing looping rendering on notes corresponding to the second music control according to the timbre corresponding to the second music control to obtain the audio signal corresponding to the second music control; and
superimposing the audio signal corresponding to the first music control, the audio signal corresponding to the second music control and the first audio signal to obtain the audio signal, wherein the first audio signal is an audio signal rendered in advance.

10. The method according to claim 1 , wherein an operation control corresponding to the touch operation comprises: the first music control, the second music control, and a speed slider;
wherein generating the audio signal corresponding to the first music control and the audio signal corresponding to the second music control, and superimposing the audio signal corresponding to the first music control and the audio signal corresponding to the second music control to obtain the audio signal comprises:
performing looping rendering on notes corresponding to the first music control according to the timbre corresponding to the first music control and the number of beats per minute corresponding to the speed slider to obtain the audio signal corresponding to the first music control;
performing looping rendering on notes corresponding to the second music control according to the timbre corresponding to the second music control and the number of beats per minute corresponding to the speed slider to obtain the audio signal corresponding to the second music control; and
superimposing the audio signal corresponding to the first music control and the audio signal corresponding to the second music control to obtain the audio signal.

11. A terminal device, comprising a memory and a processor,
wherein the memory stores executable instructions; and
wherein the processor executes the computer execution instruction stored in the memory, so that the processor is configured to:
in a process of playing a video, in response to a touch operation of a user on a first music control and a second music control, generate an audio signal corresponding to the first music control and an audio signal corresponding to the second music control, and superimpose the audio signal corresponding to the first music control and the audio signal corresponding to the second music control to obtain an audio signal, wherein the first music control corresponds to a low-frequency timbre, and

Assignees

• Lemon Inc

Inventors

• Sun Chenyu
• Chen Jitong
• Schager Nathanael
• Crichton Maryyann
• Serrano Josiah John
• Li Bochen
• Hu Xuefan
• Smith Fraser
• Kim Hwankyoo Shawn
• Trevelyan David
• Feng Suiyu
• Wu Brandon
• Xiong Tao

Classifications

• G11B27/007

  reproducing continuously a part of the information, i.e. repeating · CPC title

• G06F3/165

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/04847

  Interaction techniques to control parameter settings, e.g. interaction with sliders or dials · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title