Method for converting a picture into a video, device, and storage medium

Patent metadata

Field	Value
Publication number	US-11893770-B2
Application number	US-202218148372-A
Country	US
Kind code	B2
Filing date	Dec 29, 2022
Priority date	Sep 29, 2020
Publication date	Feb 6, 2024
Grant date	Feb 6, 2024

Abstract

Provided are a method for converting a picture into a video, a device, and a storage medium. The method for converting a picture into a video includes the following: performing color fading processing on an original picture to obtain a black-and-white image; determining a foreground area and a background area of the black-and-white image; performing iterative color restoration on pixels in the black-and-white image based on a processing order of the foreground area and the background area, and storing the image obtained by each restoration as a picture frame to obtain multiple frames of images; and splicing the multiple frames of images to obtain a target video.

First claim

What is claimed is:

1. A method for converting a picture into a video, comprising:
performing color fading processing on an original picture to obtain a black-and-white image;
determining a foreground area of the black-and-white image and a background area of the black-and-white image;
performing, according to a color value of each pixel in the original picture, iterative color restoration on pixels in the black-and-white image based on a processing order of the foreground area and the background area, and storing an image obtained at each iteration of the color restoration as a picture frame to obtain a plurality of frames; and
splicing the plurality of frames to obtain a target video.

2. The method according to claim 1 , wherein the black-and-white image comprises a black-and-white picture layer and an original picture layer, and performing the color fading processing on the original picture to obtain the black-and-white image comprises:
performing binarization processing on the original picture to obtain a black-and-white picture; and
superimposing the black-and-white picture to the original picture to obtain the black-and-white image.

3. The method according to claim 2 , wherein determining the foreground area of the black-and-white image and the background area of the black-and-white image comprises:
sending the original picture to a server so that the server performs foreground clipping on the original picture to obtain a foreground segmentation area;
receiving the foreground segmentation area returned by the server; and
determining, according to the foreground segmentation area, the foreground area of the black-and-white image and the background area of the black-and-white image.

4. The method according to claim 3 , wherein each iteration of the iterative color restoration comprises:
in a case where the processing sequence is that the foreground area is processed first and then the background area is processed, performing iterative masking filtering on pixels in the foreground area of the black-and-white picture layer according to a first direction, and performing the iterative masking filtering on pixels in the background area of the black-and-white picture layer according to a second direction.

5. The method according to claim 4 , wherein each iteration of the iterative color restoration is performed on a predetermined number of pixels or a predetermined proportion of pixels of the black-and-white image.

6. The method according to claim 3 , wherein each iteration of the iterative color restoration comprises:
in a case where the processing sequence is that the background area is processed first and then the foreground area is processed, performing iterative masking filtering on pixels in the background area of the black-and-white picture layer according to a third direction, and performing the iterative masking filtering on pixels in the foreground area of the black-and-white picture layer according to a fourth direction.

7. The method according to claim 1 , wherein each iteration of the iterative color restoration comprises:
acquiring the color value of each pixel in the original picture; and
performing color restoration on the pixels in the black-and-white image according to the color value of each pixel in the original picture.

8. The method according to claim 7 , wherein performing the color restoration on the pixels in the black-and-white image comprises:
replacing the color value of each pixel in the black-and-white image iteratively with the acquired color value of the pixel in the original picture corresponding to said each pixel.

9. The method according to claim 1 , wherein splicing the plurality of frames to obtain the target video comprises:
adding a set transition effect between adjacent frames of the plurality of frames; and
rendering the plurality of frames and the added set transition effect to obtain the target video.

10. The method according to claim 1 , wherein the foreground area comprises a portrait area.

11. An electronic device, comprising:
at least one processing apparatus; and
a storage apparatus configured to store at least one instruction;
wherein when the at least one instruction is executed by the at least one processing apparatus, the at least one processing apparatus implements the following:
performing color fading processing on an original picture to obtain a black-and-white image;
determining a foreground area of the black-and-white image and a background area of the black-and-white image;
performing, according to a color value of each pixel in the original picture, iterative color restoration on pixels in the black-and-white image based on a processing order of the foreground area and the background area, and storing an image obtained at each iteration of the color restoration as a picture frame to obtain a plurality of frames; and
splicing the plurality of frames to obtain a target video.

12. The electronic device according to claim 11 , wherein the black-and-white image comprises a black-and-white picture layer and an original picture layer, and the at least one processing apparatus implements performing the color fading processing on the original picture to obtain the black-and-white image by:
performing binarization processing on the original picture to obtain a black-and-white picture; and
superimposing the black-and-white picture to the original picture to obtain the black-and-white image.

13. The electronic device according to claim 12 , wherein the at least one processing apparatus implements determining the foreground area of the black-and-white image and the background area of the black-and-white image by:
sending the original picture to a server so that the server performs foreground clipping on the original picture to obtain a foreground segmentation area;
receiving the foreground segmentation area returned by the server; and
determining, according to the foreground segmentation area, the foreground area of the black-and-white image and the background area of the black-and-white image.

14. The electronic device according to claim 13 , wherein the at least one processing apparatus implements each iteration of the iterative color restoration by:
in a case where the processing sequence is that the foreground area is processed first and then the background area is processed, performing iterative masking filtering on pixels in the foreground area of the black-and-white picture layer according to a first direction, and performing the iterative masking filtering on pixels in the background area of the black-and-white picture layer according to a second direction.

15. The electronic device according to claim 14 , wherein the at least one processing apparatus implements each iteration of the iterative color restoration on a predetermined number of pixels or a predetermined proportion of pixels of the black-and-white image.

16. The electronic device according to claim 13 , wherein the at least one processing apparatus implements each iteration of the iterative color restoration by:
in a case where the processing sequence is that the background area is processed first and then the foreground area is processed, performing iterative masking filtering on pixels in the background area of the black-and-white picture layer according to a third direction, and performing the iterative masking filtering on pixels in the foreground area of the black-and-white picture layer according to a fourth direction.

17. The electronic device according to claim 11 , wherein the at least one processing apparatus im

Assignees

• Beijing Zitiao Network Technology Co Ltd

Inventors

• Zhang Shupeng
• Gan Xiaorui
• Wen Jie
• Wang Yitong
• Pan Jingxiang

Classifications

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06V10/56 Primary

  relating to colour · CPC title

• G06T5/50

  using two or more images, e.g. averaging or subtraction · CPC title

• G06T7/194

  involving foreground-background segmentation · CPC title

• G06T7/90

  Determination of colour characteristics · CPC title