Video processing method and apparatus, storage medium, and electronic device

Patent metadata

Field	Value
Publication number	US-2022014737-A1
Application number	US-202117449109-A
Country	US
Kind code	A1
Filing date	Sep 28, 2021
Priority date	Sep 27, 2019
Publication date	Jan 13, 2022
Grant date	—

Abstract

A video processing method is provided. In the method, at least one pair of decoded blocks to be reconstructed in a video frame is determined. Each pair of decoded blocks in the at least one pair of decoded blocks includes a first decoded block of a first resolution and a second decoded block of a second resolution. The first decoded block is adjacent to the second decoded block. The first resolution of the first decoded block is adjusted to a target resolution. The second resolution of the second decoded block is adjusted to the target resolution. A first edge pixel set in the first decoded block is determined. A second edge pixel set in the second decoded block is determined, the second edge pixel set being adjacent to the first edge pixel set. Further, the first edge pixel set and the second edge pixel set are filtered.

First claim

What is claimed is:

1 . A video processing method, the method comprising:
determining at least one pair of decoded blocks to be reconstructed in a video frame, each pair of decoded blocks in the at least one pair of decoded blocks including a first decoded block of a first resolution and a second decoded block of a second resolution, the first decoded bloc k being adjacent to the second decoded block; adjusting the first resolution of the first decoded block to a target resolution; adjusting the second resolution of the second decoded block to the target resolution; determining a first edge pixel set in the first decoded block; determining a second edge pixel set in the second decoded block, the second edge pixel set being adjacent to the first edge pixel set; and filtering, by processing circuitry, the firm edge pixel set and the second edge pixel set.

2 . The method according to claim 1 , wherein the filtering comprises:
determining first reference pixels associated with the first edge pixel set in the first decoded block, determining second reference pixels associated with the second edge pixel set in the second decoded block, and filtering the first edge pixel set and the second edge pixel set according to pixel values of the first reference pixels and pixel values of the second reference pixels, a first difference between a pixel value of an i th pixel in the filtered first edge pixel set and a pixel value of a j th pixel that corresponds to the i th pixel and is in the filtered second edge pixel set being less than a second difference between a pixel value of an i th pixel in the first edge pixel set and a pixel value of a j th pixel in the second edge pixel set, i being a positive integer that is less than or equal to a total quantity of pixels in the first edge pixel set, j being a positive integer that is less than or equal to a total quantity of pixels in the second edge pixel set.

3 . The method according to claim 2 , wherein the filtering comprises:
determining edge pixels in the first edge pixel set and the second edge pixel set; and for each of the edge pixels,
performing a weighted summation on the pixel values of the first reference pixels and the pixel values of the second reference pixels to obtain a target pixel value of the respective edge pixel; and
updating a pixel value of the respective edge pixel to the target pixel value of the respective edge pixel to obtain a filtered respective edge pixel.

4 . The method according to claim 3 , wherein the performing the weighted summation comprises:
determining a position of the respective edge pixel; obtaining a distance between a position of each reference pixel in the first reference pixels and the second reference pixels and the position of the respective edge pixel; determining a weight for each reference pixel according to the distance from the position of the respective edge pixel; and performing the weighted summation on the pixel values of the first reference pixels and the pixel values of the second reference pixels by using the weights, to obtain the target pixel value of the respective edge pixel.

5 . The method according to claim 1 , wherein
the determining the first edge pixel set includes:
obtaining a first row position and/or a first column position pre-configured in the first decoded block, and
determining the first edge pixel set according to the first row position and/or the first column position; and
the determining the second edge pixel set includes:
obtaining a second row position and/or a second column position pre-configured in the second decoded block, and
determining the second edge pixel set according to the second row position and/or the second column position.

6 . The method according to claim 1 , wherein
the adjusting the second resolution includes adjusting the second resolution to the first resolution when the target resolution is equal to the first resolution; the adjusting the first resolution includes adjusting the first resolution to the second resolution when the target resolution is equal to the second resolution; and the adjusting the first resolution includes adjusting the first resolution to a third resolution and the adjusting the second resolution includes adjusting the second resolution to the third resolution when the target resolution is equal to the third resolution, the third resolution being different from the first resolution and the second resolution.

7 . The method according to claim 1 , wherein
the adjusting the first resolution includes downsampling the first resolution when the first resolution is greater than the target resolution, and upsampling the first resolution when the first resolution is less than the target resolution; and the adjusting the second resolution includes downsampling the second resolution when the second resolution is greater than the target resolution, and upsampling the second resolution when the second resolution is less than the target resolution.

8 . A video processing method, the method comprising:
determining at least one pair of encoded blocks to be reconstructed in a video frame, each pair of encoded blocks in the at least one pair of encoded blocks including a first encoded block of a first resolution and a second encoded block of a second resolution, the first encoded block being adjacent to the second encoded block; adjusting the first resolution of the first encoded block to a target resolution; adjusting the second resolution of the second encoded block to the target resolution; determining a first edge pixel set in the first encoded block; determining a second edge pixel set in the second encoded block, the second edge pixel set being adjacent to the first edge pixel set; and filtering, by processing circuitry, the first edge pixel set and the second edge pixel set.

9 . The method according to claim 8 , wherein the filtering comprises:
determining first reference pixels associated with the first edge pixel set in the first encoded block; determining second reference pixels associated with the second edge pixel set in the second encoded block; and filtering the first edge pixel set and the second edge pixel set according to pixel values of the first reference pixels and pixel values of the second reference pixels, a first difference between a pixel value of an i th pixel in the filtered first edge pixel set and a pixel value of a j th pixel that corresponds to the i th pixel and is in the filtered second edge pixel set being less than a second difference between a pixel value of an i th pixel in the first edge pixel set and a pixel value of a j th pixel in the second edge pixel set, i being a positive integer that is less than or equal to a total quantity of pixels in the first edge pixel set, j being a positive integer that is less than or equal to a total quantity of pixels in the second edge pixel set.

10 . The method according to claim 9 , wherein the filtering comprises:
determining edge pixels in the first edge pixel set and the second edge pixel set; and for each of the edge pixels,
performing a weighted summation on the pixel values of the first reference pixels and the pixel values of the second reference pixels to obtain a target pixel value of the respective edge pixel; and
updating a pixel value of the respective edge pixel to the target pixel value of the respective edge pixel to obtain a filtered respective edge pixel.

11 . The method according to claim 10 , wherein the performing the weighted summation comprises:
determining a position of the respective edge pixel; obtaining a distance between a position of each reference pixel in the

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Gao Xinwei
• Li Weiran
• Mao Xunan
• Gu Chenchen

Classifications

• H04N21/4621

  Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen (arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10) · CPC title

• H04N21/440263

  by altering the spatial resolution, e.g. for displaying on a connected PDA · CPC title

• H04N21/2662

  Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities · CPC title

• H04N21/234363

  by altering the spatial resolution, e.g. for clients with a lower screen resolution · CPC title

• H04N19/86

  involving reduction of coding artifacts, e.g. of blockiness · CPC title