Video decoding method and apparatus, video encoding method and apparatus, storage medium, and electronic device

Patent metadata

Field	Value
Publication number	US-12294724-B2
Application number	US-202117469710-A
Country	US
Kind code	B2
Filing date	Sep 8, 2021
Priority date	Sep 27, 2019
Publication date	May 6, 2025
Grant date	May 6, 2025

Abstract

A video decoding method includes obtaining a current video frame and determining a region of interest (ROI) of the current video frame. The method also includes decoding the ROI by using a first resolution, and decoding at least other regions of the current video frame than the ROI by using second resolutions, the first resolution being higher than the second resolution.

First claim

What is claimed is:

1. A video decoding method performed by an electronic device, the method comprising:
obtaining a current video frame;
determining a region of interest (ROI) of the current video frame;
decoding the ROI by using a first resolution, and decoding at least other regions of the current video frame than the ROI by using a plurality of second resolutions, the first resolution being higher than the plurality of second resolutions, wherein the first resolution and the plurality of second resolutions are determined according to a comparison of a current transmission bandwidth of a video stream to a preset bandwidth threshold, the video stream including the current video frame; and
matching pixel sets at a boundary between a pair of a first decoding region a and a second decoding region among the at least other regions by applying edge filtering, wherein the first decoding region and the second decoding region are decoding regions with adjacent positions, including:
determining, among the plurality of second resolutions, a resolution A for the first decoding region and a resolution B for the second decoding region, wherein the resolution A is different from the resolution B;
identifying a target resolution for the first decoding region and the second decoding region, wherein the target resolution is different from the resolution A and the resolution B;
identifying a first edge pixel set in the first decoding region;
identifying a second edge pixel set, distinct from the first edge pixel set, in the second decoding region, wherein the second edge pixel set is adjacent to the first edge pixel set; and
filtering the first edge pixel set and the second edge pixel set according to the target resolution.

2. The method according to claim 1 , wherein the decoding the ROI by using a first resolution, and decoding at least other regions of the current video frame than the ROI by using second resolutions comprises:
decoding a target video block that has an overlapping part with the ROI among a plurality of video blocks by using the first resolution, and decoding other video blocks in the plurality of video blocks than the target video block by using the second resolutions, the current video frame being divided into the plurality of video blocks.

3. The method according to claim 2 , wherein the decoding other video blocks in the plurality of video blocks than the target video block by using the second resolutions comprises:
decoding the other video blocks in the plurality of video blocks than the target video block by using a plurality of resolutions, the second resolutions comprising the plurality of resolutions.

4. The method according to claim 1 , wherein the decoding the ROI by using a first resolution, and decoding at least other regions of the current video frame than the ROI by using second resolutions comprises:
obtaining a syntax element from each piece of to-be-decoded data in to-be-decoded data of a plurality of video blocks, a syntax element corresponding to a target video block in the plurality of video blocks that has an overlapping part with the ROI indicating that a resolution used to decode the target video block is the first resolution, and syntax elements corresponding to other video blocks in the plurality of video blocks than the target video block indicating that resolutions used to decode the other video blocks are the second resolutions; and
decoding the piece of to-be-decoded data by using a resolution indicated by the syntax element corresponding to the piece of to-be-decoded data.

5. The method according to claim 1 , wherein the determining a ROI of the current video frame comprises:
determining a region at a center of the current video frame as the ROI; or
determining a person region or a thing region in the current video frame as the ROI; or
determining a picture region in which motion exists in the current video frame as the ROI.

6. A video encoding method performed by an electronic device, the method comprising:
obtaining a second current video frame;
determining a region of interest (ROI) in the second current video frame;
encoding the ROI by using a first resolution, and encoding at least other regions of the second current video frame than the ROI by using a plurality of second resolutions, the first resolution being higher than the plurality of second resolutions, wherein the first resolution and the plurality of second resolutions are determined according to a comparison of a current transmission bandwidth of a video stream to a preset bandwidth threshold, the video stream including the second current video frame; and
matching pixel sets at a boundary between a pair of a first decoding region a and a second decoding region among the at least other regions by applying edge filtering, wherein the first decoding region and the second decoding region are decoding regions with adjacent positions, including:
determining, among the plurality of second resolutions, a resolution A for the first decoding region and a resolution B for the second decoding region, wherein the resolution A is different from the resolution B;
identifying a target resolution for the first decoding region and the second decoding region, wherein the target resolution is different from the resolution A and the resolution B;
identifying a first edge pixel set in the first decoding region;
identifying a second edge pixel set, distinct from the first edge pixel set, in the second decoding region, wherein the second edge pixel set is adjacent to the first edge pixel set; and
filtering the first edge pixel set and the second edge pixel set according to the target resolution.

7. The method according to claim 6 , wherein the encoding the ROI by using a first resolution, and encoding at least other regions of the second current video frame than the ROI by using second resolutions comprises:
dividing the second current video frame into a plurality of video blocks; and
encoding a target video block that has an overlapping part with the ROI among the plurality of video blocks by using the first resolution, and encoding other video blocks in the plurality of video blocks than the target video block by using the second resolutions.

8. The method according to claim 7 , wherein the encoding other video blocks in the plurality of video blocks than the target video block by using the second resolutions comprises:
encoding the other video blocks in the plurality of video blocks than the target video block by using a plurality of resolutions, the second resolutions comprising the plurality of resolutions.

9. The method according to claim 7 , wherein after the encoding a target video block that has an overlapping part with the ROI among the plurality of video blocks by using the first resolution, and encoding other video blocks in the plurality of video blocks than the target video block by using the second resolutions, the method further comprises:
adding a first syntax element to first encoded data corresponding to the target video block, and adding second syntax elements to second encoded data corresponding to the other video blocks, the first encoded data being data obtained by encoding the target video block by using the first resolution, the second encoded data being data obtained by encoding the other video blocks by using the second resolutions, the first syntax element being used for indicating the first resolution, and the second syntax elements being used for indicating the second resolutions.

10. An electronic device, comprising a memory and one or more processors, the memory storing computer-readable instructions, and the computer-readable instructions, when executed by the one or more process

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Gao Xinwei
• Li Weiran
• Gu Chenchen

Classifications

• H04N19/70

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N19/59

  involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution · CPC title

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title

• H04N19/119

  Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks · CPC title

• H04N19/132

  Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking · CPC title