Video encoding method and apparatus, video decoding method and apparatus, computer device, and storage medium

Patent metadata

Field	Value
Publication number	US-11330254-B2
Application number	US-202016988511-A
Country	US
Kind code	B2
Filing date	Aug 7, 2020
Priority date	Jun 20, 2018
Publication date	May 10, 2022
Grant date	May 10, 2022

Abstract

The embodiments of this application relate to a video encoding method performed at a computer device. The video encoding method includes: during video encoding, obtaining an input video sequence; selecting, from candidate video sequence encoding modes, a target video sequence encoding mode corresponding to the input video sequence, the candidate video sequence encoding modes including a constant-resolution encoding mode and a mixed-resolution encoding mode; and encoding each input video frame of the input video sequence according to the target video sequence encoding mode, to obtain encoded data.

First claim

What is claimed is:

1. A video encoding method, performed by a computer device having a processor and memory storing a plurality of computer programs to be executed by the processor, the method comprising:
obtaining an input video sequence;
selecting, from one or more candidate video sequence encoding modes, a target video sequence encoding mode for the input video sequence according to one or more attributes of the input video sequence and/or the computer device, the attributes including: a real-time or non-real time application of the input video sequence, a bandwidth for playback of the input video sequence, and a processing speed of the processor, wherein:
the selected target video sequence encoding mode is a mixed-resolution encoding mode; and
in the mixed-resolution encoding mode, different input video frames in the input video sequence are encoded at varying resolutions that are adaptively adjusted according to the one or more attributes;

encoding each of the input video frames of the input video sequence according to the target video sequence encoding mode, including encoding a first frame of the input video frames at a first resolution and a second frame of the input video frames at a second resolution that is distinct from the first resolution;
processing each frame of the input video sequence according to the target video sequence encoding mode information, further including:
adding, to sequence-level header information of the encoded data, a flag bit for describing the target video sequence encoding mode, wherein the flag bit has a first predefined value corresponding to the mix-resolution encoding mode; and
for each of the video input frames, adding a respective frame-level header information indicating a respective processing manner for the input video frame to achieve the respective resolution; and

obtaining the encoded data in accordance with the encoding.

2. The method according to claim 1 , wherein encoding each of the input video frames of the input video sequence further comprises:
obtaining a processing manner corresponding to the input video frame when the target video sequence encoding mode is the mixed-resolution encoding mode;
processing the input video frame according to the processing manner to obtain a current frame having a resolution that corresponds to a resolution of the input video frame or a resolution that is less than a resolution of the input video frame; and
encoding the current frame at the resolution to obtain the encoded data corresponding to the input video frame.

3. The method according to claim 1 , wherein selecting the target video sequence encoding mode further comprises:
obtaining current environment information, the current environment information comprising at least one of current encoding environment information and current decoding environment information.

4. The method according to claim 3 , wherein the current environment information further comprises current application scenario information; and the method further comprises:
selecting the mixed-resolution encoding mode as the target video sequence encoding mode when the current application scenario is a real-time application scenario.

5. The method according to claim 1 , wherein adding
the flag bit for describing the target video sequence encoding mode comprises adding the flag bit to sequence-level header information of the encoded data, and the first predefined value corresponding to the mixed-resolution encoding mode is 1.

6. A computer device, comprising:
a processor; and
memory;
the memory storing a plurality of computer programs that, when executed by the processor, causing the processor to perform a plurality of operations including:
obtaining an input video sequence;
selecting, from one or more candidate video sequence encoding modes, a target video sequence encoding mode for the input video sequence according to one or more attributes of the input video sequence and/or the computer device, the attributes including: a real-time or non-real time application of the input video sequence, a bandwidth for playback of the input video sequence, and a processing speed of the processor, wherein:
the selected target video sequence encoding mode is a mixed-resolution encoding mode; and
in the mixed-resolution encoding mode, different input video frames in the input video sequence are encoded at varying resolutions that are adaptively adjusted according to the one or more attributes;

encoding each of the input video frames of the input video sequence according to the target video sequence encoding mode, including encoding a first frame of the input video frames at a first resolution and a second frame of the input video frames at a second resolution that is distinct from the first resolution;
processing each frame of the input video sequence according to the target video sequence encoding mode information, further including:
adding, to sequence-level header information of the encoded data, a flag bit for describing the target video sequence encoding mode, wherein the flag bit has a first predefined value corresponding to the mix-resolution encoding mode; and
for each of the video input frames, adding a respective frame-level header information indicating a respective processing manner for the input video frame to achieve the respective resolution; and

obtaining the encoded data in accordance with the encoding.

7. The computer device according to claim 6 , wherein encoding each of the input video frames of the input video sequence further comprises:
obtaining a processing manner corresponding to the input video frame when the target video sequence encoding mode is the mixed-resolution encoding mode;
processing the input video frame according to the processing manner to obtain a current frame having a resolution that corresponds to a resolution of the input video frame or a resolution that is less than a resolution of the input video frame; and
encoding the current frame at the resolution to obtain encoded data corresponding to the input video frame.

8. The computer device according to claim 6 , wherein selecting the target video sequence encoding mode further comprises:
obtaining current environment information, the current environment information comprising at least one of current encoding environment information and current decoding environment information.

9. The computer device according to claim 8 , wherein the current environment information further comprises current application scenario information; and the plurality of operations further include:
selecting the mixed-resolution encoding mode as the target video sequence encoding mode when the current application scenario is a real-time application scenario.

10. The computer device according to claim 6 , wherein adding
flag bit for describing the target video sequence encoding mode comprises adding the flag bit to sequence-level header information of the encoded data, and the first predefined value corresponding to the mixed-resolution encoding mode is 1.

11. A non-transitory computer-readable storage medium, storing a plurality of computer programs that, when executed by a processor of a computer device, cause the computer device to perform a plurality of operations including:
obtaining an input video sequence;
selecting, from one or more candidate video sequence encoding modes, a target video sequence encoding mode for the input video sequence according to one or more attributes of the input video sequence and/or the computer device, the attributes including: a real-time or non-real time application of the input video sequence, a bandwidth for playback of the input video sequence, and a proce

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Gao Xinwei
• Mao Xunan
• Gu Chenchen

Classifications

• H04N19/179

  the unit being a scene or a shot · CPC title

• H04N19/70

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N19/156

  Availability of hardware or computational resources, e.g. encoding based on power-saving criteria · CPC title

• H04N19/103 Primary

  Selection of coding mode or of prediction mode · CPC title

• H04N19/132

  Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking · CPC title