Video coding method, network device, and storage medium

Patent metadata

Field	Value
Publication number	US-2025260817-A1
Application number	US-202218704798-A
Country	US
Kind code	A1
Filing date	Mar 2, 2022
Priority date	Nov 1, 2021
Publication date	Aug 14, 2025
Grant date	—

Abstract

A video coding method, a network device, and a computer-readable storage medium are disclosed. The method includes: performing reinforcement learning network training on an acquired image sequence to obtain optimized coding unit partitioning information corresponding to the image sequence; obtaining game result information corresponding to optimized coding contents according to the optimized coding contents, reference coding contents, and a preset evaluation index, with the optimized coding contents being obtained according to the optimized coding unit partitioning information, and the reference coding contents being obtained according to the image sequence; and when it is determined that the game result information meets a preset game condition, determining a coding mode corresponding to the optimized coding unit partitioning information as a video coding mode for the image sequence.

First claim

1 . A video coding method, comprising:
performing reinforcement learning network training on an acquired image sequence to obtain optimized coding unit partitioning information corresponding to the image sequence; obtaining game result information corresponding to optimized coding contents according to the optimized coding contents, reference coding contents, and a preset evaluation index, wherein the optimized coding contents are obtained according to the optimized coding unit partitioning information, and the reference coding contents are obtained according to the image sequence; and in response to determining that the game result information meets a preset game condition, determining a coding mode corresponding to the optimized coding unit partitioning information as a video coding mode for the image sequence.

2 . The video coding method of claim 1 , wherein the reinforcement learning network training comprises forward network training, backward network training, and fusion network training; and performing reinforcement learning network training on the acquired image sequence to obtain the optimized coding unit partitioning information corresponding to the image sequence comprises:
performing the backward network training on the acquired image sequence to obtain backward coding unit partitioning information corresponding to the image sequence; performing the forward network training on the acquired image sequence to obtain forward coding unit partitioning information corresponding to the image sequence; and performing the fusion network training on the backward coding unit partitioning information and the forward coding unit partitioning information to obtain the optimized coding unit partitioning information corresponding to the image sequence.

3 . The video coding method of claim 2 , wherein the image sequence comprises N frames; and performing the backward network training on the acquired image sequence to obtain the backward coding unit partitioning information corresponding to the image sequence comprises:
traversing all frames in the image sequence in order of N to 1 in a following way: obtaining first sub-coding unit partitioning information of an i th frame according to image information of the i th frame and first sub-coding unit partitioning information of a (i+1) th frame; and according to first sub-coding unit partitioning information of each frame, obtaining the backward coding unit partitioning information corresponding to the image sequence; where i represents the i th frame in the image sequence.

4 . The video coding method of claim 3 , wherein performing the forward network training on the acquired image sequence to obtain the forward coding unit partitioning information corresponding to the image sequence comprises:
traversing all the frames in the image sequence in order of 1 to N in a following way: obtaining second sub-coding unit partitioning information of a j th frame according to image information of the j th frame and second sub-coding unit partitioning information of a (j−1) th frame; and according to second sub-coding unit partitioning information of each frame, obtaining the forward coding unit partitioning information corresponding to the image sequence; where j represents the j th frame in the image sequence.

5 . The video coding method of claim 4 , wherein performing the fusion network training on the backward coding unit partitioning information and the forward coding unit partitioning information to obtain the optimized coding unit partitioning information corresponding to the image sequence comprises:
acquiring the first sub-coding unit partitioning information of each frame from the backward coding unit partitioning information, and acquiring the second sub-coding unit partitioning information of each frame from the forward coding unit partitioning information; obtaining sub-optimized coding unit partitioning information of each frame according to the first sub-coding unit partitioning information and the second sub-coding unit partitioning information of each frame; and obtaining the optimized coding unit partitioning information corresponding to the image sequence according to the sub-optimized coding unit partitioning information of each frame.

6 . The video coding method of claim 1 , wherein obtaining the game result information corresponding to the optimized coding contents according to the optimized coding contents, the reference coding contents, and the preset evaluation index comprises:
comparing the optimized coding contents with the reference coding contents according to the preset evaluation index, and determining a relative quality degree between the optimized coding contents and the reference coding contents; and obtaining the game result information corresponding to the optimized coding contents according to the relative quality degree between the optimized coding contents and the reference coding contents.

7 . The video coding method of claim 6 , wherein the game result information comprises success result information and failure result information, the optimized coding contents comprise several sub-optimized coding contents, and the reference coding contents comprise several sub-reference coding contents; and obtaining the game result information corresponding to the optimized coding contents according to the relative quality degree between the optimized coding contents and the reference coding contents comprises:
in response to determining that a sub-optimized coding content is better than a corresponding sub-reference coding content, obtaining success result information corresponding to the sub-optimized coding content; and in response to determining that a sub-reference coding content is better than a corresponding sub-optimized coding content, obtaining failure result information corresponding to the sub-optimized coding content.

8 . The video coding method of claim 7 , wherein the preset game condition comprises a winning probability threshold; and determining, in response to determining that the game result information meets the preset game condition, the coding mode corresponding to the optimized coding unit partitioning information as the video coding mode for the image sequence comprises:
counting all success result information and all failure result information corresponding to the sub-optimized coding contents; dividing the success result information by a sum of the success result information and the failure result information to obtain a success-result winning probability; and in response to determining that the success-result winning probability is not less than the winning probability threshold, determining the coding mode corresponding to the optimized coding unit partitioning information as the video coding mode for the image sequence.

9 . The video coding method of claim 7 , wherein the optimized coding unit partitioning information comprises reinforcement learning prediction information and success sub-coding unit partitioning information corresponding to the success result information, and the reinforcement learning prediction information is configured to represent a game success prediction probability corresponding to the optimized coding unit partitioning information; and the method further comprises:
in response to determining that the game result information does not meet the preset game condition, determining a network training weight according to the game result information, prediction error information, and the success sub-coding unit partitioning information, where the prediction error information is a difference between the game result information and the reinforcement learning prediction information; and performing the rein

Assignees

• Sanechips Tech Co Ltd

Inventors

• Yi Ziyao
• Xu Ke
• Kong Dehui
• Song Jianjun
• Ren Cong

Classifications

• G06N3/092

  Reinforcement learning · CPC title

• H04N19/154

  Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147) · CPC title

• G06N3/084

  Backpropagation, e.g. using gradient descent · CPC title

• H04N19/96

  Tree coding, e.g. quad-tree coding · CPC title

• H04N19/119 Primary

  Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks · CPC title