Encoding/decoding method, apparatus, and system

Patent metadata

Field	Value
Publication number	US-2025142088-A1
Application number	US-202519009255-A
Country	US
Kind code	A1
Filing date	Jan 3, 2025
Priority date	Jul 5, 2022
Publication date	May 1, 2025
Grant date	—

Abstract

Disclosed are an encoding/decoding method, apparatus, and system. In an implementation, the encoding method includes: encoding video information, where the video information includes M frames, the M frames include a first frame, a second frame, and a third frame, the second frame refers to the first frame, and the third frame refers to the second frame or the first frame, storing the first frame, the second frame, and the third frame in a buffer to obtain candidates of a long-term reference frame, and selecting a subset from the candidates based on a feedback signal as a long-term reference frame.

First claim

1 . A video encoding method, wherein the method comprises:
encoding video information, wherein the video information comprises M frames, the M frames comprise a first frame, a second frame, and a third frame, the second frame refers to the first frame, and the third frame refers to the second frame or the first frame; storing the first frame, the second frame, and the third frame in a buffer to obtain candidates of a long-term reference frame; and selecting a subset from the candidates as the long-term reference frame.

2 . The method according to claim 1 , wherein selecting the subset from the candidates comprises:
determining, based on a feedback signal, to select one or more of the first frame, the second frame, and the third frame from the candidates as the long-term reference frame, wherein the feedback signal indicates whether a receiver successfully performs receiving.

3 . The method according to claim 1 , wherein the encoding is layered encoding, and wherein selecting the subset from the candidates comprises:
selecting a layer from the long-term reference frame as the long-term reference frame.

4 . The method according to claim 3 , wherein each of the M frames comprises a basic layer and an enhancement layer, and encoding at the basic layer in each frame refers to an enhancement layer in the long-term reference frame.

5 . The method according to claim 3 , wherein each of the M frames comprises a basic layer and an enhancement layer, and encoding at the enhancement layer in each frame refers to a lower layer in a same frame and a same layer in a previous frame.

6 . The method according to claim 1 , wherein the method further comprises:
adding a first mark to the video information, wherein the first mark indicates frame information or layer information of the candidates of the long-term reference frame.

7 . The method according to claim 1 , wherein the method further comprises:
adding a second mark to the video information, wherein the second mark indicates frame information or layer information of the long-term reference frame.

8 . The method according to any one of claim 2 , wherein a frame delay of the feedback signal is at least M frames.

9 . The method according to claim 2 , wherein the feedback signal comprises candidate information of the long-term reference frame that is successfully received, and wherein the method further comprises:
determining and updating the long-term reference frame based on the candidate information.

10 . The method according to claim 8 , wherein the method further comprises:
determining, based on candidate information of the long-term reference frame in each of a plurality of feedback signals, candidate information of the long-term reference frame successfully received on a plurality of channels; and determining and updating the long-term reference frame based on the candidate information successfully received on the plurality of channels.

11 . The method according to claim 2 , wherein a latest determined long-term reference frame is used based on the feedback signal.

12 . The method according to claim 1 , wherein the method further comprises:
determining, according to a pre-determined rule, to select the subset from the candidates as the long-term reference frame.

13 . The method according to claim 1 , wherein storing the first frame, the second frame, and the third frame in the buffer comprises:
storing frame quantities of the first frame, the second frame, and the third frame and location information of frames in the buffer, wherein the location information comprises frame information or layer information of the first frame, the second frame, and the third frame.

14 . A video encoding apparatus, comprising:
at least one processor; and one or more memories coupled to the at least one processor and storing programming instructions for execution by the at least one processor to perform operations comprising: encoding video information, wherein the video information comprises M frames, the M frames comprise a first frame, a second frame, and a third frame, the second frame refers to the first frame, and the third frame refers to the second frame or the first frame; storing the first frame, the second frame, and the third frame in a buffer to obtain candidates of a long-term reference frame; and
selecting a subset from the candidates as the long-term reference frame.

15 . The apparatus according to claim 14 , wherein selecting the subset from the candidates comprises:
determining, based on a feedback signal, to select one or more of the first frame, the second frame, and the third frame from the candidates as the long-term reference frame, wherein the feedback signal indicates whether a receiver successfully performs receiving.

16 . The apparatus according to claim 14 , wherein the encoding is layered encoding, and wherein selecting the subset from the candidates comprises:
selecting a layer from the long-term reference frame as the long-term reference frame.

17 . The apparatus according to claim 16 , wherein each of the M frames comprises a basic layer and an enhancement layer, and encoding at the basic layer in each frame refers to an enhancement layer in the long-term reference frame.

18 . The apparatus according to claim 16 , wherein each of the M frames comprises a basic layer and an enhancement layer, and encoding at the enhancement layer in each frame refers to a lower layer in a same frame and a same layer in a previous frame.

19 . The apparatus according to claim 16 , wherein the operations further comprise:
adding a first mark to the video information, wherein the first mark indicates frame information or layer information of the candidates of the long-term reference frame.

20 . A non-transitory, computer-readable medium storing one or more instructions executable by at least one processor to perform operations comprising:
encoding video information, wherein the video information comprises M frames, the M frames comprise a first frame, a second frame, and a third frame, the second frame refers to the first frame, and the third frame refers to the second frame or the first frame; storing the first frame, the second frame, and the third frame in a buffer to obtain candidates of a long-term reference frame; and selecting a subset from the candidates as the long-term reference frame.

Assignees

• Huawei Tech Co Ltd

Inventors

• Zhang Yixuan
• Chen Shaolin
• Song Yi
• Di Peiyun

Classifications

• H04N19/30

  using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) · CPC title

• H04N19/46

  Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) · CPC title

• H04N19/423

  characterised by memory arrangements (H04N19/433 takes precedence) · CPC title

• H04N19/172

  the region being a picture, frame or field · CPC title

• H04N19/164 Primary

  Feedback from the receiver or from the transmission channel · CPC title