Image Encoding and Decoding Method and Apparatus

Patent metadata

Field	Value
Publication number	US-2023103928-A1
Application number	US-202217993533-A
Country	US
Kind code	A1
Filing date	Nov 23, 2022
Priority date	May 26, 2020
Publication date	Apr 6, 2023
Grant date	—

Abstract

An image encoding and decoding method includes obtaining a to-be-encoded image, where the to-be-encoded image is divided into a base layer and at least one enhancement layer; when feedback information sent by a decoder side is received, determining a reconstructed image corresponding to a frame sequence number and a layer sequence number indicated in the feedback information as a first reference frame, and performing inter encoding on the base layer based on the first reference frame to obtain a bitstream of the base layer; encoding the at least one enhancement layer to obtain a bitstream of the at least one enhancement layer; and sending the bitstream of the base layer and the bitstream of the at least one enhancement layer to the decoder side, where the bitstream of the base layer carries coding reference information.

First claim

What is claimed is:

1 . An image encoding method, comprising:
obtaining a to-be-encoded image, wherein the to-be-encoded image is divided into a base layer and at least one enhancement layer; when feedback information sent by a decoder side is received, determining a reconstructed image corresponding to a frame sequence number and a layer sequence number indicated in the feedback information as a first reference frame, and performing inter encoding on the base layer based on the first reference frame to obtain a bitstream of the base layer; encoding the at least one enhancement layer to obtain a bitstream of the at least one enhancement layer; and sending the bitstream of the base layer and the bitstream of the at least one enhancement layer to the decoder side, wherein the bitstream of the base layer carries coding reference information, and the coding reference information comprises a frame sequence number and a layer sequence number of the first reference frame.

2 . The method according to claim 1 , wherein the to-be-encoded image is an entire image frame or one sub-image in an entire image frame.

3 . The method according to claim 2 , wherein when the to-be-encoded image is the one sub-image in the entire image frame, the feedback information further comprises location information, and the location information indicates a location of the to-be-encoded sub-image in the entire image frame.

4 . The method according to any one of claim 1 , wherein the frame sequence number indicates a preceding n th image frame of the to-be-encoded image, and n is a positive integer; and
the layer sequence number corresponds to an image layer that has highest quality or resolution and that is successfully decoded by the decoder side from a bitstream of the preceding n th image frame of the to-be-encoded image, the layer sequence number corresponds to an image layer that has highest quality or resolution and that is successfully received by the decoder side from a bitstream of the preceding n th image frame of the to-be-encoded image, or the layer sequence number corresponds to an image layer that is determined by the decoder side to have highest quality or resolution and that is to be decoded from a bitstream of the preceding n th image frame of the to-be-encoded image.

5 . The method according to any one of claim 1 , wherein after the obtaining a to-be-encoded image, the method further comprises:
when the feedback information is not received or the feedback information comprises identification information indicating a receiving failure or a decoding failure, performing inter encoding on the base layer based on a third reference frame, wherein the third reference frame is a reference frame for a base layer of a previous image frame of the to-be-encoded image.

6 . The method according to any one of claim 1 , wherein after the obtaining a to-be-encoded image, the method further comprises:
when the feedback information is not received or the feedback information comprises identification information indicating a receiving failure or a decoding failure, performing intra encoding on the base layer.

7 . The method according to claim 1 , wherein the encoding the at least one enhancement layer to obtain a bitstream of the at least one enhancement layer comprises:
performing inter encoding on a first enhancement layer based on a second reference frame to obtain a bitstream of the first enhancement layer, wherein the first enhancement layer is any one of the at least one enhancement layer, the second reference frame is a reconstructed image corresponding to a first image layer, and the first image layer has lower quality or resolution than quality or resolution of the first enhancement layer.

8 . The method according to claim 7 , wherein the first image layer is an image layer lower than the first enhancement layer, or the first image layer is the base layer.

9 . The method according to claim 7 , wherein in the process of encoding the at least one enhancement layer to obtain a bitstream of the at least one enhancement layer, the method further comprises:
buffering reconstructed images respectively corresponding to the base layer and the at least one enhancement layer.

10 . The method according to claim 1 , wherein before the determining a reconstructed image corresponding to a frame sequence number and a layer sequence number indicated in the feedback information as a first reference frame when feedback information sent by a decoder side is received, the method further comprises:
monitoring the feedback information within specified duration; and if the feedback information is received within the specified duration, determining that the feedback information is received.

11 . An image decoding method, comprising:
receiving, from an encoder side, a bitstream of a base layer and a bitstream of at least one enhancement layer of a to-be-decoded image, wherein the bitstream of the base layer carries coding reference information, and the coding reference information comprises a first frame sequence number and a first layer sequence number; determining a first reference frame based on the first frame sequence number and the first layer sequence number, and performing inter decoding on the bitstream of the base layer based on the first reference frame to obtain a reconstructed image corresponding to the base layer; decoding the bitstream of the at least one enhancement layer to obtain a reconstructed image corresponding to the at least one enhancement layer; and sending feedback information to the encoder side, wherein the feedback information comprises a second frame sequence number and a second layer sequence number, the second frame sequence number corresponds to the to-be-decoded image, and the second layer sequence number corresponds to an image layer having highest quality or resolution in the base layer and the at least one enhancement layer of the to-be-decoded image.

12 . The method according to claim 11 , wherein the to-be-decoded image is an entire image frame or one sub-image in an entire image frame.

13 . The method according to claim 12 , wherein when the to-be-decoded image is the one sub-image in the entire image frame, the feedback information further comprises location information, and the location information indicates a location of the to-be-decoded image in the entire image frame.

14 . The method according to claim 11 , wherein that the second layer sequence number corresponds to an image layer having highest quality or resolution in the base layer and the at least one enhancement layer of the to-be-decoded image specifically comprises:
the second layer sequence number corresponds to an image layer that has highest quality or resolution and that is successfully decoded from the bitstream of the base layer and the bitstream of the at least one enhancement layer of the to-be-decoded image; the second layer sequence number corresponds to an image layer that has highest quality or resolution and that is successfully received from the bitstream of the base layer and the bitstream of the at least one enhancement layer of the to-be-decoded image; or the second layer sequence number corresponds to an image layer that is currently determined to have highest quality or resolution and that is to be decoded from the bitstream of the base layer and the bitstream of the at least one enhancement layer of the to-be-decoded image.

15 . The method according to claim 11 , further comprising:
when both the bitstream of the base layer and the bitstream of the at least one enhancement layer fail to be recei

Assignees

• Huawei Tech Co Ltd

Inventors

• Zhang Yixuan
• Chen Shaolin
• Meng Lin
• Feng Junkai

Classifications

• H04N19/105

  Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction · CPC title

• H04N19/463

  by compressing encoding parameters before transmission · CPC title

• H04N19/172 Primary

  the region being a picture, frame or field · CPC title

• H04N19/164 Primary

  Feedback from the receiver or from the transmission channel · CPC title

• H04N19/117

  Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635) · CPC title