Anti-tearing picture processing method and apparatus

Patent metadata

Field	Value
Publication number	US-12355980-B2
Application number	US-202218147402-A
Country	US
Kind code	B2
Filing date	Dec 28, 2022
Priority date	Jun 30, 2020
Publication date	Jul 8, 2025
Grant date	Jul 8, 2025

Abstract

In a picture processing method, when receiving a first picture in a video stream, a decoder side determines, based on a base layer of the 1st sub-picture of the first picture, whether the first picture meets a first preset condition; and the decoder side sends a second picture within a display time period of the first picture for displaying if the first picture meets the first preset condition, where the second picture is a picture that is in the video stream and that is sent within a first display time period for displaying.

First claim

What is claimed is:

1. A picture processing method comprising:
receiving a first picture and a second picture in a video stream, wherein the first picture has a first display time period and the second picture has a second display time period after the first display time period, and wherein each picture in the video stream comprises a plurality of sub-pictures, and wherein each sub-picture comprises a base layer;
sending the first picture for displaying the first picture during the first display time period;
determining whether the second picture meets a first preset condition based on a base layer of a first sub-picture of the second picture;
sending, when the second picture meets the first preset condition, the first picture for displaying the first picture again during the second display time period;
determining, when scene switching occurs, whether the second picture meets a second preset condition based on the base layer of the first sub-picture of the second picture; and
sending, when the second picture meets the second preset condition, the first picture for displaying the first picture again during the second display time period.

2. The picture processing method of claim 1 , wherein the first preset condition comprises the base layer of the first sub-picture of the second picture is lost or partially lost.

3. The picture processing method of claim 1 , wherein the first sub-picture is an initial sub-picture of the second picture.

4. The picture processing method of claim 1 , wherein the second preset condition comprises a first ratio of an amount of encoded data at the base layer of the first sub-picture of the second picture received within a first preset duration to a first channel bandwidth is greater than or equal to a first preset value and a second ratio of the amount of the encoded data at the base layer of the first sub-picture of the second picture received within the first preset duration to a second channel bandwidth is greater than or equal to a second preset value, wherein the first channel bandwidth is a first average bandwidth within the first preset duration, wherein the second channel bandwidth is a second average bandwidth within a second preset duration, wherein the second preset duration is greater than the first preset duration, and wherein the second preset duration is based on extending the first preset duration forward or backward along a time axis.

5. The picture processing method of claim 1 , wherein each of the sub-pictures in the plurality of sub-pictures further comprises at least one enhancement layer, and wherein the picture processing method further comprises:
determining, when scene switching occurs, whether the second picture meets a second preset condition based on an enhancement layer of the first sub-picture of the second picture; and
entering, when the second picture meets the second preset condition, a target mode and sending the first picture for displaying the first picture again during the second display time period, and storing received sub-pictures of the second picture into a buffer.

6. The picture processing method of claim 5 , wherein the second preset condition comprises:
a quantity of received enhancement layers of the first sub-picture of the second picture is less than or equal to a first preset value; or
a first ratio of an amount of encoded data at an enhancement layer of the first sub-picture of the second picture received within a first preset duration to a first channel bandwidth is greater than or equal to a second preset value and a second ratio of the amount of the encoded data at the enhancement layer of the first sub-picture of the second picture received within the first preset duration to a second channel bandwidth is greater than or equal to a fifth preset value, wherein the first channel bandwidth is a first average bandwidth within the first preset duration, wherein the second channel bandwidth is a second average bandwidth within second preset duration, wherein the second preset duration is greater than the first preset duration, and wherein the second preset duration is obtained by extending the first preset duration forward or backward along a time axis.

7. The picture processing method of claim 5 , further comprising sending, when the target mode is entered, first indication information to an encoder side to indicate to the encoder side to enter the target mode.

8. The picture processing method of claim 7 , further comprising:
exiting the target mode to send a latest successfully decoded picture for displaying when a quantity of received enhancement layers of each of the sub-pictures of the second picture is greater than or equal to a first preset value; and
sending second indication information to the encoder side to indicate to the encoder side to exit the target mode.

9. A picture processing method comprising:
receiving first indication information from a decoder side during a process of sending a first picture in a video stream to the decoder side;
entering a target mode in response to the first indication information;
adjusting a coding parameter in the target mode to reduce an amount of encoded data of a second sub-picture following a first sub-picture of the first picture;
setting an inter-coding reference frame of a second picture following the first picture to the first picture;
receiving second indication information from the decoder side;
exiting the target mode in response to the second indication information;
terminating sending of the first picture to the decoder side in response to exiting the target mode; and
sending a latest successfully encoded picture in the video stream to the decoder side.

10. A picture processing method comprising:
determining, when scene switching occurs, whether a second picture in a video stream meets a first preset condition based on a base layer of a first sub-picture of the second picture, wherein each picture in the video stream comprises a plurality of sub-pictures, and wherein each sub-picture comprises a base layer and at least one enhancement layer;
sending first indication information to a decoder side when the second picture meets the first preset condition to indicate to the decoder side to send a second picture within a second display time period of the second picture for displaying the second picture again, wherein the second picture is a picture in the video stream that is sent for displaying within a second display time period prior to the second display time period;
determining, when scene switching occurs, whether the second picture meets a second preset condition based on an enhancement layer of the first sub-picture of the second picture;
entering a target mode when the second picture meets the second preset condition, and sending second indication information to the decoder side in the target mode to indicate to the decoder side to enter the target mode;
adjusting a coding parameter in the target mode to reduce a first amount of encoded data of a second sub-picture following the first sub-picture in the second picture; and
setting an inter-coding reference frame of a third picture following the second picture to the second picture.

11. The picture processing method of claim 10 , wherein the first preset condition comprises: a first ratio of an amount of encoded data at the base layer of the first sub-picture of the second picture that is successfully sent within a first preset duration to a first channel bandwidth is greater than a first preset value, and a second ratio of the amount of the encoded data at the base layer of the first sub-picture of the second picture that is successfully sent within the first preset duration to a second

Assignees

• Huawei Tech Co Ltd

Inventors

• Zhang Yixuan
• Chen Shaolin
• Meng Lin

Classifications

• H04N19/87

  involving scene cut or scene change detection in combination with video compression · CPC title

• H04N19/463

  by compressing encoding parameters before transmission · CPC title

• H04N19/423

  characterised by memory arrangements (H04N19/433 takes precedence) · CPC title

• H04N19/30

  using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) · CPC title

• H04N19/172

  the region being a picture, frame or field · CPC title