Spatially adaptive quantization-aware deblocking filter

Patent metadata

Field	Value
Publication number	US-11070808-B2
Application number	US-201916687719-A
Country	US
Kind code	B2
Filing date	Nov 19, 2019
Priority date	Apr 13, 2018
Publication date	Jul 20, 2021
Grant date	Jul 20, 2021

Abstract

A spatially adaptive quantization-aware deblocking filter is used for encoding or decoding video or image frames. The deblocking filter receives a reconstructed frame produced based on dequantized and inverse transformed coefficients of a video frame or an image frame. The reconstructed frame is filtered according to adaptive quantization field data for the video or image frame. The adaptive quantization field data represents weights applied to quantization values used at different areas of the video or image frame. A number of blocking artifacts remaining within the resulting filtered frame is determined. The adaptive quantization field data is then adjusted based on that number of blocking artifacts. The filtered frame is then filtered according to the adjusted adaptive quantization field data. The resulting re-filtered frame is then output to an output source, such as for transmission, display, storage, or further processing.

First claim

What is claimed is:

1. A method for decoding an encoded frame, the method comprising:
decoding, from a bitstream to which the encoded frame is encoded, quantized transform coefficients of encoded blocks of the encoded frame and adaptive quantization field data used to encode the encoded blocks;
producing a reconstructed frame, wherein producing the reconstructed frame includes dequantizing and inverse transforming the quantized transform coefficients;
filtering the reconstructed frame according to the adaptive field data to produce a filtered frame based on the reconstructed frame, wherein filtering the reconstructed frame includes modulating, according to the adaptive quantization field data, one or more of a non-linearity selection filter parameter, a filter size parameter, or a directional sensitivity filter parameter; and
outputting the filtered frame for storage or display.

2. The method of claim 1 , wherein filtering the reconstructed frame according to the adaptive quantization field data comprises:
producing filtered data by filtering the reconstructed frame according to the adaptive quantization field data;
determining a number of blocking artifacts within the filtered data;
adjusting at least some of the adaptive quantization field data based on the number of blocking artifacts within the filtered data; and
producing the filtered frame by re-filtering the reconstructed frame according to the adjusted adaptive quantization field data.

3. The method of claim 2 , wherein adjusting the at least some of the adaptive quantization field data based on the number of blocking artifacts within the filtered data comprises:
increasing the adaptive quantization field data responsive to determining that the number of blocking artifacts within the filtered data exceeds a threshold.

4. The method of claim 3 , wherein the threshold represents a maximum acceptable difference between a given area of the reconstructed frame and a corresponding area within an original frame encoded to produce the encoded frame.

5. The method of claim 4 , wherein the threshold is defined using a psychovisual model which analyzes visually perceptible artifacts resulting from filtering.

6. The method of claim 2 , wherein the filtered data is first filtered data, wherein producing the filtered frame by re-filtering the reconstructed frame according to the adjusted adaptive quantization field data comprises:
producing second filtered data by filtering the reconstructed frame according to the adjusted adaptive quantization field data;
determining a number of blocking artifacts within the second filtered data;
further adjusting the adjusted adaptive quantization field data based on the number of blocking artifacts within the second filtered data; and
producing the filtered frame by re-filtering the reconstructed frame according to the further adjusted adaptive quantization field data.

7. The method of claim 2 , wherein adjustments to the adaptive quantization field data are limited by an error level definition representing a maximum quantization error for the reconstructed frame.

8. A method for decoding an encoded frame, the method comprising:
receiving an encoded frame and adaptive quantization field data used to encode the encoded frame;
producing a reconstructed frame using the encoded frame;
changing, based on the adaptive quantization field data, one or more of a non-linearity selection filter parameter, a filter size parameter, or a directional sensitivity filter parameter available for filtering the reconstructed frame;
producing filtered data by filtering the reconstructed frame according to the adaptive quantization field data and using the changed one or more of the non-linearity selection filter parameter, the filter size parameter, or the directional sensitivity filter parameter;
determining whether a number of blocking artifacts within the filtered data exceeds a threshold;
responsive to determining that the number of blocking artifacts within the filtered data exceeds the threshold, adjusting at least some of the adaptive quantization field data for further use in filtering the reconstructed frame; and
producing a filtered frame by re-filtering the reconstructed frame according to the adjusted adaptive quantization field data.

9. The method of claim 8 , wherein adjusting the at least some of the adaptive quantization field data comprises:
increasing a weight applied to a quantization value used to process a first area of the reconstructed frame by a first amount; and
increasing a weight applied to a quantization value used to process a second area of the reconstructed frame by a second amount,
wherein the first amount and the second amount are different.

10. The method of claim 9 , wherein the first amount and the second amount are determined based on an amount by which the first area and the second area of the reconstructed frame differ from corresponding areas within an original frame encoded to produce the encoded frame.

11. The method of claim 8 , wherein the changes to the one or more of the non-linearity selection filter parameter, the filter size parameter, or the directional sensitivity filter parameter are based on a visual perceptibility of data within the reconstructed frame.

12. The method of claim 11 , wherein the visual perceptibility of the data within the reconstructed frame is analyzed using a psychovisual model, wherein the threshold is defined using the psychovisual model.

13. The method of claim 12 , wherein changing the non-linearity selection filter parameter causes a preservation of certain types of the data within the reconstructed frame.

14. The method of claim 13 , wherein the certain types of the data within the reconstructed frame are a first set of reconstructed frame data and remaining data within the reconstructed frame are a second set of reconstructed frame data, wherein the filtering of the reconstructed frame according to the adaptive quantization field data and using the changed one or more of the non-linearity selection filter parameter, the filter size parameter, or the directional sensitivity filter parameter is limited to the second set of reconstructed frame data.

15. A method for decoding an encoded frame, the method comprising:
producing a reconstructed frame from the encoded frame;
adjusting adaptive quantization field data for the encoded frame according to one or more details within the reconstructed frame; and
controlling a filtering of the reconstructed frame using the adjusted adaptive quantization field data.

16. The method of claim 15 , wherein controlling the filtering of the reconstructed frame using the adjusted adaptive quantization field data comprises:
using the adaptive quantization field data to control one or both of a strength or a spatial size of a deblocking filter.

17. The method of claim 16 , wherein the adaptive quantization field data indicates that a first area of the reconstructed frame was encoded using a first quantization value and that a second area of the reconstructed frame was encoded using a second quantization value, wherein the first quantization value is higher than the second quantization value,
wherein using the adaptive quantization field data to control the one or both of the strength or the spatial size of the deblocking filter comprises:
filtering the first area of the reconstructed frame using a first filter strength and the second area of the reconstructed frame using a second filter strength, wherein the first filter strength is stronger than the second filter strength.

Assignees

• Google Llc

Inventors

• Alakuijala Jyrki
• Wassenberg Jan

Classifications

• H04N19/86 Primary

  involving reduction of coding artifacts, e.g. of blockiness · CPC title

• H04N19/80 Primary

  Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence) · CPC title

• H04N19/70

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N19/44

  Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder · CPC title

• H04N19/186

  the unit being a colour or a chrominance component · CPC title