Method and apparatus for sparsity-based de-artifact filtering for video encoding and decoding

Patent metadata

Field	Value
Publication number	US-9723330-B2
Application number	US-99872109-A
Country	US
Kind code	B2
Filing date	Nov 18, 2009
Priority date	Nov 25, 2008
Publication date	Aug 1, 2017
Grant date	Aug 1, 2017

Abstract

Methods and apparatus are provided for sparsity-based de-artifact filtering for video encoding and decoding. An apparatus includes an encoder ( 400 ) for encoding at least a portion of an image by grouping regions within the portion based on a grouping metric, transforming the grouped regions, adaptively performing de-artifact filtering on the transformed regions using a de-artifacting filter ( 413 ) included in the encoder, inverse transforming the de-artifacted regions to create replacement regions, and restoring the replacement regions to positions with the image from which the regions were taken prior to the grouping.

First claim

The invention claimed is:

1. An apparatus, comprising:
an encoder encoding at least a portion of an image using de-artifact filtering, said encoder comprising a de-artifacting filter that performs the de-artifact filtering by grouping regions within the portion based on dimensions and characteristics of the region or portion, transforming the grouped regions, adaptively performing the de-artifact filtering on the transformed regions, inverse transforming the de-artifacted regions to create replacement regions, and restoring the replacement regions to positions with the image from which the regions were taken prior to the grouping, wherein multiple estimates of the same pixel are obtained from overlapping regions and, for each pixel, adaptive sparsity-based filtering is used to fuse multiple estimates from redundant representations of the overlapping regions, and wherein a type and a strength of the de-artifact filtering is adaptively selected responsive to characteristics of at least one of quantization noise statistics, coding modes and motion information, local coding conditions, and compression requirements.

2. The apparatus of claim 1 , wherein the de-artifacting filter is useable in any of an in-loop configuration and an out-of-loop configuration.

3. The apparatus of claim 2 , wherein the de-artifacting filter replaces a deblocking filter when said de-artifacting filter is applied the in-loop configuration.

4. The apparatus of claim 2 , wherein the encoder includes a deblocking filter, and said de-artifacting filter is configured for use subsequent to the deblocking filter.

5. The apparatus of claim 1 , wherein the de-artifacting filter is a Wiener filter.

6. The apparatus of claim 1 , wherein the replacement regions are combined using weights prior to restoring.

7. The apparatus of claim 6 , wherein the grouped regions are transformed to obtain transform sparsity values there for, and the weights are determined responsive to the transform sparsity values.

8. A method performed in a video encoder, comprising:
encoding at least a portion of an image using de-artifact filtering,
wherein said de-artifact filtering comprises:
grouping regions within the portion based on dimensions and characteristics of the region or portion;
transforming the grouped regions;
adaptively performing de-artifact filtering on the transformed regions using a de-artifacting filter;
inverse transforming the de-artifacted regions to create replacement regions; and
restoring the replacement regions to positions with the image from which the regions were taken prior to the grouping, wherein multiple estimates of the same pixel are obtained from overlapping regions and, for each pixel, adaptive sparsity-based filtering is used to fuse multiple estimates from redundant representations of the overlapping regions, and,

wherein a type and a strength of the de-artifact filtering is adaptively selected responsive to characteristics of at least one of quantization noise statistics, coding modes and motion information, local coding conditions, and compression requirements.

9. The method of claim 8 , further comprising configuring the de-artifacting filter for use in any of an in-loop configuration and an out-of-loop configuration.

10. The method of claim 9 , further comprising replacing a deblocking filter with the de-artifacting filter when the de-artifacting filter is applied the in-loop configuration.

11. The method of claim 9 , wherein the encoder includes a deblocking filter, and the method further comprises configuring the de-artifacting filter for use subsequent to the deblocking filter.

12. The method of claim 8 , further comprising combining the replacement regions using weights prior to said restoring step.

13. The method of claim 12 , wherein the grouped regions are transformed to obtain transform sparsity values there for, and the weights are determined responsive to the transform sparsity values.

14. The method of claim 8 , further comprising applying a secondary filter before or after the de-artifacting filter.

15. An apparatus, comprising:
a decoder decoding at least a portion of an image using de-artifact filtering, said decoder comprising a de-artifact filter for performing the de-artifact filtering by grouping regions within the portion based on dimensions and characteristics of the region or portion, transforming the grouped regions, adaptively performing the de-artifact filtering on the transformed regions, inverse transforming the de-artifacted regions to create replacement regions, and restoring the replacement regions to positions with the image from which the regions were taken prior to the grouping, wherein multiple estimates of the same pixel are obtained from overlapping regions and, for each pixel, adaptive sparsity-based filtering is used to fuse multiple estimates from redundant representations of the overlapping regions, and,
wherein a type and a strength of the de-artifact filtering is adaptively selected responsive to characteristics of at least one of quantization noise statistics, coding modes and motion information, local coding conditions, and compression requirements.

16. The apparatus of claim 15 , wherein the de-artifacting filter is useable in any of an in-loop configuration and an out-of-loop configuration.

17. The apparatus of claim 16 , wherein the de-artifacting filter replaces a deblocking filter when said de-artifacting filter is applied the in-loop configuration.

18. The apparatus of claim 16 , wherein the decoder includes a deblocking filter, and said de-artifacting filter is configured for use subsequent to the deblocking filter.

19. The apparatus of claim 15 , wherein the de-artifacting filter is a Wiener filter.

20. The apparatus of claim 15 , wherein the replacement regions are combined using weights prior to restoring.

21. The apparatus of claim 20 , wherein the grouped regions are transformed to obtain transform sparsity values there for, and the weights are determined responsive to the transform sparsity values.

22. A method performed in a video decoder, comprising:
decoding at least a portion of an image using de-artifact filtering,
wherein said de-artifact filtering comprises:
grouping regions within the portion based on dimensions and characteristics of the region or portion;
transforming the grouped regions;
adaptively performing the de-artifact filtering on the transformed regions using a de-artifacting filter;
inverse transforming the de-artifacted regions to create replacement regions; and
restoring the replacement regions to positions with the image from which the regions were taken prior to the grouping, wherein multiple estimates of the same pixel are obtained from overlapping regions and, for each pixel, adaptive sparsity-based filtering is used to fuse multiple estimates from redundant representations of the overlapping regions, and,

wherein a type and a strength of the de-artifact filtering is adaptively selected responsive to characteristics of at least one of quantization noise statistics, coding modes and motion information, local coding conditions, and compression requirements.

23. The method of claim 22 , further comprising configuring the de-artifacting filter for use in any of an in-loop configuration and an out-of-loop configuration.

24. The method of claim 23 , further comprising replacing a deblocking filter with the de-artifacting filter when the de-artifacting filter is appli

Assignees

• Xu Jun
• Sole Joel
• Yin Peng
• Zheng Yunfei
• Thomson Licensing Dtv

Inventors

• Xu Jun
• Sole Joel
• Yin Peng
• Zheng Yunfei

Classifications

• H04N19/154

  Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147) · CPC title

• H04N19/80

  Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence) · CPC title

• H04N19/86 Primary

  involving reduction of coding artifacts, e.g. of blockiness · CPC title

• H04N19/18

  the unit being a set of transform coefficients · CPC title

• H04N19/157

  Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter · CPC title