Encoder-side decisions for sample adaptive offset filtering

Patent metadata

Field	Value
Publication number	US-11895295-B2
Application number	US-202217684514-A
Country	US
Kind code	B2
Filing date	Mar 2, 2022
Priority date	Apr 29, 2014
Publication date	Feb 6, 2024
Grant date	Feb 6, 2024

Abstract

Disclosed herein are exemplary embodiments of innovations in the area of encoding pictures or portions of pictures (e.g., slices, coding tree units, or coding units) and determining whether and how certain filtering operation should be performed and flagged for performance by the decoder in the bitstream. In particular examples, various implementations for setting the sample adaptive offset (SAO) syntax elements in the H.265/HEVC standard are disclosed. Although these examples concern the H.265/HEVC standard and its SAO filter, the disclosed technology is more widely applicable to other video codecs that involve filtering operations (particularly multi-stage filtering operations) as part of their encoding and decoding processes.

First claim

We claim:

1. In a computing device implementing a video encoder or image encoder, a method comprising:
for a series of pictures or picture portions being encoded, periodically applying a second stage of filtering of a multi-stage filtering process;
for each picture or picture portion in the series, specifying one or more syntax elements for controlling the second stage of filtering, including a syntax element that signals the periodic application of the second stage;
encoding the series of picture portions in a bitstream, the bitstream further including the specified one or more syntax elements that control application of the second stage of filtering; and
outputting the bitstream.

2. The method of claim 1 , wherein the periodically applying comprises applying the second stage of filtering every n pictures, and wherein n is an integer value greater than or equal to 2.

3. The method of claim 1 , wherein the periodically applying comprises applying the second stage of filtering every n picture portions, and wherein n is an integer value greater than or equal to 2.

4. The method of claim 3 , wherein the periodically applying further comprises varying the applying the second stage of filtering regionally from picture to picture, so that a given region does not have the second stage of filtering disabled between consecutive pictures.

5. The method of claim 3 , wherein the picture portions are coding tree units.

6. The method of claim 3 , wherein the picture portions are slices.

7. The method of claim 1 , wherein the second stage of filtering comprises sample adaptive offset (SAO) filtering, and wherein a first stage of filtering of the multi-stage filtering process comprises applying a deblocking filter.

8. The method of claim 7 , wherein the SAO filtering includes applying an edge offset (EO) technique, wherein the specifying comprises specifying a SAO parameter that indicates an EO class and SAO parameters that indicate offset values for the EO technique, and wherein the SAO parameter that indicates the EO class indicates which one of multiple directional one-dimensional patterns is to be used when applying the EO technique.

9. The method of claim 7 , wherein the SAO filtering includes applying a band offset (BO) technique, and wherein the specifying comprises specifying an SAO parameter that indicates a starting band position for applying offset values and SAO parameters that indicate the offset values for bands to which the BO technique is to be applied.

10. The method of claim 1 , wherein the periodically applying uses a fixed period.

11. The method of claim 1 , wherein the second stage of filtering includes non-linear filter operations, transform operations, or another type of filter operations.

12. One or more tangible computer-readable media storing computer-executable instructions for causing a computing device, when programmed thereby, to perform operations comprising:
for a series of pictures or picture portions being encoded, periodically applying a second stage of filtering of a multi-stage filtering process;
for each picture or picture portion in the series, specifying one or more syntax elements for controlling the second stage of filtering, the one or more syntax elements including a syntax element that signals the periodic application of the second stage of filtering;
encoding the series of picture portions, thereby producing a bitstream, the bitstream including the specified one or more syntax elements for controlling application of the second stage of filtering; and
outputting the bitstream.

13. The one or more computer-readable media of claim 12 , wherein the periodically applying comprises applying the second stage of filtering every n pictures, and wherein n is an integer value greater than or equal to 2.

14. The one or more computer-readable media of claim 12 , wherein the periodically applying comprises applying the second stage of filtering every n picture portions, and wherein n is an integer value greater than or equal to 2.

15. The one or more computer-readable media of claim 14 , wherein the periodically applying further comprises varying the applying the second stage of filtering regionally from picture to picture, so that a given region does not have the second stage of filtering disabled between consecutive pictures.

16. The one or more computer-readable media of claim 14 , wherein the picture portions are coding tree units or slices.

17. The one or more computer-readable media of claim 12 , wherein the second stage of filtering comprises sample adaptive offset (SAO) filtering, and wherein a first stage of filtering of the multi-stage filtering process comprises applying a deblocking filter.

18. The one or more computer-readable media of claim 12 , wherein the periodically applying uses a fixed period.

19. A computer system comprising:
a video encoder, implemented using one or more processors and memory, configured to perform operations, the operations comprising:
for a series of pictures or picture portions being encoded, periodically applying a second stage of filtering of a multi-stage filtering process;
for each picture or picture portion in the series, specifying one or more syntax elements for controlling the second stage of filtering, the one or more syntax elements including a syntax element that signals the periodic application of the second stage of filtering; and
encoding the series of picture portions, thereby producing a bitstream, the bitstream including the specified one or more syntax elements for controlling application of the second stage of filtering; and

a buffer configured to store the bitstream for output.

20. The computer system of claim 19 , wherein the periodically applying comprises applying the second stage of filtering every n picture portions, and wherein n is an integer value greater than or equal to 2.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Li Bin
• Zhou You
• Xu Jizheng
• Lin Chih-Lung
• Wu Feng

Classifications

• H04N19/117 Primary

  Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635) · CPC title

• H04N19/132

  Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking · CPC title

• H04N19/14

  Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence) · CPC title

• H04N19/157

  Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter · CPC title

• H04N19/172

  the region being a picture, frame or field · CPC title