Video encoder with quantization control

Patent metadata

Field	Value
Publication number	US-11843776-B2
Application number	US-202217843160-A
Country	US
Kind code	B2
Filing date	Jun 17, 2022
Priority date	Apr 9, 2019
Publication date	Dec 12, 2023
Grant date	Dec 12, 2023

Abstract

In one implementation, a method of encoding an image is performed at a device including one or more processors and non-transitory memory. The method includes determining a category of a spatial portion of an image based on a relation between a plurality of thresholds associated with a plurality of quantization scaling parameters and a bit rate of the spatial portion of the image at the plurality of quantization scaling parameters. The method includes quantizing the spatial portion of the image based on the categorization.

First claim

What is claimed is:

1. A method comprising:
at an electronic device including one or more processors and non-transitory memory:
receiving an image comprising a plurality of pixels having respective plurality of pixel locations and a respective plurality of pixel values;
applying a frequency transform to a spatial portion of the image to generate a plurality of frequency coefficients respectively associated with a plurality of spatial frequencies;
obtaining a quantization matrix including, for each of the plurality of spatial frequencies, a respective quantization parameter;
determining a category of the spatial portion of the image based on a relation between a plurality of thresholds associated with a plurality of quantization scaling parameters and a bit rate of the spatial portion of the image at the plurality of quantization scaling parameters;
determining a quantization scaling parameter for the spatial portion of the image based the category;
quantizing the plurality of frequency coefficients according to the quantization matrix and the quantization scaling parameter for the spatial portion of the image to generate a plurality of quantized frequency coefficients; and
transmitting the plurality of quantized frequency coefficients.

2. The method of claim 1 , wherein the plurality of thresholds are based on a target bit rate for the spatial portion of the image.

3. The method of claim 1 , further comprising obtaining a quantization spreading parameter defining the plurality of thresholds associated with the plurality of quantization scaling parameters.

4. The method of claim 3 , wherein the quantization spreading parameter defines a plurality of denominators and the plurality of thresholds are based on a target bit rate for the spatial portion of the image respectively divided by the plurality of denominators.

5. The method of claim 3 , wherein, for a particular value of the quantization spreading parameter, the plurality of thresholds are equal.

6. The method of claim 1 , wherein determining the category of the spatial portion of the image includes comparing the bit rate of the spatial portion of the image at each of the plurality of quantization scaling parameters to a corresponding threshold for each of the plurality of quantization scaling parameters.

7. The method of claim 6 , wherein determining the category of the spatial portion of the image includes determining a lowest quantization scaling parameter of the plurality of quantization scaling parameters at which the bit rate of the spatial portion of the image is less than the corresponding threshold.

8. The method of claim 1 , wherein determining the quantization scaling parameter for the spatial portion of the image based the category includes selecting a high quantization scaling parameter of the category.

9. The method of claim 1 , wherein determining the quantization scaling parameter for the spatial portion of the image based on the category includes selecting a quantization scaling parameter between a low quantization scaling parameter of the category and a high quantization scaling parameter of the category.

10. The method of claim 9 , wherein the quantization scaling parameter for the spatial portion of the image is a mean of the low quantization scaling parameter of the category and the high quantization scaling parameter of the category.

11. The method of claim 9 , wherein determining the quantization scaling parameter for the spatial portion of the image comprises:
determining a middle quantization scaling parameter of the category between the low quantization scaling parameter of the category and the high quantization scaling parameter of the category;
determining a middle threshold of the category between a low threshold of the category and a high threshold of the category;
determining a bit rate of the spatial portion of the image at the middle quantization scaling parameter; and
selecting the quantization scaling parameter for the spatial portion of the image based on a relation between the middle threshold of the category and the bit rate of the spatial portion of the image at the middle quantization scaling parameter.

12. The method of claim 11 , wherein selecting the quantization scaling parameter for the spatial portion of the image includes selecting the middle quantization scaling parameter as the quantization scaling parameter of the spatial portion of the image.

13. The method of claim 1 , further comprising determining the bit rate of the spatial portion of the image at the plurality of quantization scaling parameters,
wherein determining the bit rate of the spatial portion of the image at the plurality of quantization scaling parameters comprises either, depending on at least one of a target bit rate of the spatial portion of the image, a signal-to-noise ratio of the spatial portion of the image, a complexity of the spatial portion of the image, or channel conditions of a channel over which the plurality of quantized frequency coefficients are transmitted, determining an estimated bit rate of the spatial portion of the image at the plurality of quantization scaling parameters or determining an actual bit rate of the spatial portion of the image at the plurality of quantization scaling parameters.

14. A device comprising:
non-transitory memory; and
one or more processors to:
receive an image comprising a plurality of pixels having respective plurality of pixel locations and a respective plurality of pixel values;
apply a frequency transform to a spatial portion of the image to generate a plurality of frequency coefficients respectively associated with a plurality of spatial frequencies;
obtain a quantization matrix including, for each of the plurality of spatial frequencies, a respective quantization parameter;
determine a category of the spatial portion of the image based on a relation between a plurality of thresholds associated with a plurality of quantization scaling parameters and a bit rate of the spatial portion of the image at the plurality of quantization scaling parameters;
determine a quantization scaling parameter for the spatial portion of the image based the category;
quantize the plurality of frequency coefficients according to the quantization matrix and the quantization scaling parameter for the spatial portion of the image to generate a plurality of quantized frequency coefficients; and
transmit the plurality of quantized frequency coefficients.

15. The device of claim 14 , wherein the one or more processors are further to obtain a quantization spreading parameter defining the plurality of thresholds associated with the plurality of quantization scaling parameters.

16. The device of claim 15 , wherein the quantization spreading parameter defines a plurality of denominators and the plurality of thresholds are based on a target bit rate for the spatial portion of the image respectively divided by the plurality of denominators.

17. The device of claim 15 , wherein, for a particular value of the quantization spreading parameter, the plurality of thresholds are equal.

18. The device of claim 14 , wherein the one or more processors are to determine the quantization scaling parameter for the spatial portion of the image based on the category by selecting a quantization scaling parameter between a low quantization scaling parameter of the category and a high quantization scaling parameter of the category.

19. The device of claim 18 , wherein the one or more processors are to determine the quantization scaling parameter for

Assignees

• Apple Inc

Inventors

• Rapaka Krishnakanth
• Nakazato Munehiro
• Shen Jiandong
• Yadav Ganesh G
• Cismas Sorin Constantin
• Chou Jim C
• Pan Hao

Classifications

• H04N19/124 Primary

  Quantisation · CPC title

• H04N19/126

  Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers · CPC title

• H04N19/60

  using transform coding · CPC title