Dynamically updating quality to higher chroma sampling rate

Patent metadata

Field	Value
Publication number	US-9854201-B2
Application number	US-201514599412-A
Country	US
Kind code	B2
Filing date	Jan 16, 2015
Priority date	Jan 16, 2015
Publication date	Dec 26, 2017
Grant date	Dec 26, 2017

Abstract

Innovations in encoding of video pictures in a high-resolution chroma sampling format (such as YUV 4:4:4) using a video encoder operating on coded pictures in a low-resolution chroma sampling format (such as YUV 4:2:0) are presented. For example, according to a set of decision rules, high chroma resolution details are selectively encoded on a region-by-region basis such that increases in bit rate (due to encoding of sample values for the high chroma resolution details) happen when and where corresponding increases in chroma resolution are likely to improve quality in noticeable ways. In this way, available encoders operating on coded pictures in the low-resolution chroma sampling format can be effectively used to provide high chroma resolution details.

First claim

We claim:

1. A computer system comprising a processor, memory, and storage, wherein the computer system is configured to implement a video processing tool comprising:
a formatter configured to pack sample values of an input picture organized according to an input picture format into first and second coded pictures organized according to first and second coded picture formats, respectively, the first coded picture containing sample values for a low chroma resolution version of the input picture, and the second coded picture containing sample values for high chroma resolution details of the input picture;
a video encoder system configured to encode the first and second coded pictures to produce encoded data, including, for each of multiple regions of the first and second coded pictures:
evaluating one or more attributes of the region;
based at least in part on results of the evaluating, determining whether or not to encode sample values in the region for the high chroma resolution details of the input picture as part of the second coded picture; and
selectively encoding, or skipping encoding of, the sample values in the region for the high chroma resolution details of the input picture as part of the second coded picture; and

a buffer configured to output the encoded data.

2. The computer system of claim 1 , wherein the input picture format has a first chroma sampling rate, and wherein at least one of the first and second coded picture formats has a second chroma sampling rate lower than the first chroma sampling rate.

3. The computer system of claim 2 , wherein the first chroma sampling rate is 4:4:4, and wherein the second chroma sampling rate is 4:2:0.

4. The computer system of claim 1 , wherein the evaluating the one or more attributes of the region includes:
evaluating extent of change in the region between one of the first and second coded pictures and a most recent previous picture for which the region was encoded.

5. The computer system of claim 4 , wherein the evaluating the extent of change in the region includes one or more of:
computing differences between sample values in the region for the one of the first and second coded pictures and sample values in the region for the most recent previous picture for which the region was encoded, and evaluating magnitude of the differences; and
comparing one or more motion vector values in the region to a motion vector threshold.

6. The computer system of claim 4 , wherein the evaluating the extent of change in the region includes comparing, to a threshold count, a count of pictures over which the region is unchanged for low chroma resolution versions.

7. The computer system of claim 1 , wherein the evaluating the one or more attributes of the region includes:
evaluating whether quality of encoded data for the region satisfies a threshold level of quality.

8. The computer system of claim 7 , wherein the evaluating the quality of encoded data for the region includes comparing one or more quantization parameter values in the region to a quantization parameter threshold.

9. The computer system of claim 1 , wherein the evaluating the one or more attributes of the region includes:
classifying content in the region.

10. The computer system of claim 9 , wherein the classifying the content n the region includes classifying the content as text content or non-text content.

11. The computer system of claim 9 , wherein the classifying the content in the region includes classifying the content as high chroma content, in which chroma sample values are significant compared to a significance threshold, or low chroma content, in which chroma sample values are insignificant compared to the significance threshold.

12. The computer system of claim 1 , wherein the encoding the first and second coded pictures further includes, for each of the multiple regions:
based at least in part on the results of the evaluating, determining whether or not to encode sample values in the region for the low chroma resolution version of the input picture as part of the first coded picture; and
selectively encoding, or skipping the encoding of, the sample values in the region for the low chroma resolution version of the input picture as part of the first coded picture in the first coded picture format.

13. The computer system of claim 12 , wherein, for each of the multiple regions:
if the region has changed between the low chroma resolution version of the input picture and a low chroma resolution version of a most recent previous picture for which the region was encoded, the sample values in the region for the low chroma resolution version of the input picture are encoded at an initial quality level as part of the first coded picture;
otherwise, if quality of encoded data for the region fails to satisfy a threshold level of quality, the sample values in the region for the low chroma resolution version of the input picture are encoded at a high quality level as part of the first coded picture; and
otherwise, the sample values in the region for the high chroma resolution details of the input picture are encoded as part of the second coded picture.

14. The computer system of claim 13 , wherein the sample values in the region for the high chroma resolution details of the input picture are encoded at a default quality level.

15. The computer system of claim 13 , wherein, when the sample values in the region for the high chroma resolution details of the input picture are encoded:
if the region has changed between the high chroma resolution details of the input picture and high chroma resolution details of a most recent previous picture for which the region was encoded, the sample values in the region for the high chroma resolution details of the input picture are encoded at an initial quality level; and
otherwise, the sample values in the region for the high chroma resolution details of the input picture are encoded at a high quality level.

16. The computer system of claim 13 , wherein the encoding the first and second coded pictures further includes, for the region:
comparing a count of pictures over which the region is unchanged for low chroma resolution versions to a threshold count, wherein the encoding of the sample values in the region for the high chroma resolution details of the input picture depends on the comparison of the count of pictures to the threshold count.

17. The computer system of claim 13 , wherein the encoding the first and second coded pictures further includes, for the region:
classifying content of the region, wherein the encoding of the sample values in the region for the high chroma resolution details of the input picture depends on the content of the region being classified as text content.

18. The computer system of claim 13 , wherein the encoding the first and second coded pictures further includes, for the region:
classifying content of the region, wherein the encoding of the sample values in the region for the high chroma resolution details of the input picture depends on the content of the region being classified as high chroma content in which chroma sample values are significant compared to a significance threshold.

19. In a computer system that implements a video encoder system, a method comprising:
packing sample values of an input picture organized according to an input picture format into first and second coded pictures organized according to first and second coded picture formats, respectively, the first coded picture containing sample values for a low chroma resolutio

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Aharon Shir
• Zhu Lihua
• Kumar B Anil
• Van Eesteren Jeroen E

Classifications

• H04N19/167

  Position within a video image, e.g. region of interest [ROI] · CPC title

• H04N19/186 Primary

  the unit being a colour or a chrominance component · CPC title

• H04N19/17

  the unit being an image region, e.g. an object · CPC title

• H04N7/0102 Primary

  involving the resampling of the incoming video signal · CPC title

• H04N19/513

  Processing of motion vectors · CPC title