Video encoding optimization with extended spaces

Patent metadata

Field	Value
Publication number	US-9854246-B2
Application number	US-201414503200-A
Country	US
Kind code	B2
Filing date	Sep 30, 2014
Priority date	Feb 28, 2014
Publication date	Dec 26, 2017
Grant date	Dec 26, 2017

Abstract

Embodiments of the present invention may provide a video coder. The video coder may include an encoder to perform coding operations on a video signal in a first format to generate coded video data, and a decoder to decode the coded video data. The video coder may also include an inverse format converter to convert the decoded video data to second format that is different than the first format and an estimator to generate a distortion metric using the decoded video data in the second format and the video signal in the second format. The encoder may adjust the coding operations based on the distortion metric.

First claim

We claim:

1. A method, comprising:
performing coding operations on an in-process formatted first video data of an input signal to generate coded first video data;
decoding the coded first video data to produce reference video data in the in-process format;
converting the decoded reference video data to an other format different from the in-process format;
estimating coding factors for prediction based on the reference video data in the other format and a second video data of the input signal in the other format;
performing coding operations on the second video data in the in-process format based on the estimated coding factors for prediction and the reference video data in the in-process format; and
outputting the coded second video data.

2. The method of claim 1 , wherein the other format is an original format of the input signal, and the original format is a higher resolution than the in-process format.

3. The method of claim 1 , wherein the coding operations include calculating a distortion metric.

4. The method of claim 1 , wherein the coding operations include mode decisions for the current block to be encoded.

5. The method of claim 1 , further comprising:
pre-analyzing the input signal in the other format to derive target space information, and
controlling quantization parameters during the coding operations of the in-process formatted input signal based on the derived information.

6. The method of claim 1 , wherein the other format is based on a target display.

7. The method of claim 1 , further comprising:
converting the input signal into a plurality of formats including the other format;
converting the decoded video data into the plurality of formats;
estimating the coding factors using the decoded video data and the input signal, both in the plurality of formats.

8. The method of claim 7 , wherein the plurality of formats correspond to different target displays.

9. The method of claim 1 , further comprising:
converting the input signal to a second in-process format;
performing coding operations on the second in-process formatted input signal to generate second coded video data;
outputting the first and second coded video data in parallel.

10. The method of claim 9 , further comprising:
decoding the second coded video data;
converting the second decoded video data to the other format, which is different than the second in-process format;
estimating coding factors of the second in-process formatted input signal using the on the second decoded data in the other format and the input signal in the other format;
based on the estimated factors of the second in-process formatted input signal, adjusting the coding operations therein.

11. The method of claim 1 , wherein the estimating coding parameters for prediction comprises:
estimating coding parameters for prediction based on the first video data in the in-process format and a second video data in the in-process format; and
adjusting the coding parameters for prediction based on the first video data in the other format and a second video data in the other format.

12. A non-transitory computer readable medium storing program instructions that, when executed by a processing device, causes the device to perform a method comprising:
coding first data of an input signal, in a first format, to generate a first output signal;
decoding the first output signal;
converting the decoded first output signal to a second format;
estimating coding factors for prediction of second data of the input signal based on the decoded output signal in the second format; and
coding the second data of the input signal in the first format based on the estimated factors.

13. The non-transitory computer readable medium of claim 12 , wherein the second format is an original format of the input signal, and the original format is a higher resolution than the first format.

14. The non-transitory computer readable medium of claim 12 , further comprising:
pre-analyzing the input signal in the second format to derive target space information, and
controlling quantization parameters during coding of the first formatted input signal based on the derived information.

15. The non-transitory computer readable medium of claim 12 , wherein the second format is based on a target display.

16. The non-transitory computer readable medium of claim 12 ,
converting the input signal into a plurality of formats including the second format;
converting the decoded output signal into the plurality of formats;
estimating the coding factors using the decoded output signal and the input signal, both in the plurality of formats.

17. The non-transitory computer readable medium of claim 12 , wherein the estimating coding parameters for prediction comprises:
estimating coding parameters for prediction based on the first video data in the first format and a second video data in the first format; and
adjusting the coding parameters for prediction based on the first video data in the second format and a second video data in the second format.

18. A video coder, comprising:
an encoder to perform coding operations on first data and second data of a video signal in a first format to generate first coded video data and second coded video data;
a decoder to decode the first coded video data;
an inverse format converter to convert the decoded first video data to second format that is different than the first format;
an estimator to estimate prediction parameters for predicting the second video data in first format from decoded first video data in the first format based on the decoded first video data in the second format and the second video data in the second format; and
wherein the encoder encodes the second video data using the estimated prediction parameters.

19. The video coder of claim 18 , wherein the second format is an original format of the video signal, and the original format is a higher resolution than the first format.

20. The video coder of claim 18 , further comprising:
a pre-analyzer to pre-analyze the video signal in the second format to derive target space information, and to control quantization parameters during coding operations of the first formatted video signal based on the derived information.

21. The video coder of claim 18 , wherein the second format is based on a target display.

22. The video coder of claim 18 ,
a plurality of format converters to convert the video signal into a plurality of formats including the second format;
a plurality of inverse format converter to convert the decoded video data into the plurality of formats;
wherein the estimator generates the distortion metric using the decoded video data and the video signal, both in the plurality of formats.

23. The video coder of claim 18 , wherein the estimating parameters comprises:
estimating prediction parameters based on the first video data in the first format and a second video data in the first format; and
adjusting the prediction parameters for prediction based on the first video data in second format and a second video data in the second format.

Assignees

• Apple Inc

Inventors

• Tourapis Alexandros
• Singer David
• Cote Guy
• Millet Timothy J

Classifications

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title

• H04N19/154 Primary

  Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147) · CPC title

• H04N19/124

  Quantisation · CPC title

• H04N19/103

  Selection of coding mode or of prediction mode · CPC title

• H04N19/40

  using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream · CPC title