Inter layer texture prediction for video coding

Patent metadata

Field	Value
Publication number	US-9392274-B2
Application number	US-201313838270-A
Country	US
Kind code	B2
Filing date	Mar 15, 2013
Priority date	Mar 22, 2012
Publication date	Jul 12, 2016
Grant date	Jul 12, 2016

Abstract

An apparatus for coding video information according to certain aspects is disclosed. Multi-layer video steams including a base layer and an enhancement layer can be coded. Predictors generated for the base layer and the enhancement layer can be combined to form a final predictor of the enhancement layer. Each predictor can be weighted such that those predictors which are more likely to produce high quality results can be factored more heavily in the final predictor. The conditions upon which the respective weights for enhancement layer predictors and base layer predictors are determined may be implicitly derived from the predictors or characteristics thereof. Alternatively, data may be generated explicating indicating the weights or providing information from which the weights can be determined.

First claim

What is claimed is:

1. An apparatus for coding digital video, the apparatus comprising:
a memory configured to store video information associated with a base layer and a corresponding enhancement layer; and
a processor in communication with the memory, the processor configured to:
determine a first weight associated with a first video unit in the base layer and a second weight associated with a second video unit in a frame of the enhancement layer, wherein the second weight is determined based at least in part on a spatial distance between (1) a current video unit of a current enhancement layer block in the frame of the enhancement layer and (2) a border of a neighboring enhancement layer block in a prediction direction; and
code the current video unit using an inter-layer prediction based at least in part on the first weight, and an intra-layer prediction based at least in part on the second weight.

2. The apparatus of claim 1 , wherein at least one of the first and second weights is not equal to 1.

3. The apparatus of claim 1 , wherein the processor is further configured to code the current video unit in the frame of the enhancement layer based at least in part on a final predictor, and wherein the final predictor comprises a combination of a base layer predictor weighted according to the first weight and an enhancement layer predictor weighted according to the second weight.

4. The apparatus of claim 3 , wherein the first weight and the second weight sum to a predetermined constant for all base layer predictors and enhancement layer predictors combined to determine final predictors for the current enhancement layer block.

5. The apparatus of claim 1 , wherein the second weight is greater than the first weight for enhancement layer video units substantially adjacent spatially to previously coded enhancement layer blocks in the prediction direction.

6. The apparatus of claim 1 , wherein the first weight is greater than the second weight for enhancement layer video units spatially farthest from previously coded enhancement layer blocks in the prediction direction.

7. The apparatus of claim 1 , wherein the video information comprises one or more of an intra prediction direction, a pixel location, a quantization parameter, and a spatial scaling ratio.

8. The apparatus of claim 7 , wherein the second weight is determined as a function of both a quantization parameter of the base layer, QP1, and a quantization parameter of the enhancement layer, QP2.

9. The apparatus of claim 8 , wherein the second weight increases as the value of QP1-QP2 increases.

10. The apparatus of claim 7 , wherein the second weight is determined as a function of the spatial scaling ratio.

11. The apparatus of claim 10 , wherein the second weight increases as the spatial scaling ratio increases.

12. The apparatus of claim 1 , wherein the video information does not comprise the first and second weights.

13. The apparatus of claim 1 , wherein the video information comprises weighting data regarding the first and second weights.

14. The apparatus of claim 13 , wherein the weighting data comprises a location within the current enhancement layer block at which the first weight and the second weight are equal.

15. The apparatus of claim 14 , wherein the processor is further configured to determine the first and second weights for multiple video units associated with the current enhancement layer block based at least in part on the location at which the first and second weights are equal.

16. The apparatus of claim 1 , wherein coding digital video comprises encoding digital video.

17. The apparatus of claim 1 , wherein coding digital video comprises decoding digital video.

18. The apparatus of claim 1 , wherein the second video unit comprises a pixel in the neighboring enhancement layer block.

19. The apparatus of claim 1 , wherein a first value for the second weight, determined based on the spatial distance between the current video unit and the border of the neighboring enhancement layer block in the prediction direction, is greater than a second value for the second weight, determined based on a second spatial distance between a second current video unit and the border of the neighboring enhancement layer block in the prediction direction, and wherein the first value is greater than the second value due to the second spatial distance being greater than the spatial distance.

20. A method of coding digital video, the method comprising:
obtaining video information associated with a base layer and a corresponding enhancement layer;
determining a first weight associated with a first video unit in the base layer and a second weight associated with a second video unit in a frame of the enhancement layer, wherein the second weight is determined based at least in part on a spatial distance between (1) a current video unit of a current enhancement layer block in the frame of the enhancement layer and (2) a border of a neighboring enhancement layer block in a prediction direction; and
coding the current video unit using an inter-layer prediction based at least in part on the first weight, and an intra-layer prediction based at least in part on the second weight.

21. The method of claim 20 , wherein coding the current video unit in the frame of the enhancement layer is based at least in part on a final predictor, and wherein the final predictor comprises a combination of a base layer predictor weighted according to the first weight and an enhancement layer predictor weighted according to the second weight.

22. The method of claim 21 , wherein the first weight and the second weight sum to a predetermined constant for all base layer predictors and enhancement layer predictors combined to determine final predictors for the current enhancement layer block.

23. The method of claim 20 , wherein the second weight is greater than the first weight for enhancement layer video units substantially adjacent to previously coded enhancement layer blocks.

24. The method of claim 20 , wherein the first weight is greater than the second weight for enhancement layer video units farthest from previously coded enhancement layer blocks.

25. The method of claim 20 , wherein the video information comprises one or more of an intra prediction direction, a pixel location, a quantization parameter, and a spatial scaling ratio.

26. The method of claim 25 , wherein the second weight is determined as a function of both a quantization parameter of the base layer, QP1, and a quantization parameter of the enhancement layer, QP2.

27. The method of claim 26 , wherein the second weight increases as the value of QP1-QP2 increases.

28. The method of claim 25 , wherein the second weight is determined as a function of the spatial scaling ratio.

29. The method of claim 28 , wherein the second weight increases as the spatial scaling ratio increases.

30. The method of claim 20 , wherein the video information does not comprise the first and second weights.

31. The method of claim 20 , wherein the video information comprises weighting data regarding the first and second weights.

32. The method of claim 31 , wherein the weighting data comprises a location within the current enhancement layer block at which the first weight and the second weight are equal.

Assignees

• Qualcomm Inc

Inventors

• Wang Xianglin
• Karczewicz Marta

Classifications

• H04N19/46

  Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) · CPC title

• H04N19/167

  Position within a video image, e.g. region of interest [ROI] · CPC title

• H04N19/59

  involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution · CPC title

• H04N19/30 Primary

  using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) · CPC title

• H04N19/33

  in the spatial domain · CPC title