Adaptive up-sampling filter for scalable video coding

Patent metadata

Field	Value
Publication number	US-9344718-B2
Application number	US-201313954749-A
Country	US
Kind code	B2
Filing date	Jul 30, 2013
Priority date	Aug 8, 2012
Publication date	May 17, 2016
Grant date	May 17, 2016

Abstract

Methods and systems for video image coding are provided. Sets of filters may be selected and applied to video information at least partially based on the type of inter layer prediction implemented in coding the video information. Different filters, or filter sets, may be used for inter layer intra prediction, difference domain intra prediction, and/or difference domain inter prediction. Filter selection information may be embedded in the video bit stream.

First claim

What is claimed is:

1. A device configured to code video information, the device comprising:
a processor configured to:
obtain a first layer and a second layer of video information;
identify an image filter set from a plurality of image filter sets comprising a first image filter set and a second image filter set based at least in part on an interlayer prediction type associated with the video information, wherein each of the plurality of image filter sets includes one or more image filters, wherein the processor is further configured to (i) identify the first image filter set based on the interlayer prediction type corresponding to inter layer intra prediction and (ii) identify the second image filter set based on the interlayer prediction type corresponding to one of difference domain intra prediction or difference domain inter prediction; and
generate a modified version of the first layer using the first layer and the identified image filter set; and

a memory in communication with the processor, the memory configured to store the modified version of the first layer.

2. The device of claim 1 , wherein the interlayer prediction type is one of: inter-layer intra prediction, difference domain intra prediction,or difference domain inter prediction.

3. The device of claim 1 , wherein the plurality of image filter sets includes an up-sampling filter set.

4. The device of claim 3 , wherein the second layer of information provides spatial scalability.

5. The device of claim 1 , wherein the plurality of image filter sets includes a preprocessing filter set, and wherein the second layer of information provides SNR scalability.

6. The device of claim 1 , wherein the plurality of image filter sets includes a down-sampling filter set.

7. The device of claim 1 , wherein the first layer is a base layer and the second layer is an enhancement layer.

8. The device of claim 1 , the device further comprising at least one image filter circuit configured to apply the plurality of image filter sets.

9. The device of claim 1 , wherein the plurality of image filter sets is stored in the memory.

10. The device of claim 1 , wherein each image filter set of the plurality of image filter sets comprises a plurality of coefficients.

11. The device of claim 10 , wherein the processor is further configured to:
decode the coefficients from the video information; and
receive a syntax element extracted from an encoded video bit stream, the syntax element comprising an indication of the interlayer prediction type.

12. The device of claim 10 , wherein the processor is further configured to:
encode the coefficients in the video information; and
generate a syntax element for an encoded video bit stream based at least in part on the interlayer prediction type.

13. The device of claim 10 , wherein at least one image filter set of the plurality of image filter sets comprises coefficients {0, 0, 0, 64, 0, 0, 0, 0} for a phase shift of zero, {0, 1, −3, 63, 4, −2, 1, 0} for a phase shift of one, {0, 2, −6, 61, 9, 3, 1, 0} for a phase shift of two, {−1, 3, −8, 60, 13, −4, 1, 0} for a phase shift of three, {−1, 4, −10, 58, 17, −5, 1, 0} for a phase shift of four, {−1, 4, −11, 53, 25, −8, 3, −1} for a phase shift of five, {−1, 4, −11, 50, 29, −9, 3, −1} for a phase shift of six, {−1, 4, −11, 45, 34, −10, 4, −1} for a phase shift of seven, {−1, 4, −11, 40, 40, −11, 4, −} for a phase shift of eight, {−1, 4, −10, 34, 45, −11, 4, −1} for a phase shift of nine, {−1, 3, −9, 29, 50, −11, 4, −1} for a phase shift of ten, {−1, 3, −8, 25, 53, −11, 4, −1} for a phase shift of eleven, {0, 1, −5, 17, 58, −10, 4, −1} for a phase shift of twelve, {0, 1, −4, 13, 60, −8, 3, −1} for a phase shift of thirteen, {0, 1, −3, 8, 62, −6, 2, 0} for a phase shift of fourteen, and {0, 1, −2, 4, 63, −3, 1, 0} for a phase shift of fifteen.

14. The device of claim 10 , wherein at least one image filter set of the plurality of image filter sets comprises coefficients {0, −2, 8, 52, 8, −2, 0, 0} for a phase shift of zero, {0, −1, 5, 51, 11, −3, 1, 0} for a phase shift of one, {0, −1, 3, 50, 15, −4, 1, 0} for a phase shift of two, {0, −1, 1, 49, 19, −5, 1, 0} for a phase shift of three, {0, 1, −3, 47, 23, −5, 1, 0} for a phase shift of four, {0, 1, −4, 45, 27, −6, 1, 0} for a phase shift of five, {0, 1, −5, 43, 30, −6, 1, 0} for a phase shift of six, {0, 1, −6, 41, 34, −7, 1, 0} for a phase shift of seven, {0, 2, −7, 37, 37, −7, 2, 0} for a phase shift of eight, {0, 1, −7, 34, 41, −6, 1, 0} for a phase shift of nine, {0, 1, −6, 30, 43, −5, 1, 0} for a phase shift of ten, {0, 1, −6, 27, 45, −4, 1, 0} for a phase shift of eleven, {0, 1, −5, 23, 47, −3, 1, 0} for a phase shift of twelve, {0, 1, −5, 19, 59, 1, −1, 0} for a phase shift of thirteen, {0, 1, −4, 15, 50, 3, −1, 0} for a phase shift of fourteen, and {0, 1, −3, 11, 51, 5, −1, 0} for a phase shift of fifteen.

15. The device of claim 1 , wherein the plurality of image filter sets further comprises a third image filter set, wherein the processor is further configured to:
identify the second image filter set based on the interlayer prediction type corresponding to difference domain intra prediction; and
identify the third image filter set based on the interlayer prediction type corresponding to difference domain inter prediction.

16. The device of claim 1 , wherein the first image filter set has higher frequency response cut-off than the second image filter set.

17. The device of claim 1 , wherein the plurality of image filter sets further comprises a third image filter set, wherein the processor is further configured to:
identify the third image filter set based on the interlayer prediction type corresponding to one of inter layer intra prediction or difference domain intra prediction; and
identify the second image filter set based on the interlayer prediction type corresponding to difference domain inter prediction.

18. The device of claim 17 , wherein the third image filter set has higher frequency response cut-off than the second image filter set.

19. The device of claim 1 , wherein the device is selected from the group consisting of a desktop computer, a notebook computer, a tablet computer, a set-top box, a telephone handset, a television, a camera, a display device, a digital media player, a video gaming console, and a video streaming device that comprises the memory and processor.

20. A method of coding video information, comprising:
obtaining a first layer and a second layer of video information;
identifying an image filter set from a plurality of image filter sets comprising a first image filter set and a second image filter set based at least in part on an interlayer prediction type associated with the video information, wherein each of the plurality of image filter sets includes one or more image filters, wherein identifying the image filter set comprises performing one of (i) identifying the first image filter set based on the interlayer prediction type corresponding to inter layer intra prediction or (ii) identifying the second image filter set based on the interlayer prediction type corresponding to one of difference domain intra prediction or difference domain inter prediction; and
generating a modified version of the first layer using the first layer and the identified image filter set.

21. The method of claim 20 , wherein generating the modified version of the first layer comprises up-sampling the first layer at least partially by using the identified image filter set.

22. Th

Assignees

• Qualcomm Inc

Inventors

• Chen Jianle
• Seregin Vadim
• Li Xiang
• Rapaka Krishnakanth
• Tu Chengjie
• Karczewicz Marta

Classifications

• H04N19/187

  the unit being a scalable video layer · CPC title

• H04N19/59

  involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution · CPC title

• H04N19/33

  in the spatial domain · CPC title

• H04N19/82

  involving filtering within a prediction loop · CPC title

• H04N19/159

  Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction · CPC title