Bandwidth saving architecture for scalable video coding spatial mode

Patent metadata

Field	Value
Publication number	US-10659796-B2
Application number	US-201816126704-A
Country	US
Kind code	B2
Filing date	Sep 10, 2018
Priority date	Nov 29, 2012
Publication date	May 19, 2020
Grant date	May 19, 2020

Abstract

A system and method for scalable video coding that includes base layer having lower resolution encoding, enhanced layer having higher resolution encoding and the data transferring between two layers. The system and method provides several methods to reduce bandwidth of inter-layer transfers while at the same time reducing memory requirements. Due to less memory access, the system clock frequency can be lowered so that system power consumption is lowered as well. The system avoids having prediction data from base layer to enhanced layer to be up-sampled for matching resolution in the enhanced layer as transferring up-sampled data can impose a big burden on memory bandwidth.

First claim

What is claimed is:

1. A system configured to perform scalable video encoding comprising:
a memory; and
a processing unit, wherein the processing unit is configured to:
receive video data, wherein the video data includes one or more frames;
encode at least one frame to a base layer;
generate inter-layer data based on the at least one frame, wherein the inter-layer data includes any one or a combination of residual data, reconstruction data, and motion data, wherein the inter-layer data includes a bit indicating whether the inter-layer data includes residual data;
upsample the inter-layer data; and
encode the at least one frame to an enhanced layer using the upsampled inter-layer data based on a block type of the base layer, wherein the block type of the base layer indicates whether the inter-layer data includes either residual data or reconstruction data, wherein the resolution of the enhanced layer is greater than the resolution of the base layer.

2. The system of claim 1 , wherein the processing unit includes one encoder.

3. The system of claim 1 , wherein the processing unit includes a base layer encoder and an enhanced layer encoder.

4. The system of claim 3 , wherein the base layer encoder is configured to generate the inter-layer data based on the at least one frame and transmit the inter-layer data to the enhanced layer encoder.

5. The system of claim 4 , wherein the inter-layer data is transmitted to the enhanced layer decoder over a plurality of data channels.

6. The system of claim 5 , wherein a same number of the plurality data channels are used for the transmission of the residual data or the reconstruction data included in the inter-layer data.

7. The system of claim 3 , wherein the enhanced layer encoder is configured to upsample the inter-layer data and encode the at least one frame to the enhanced layer using the upsampled inter-layer data based on the block type of the base layer.

8. A method for use in a processing system for performing scalable video encoding comprising:
receiving video data, wherein the video data includes one or more frames;
encoding at least one frame to a base layer;
generating inter-layer data based on the at least one frame, wherein the inter-layer data includes any one or a combination of residual data, reconstruction data, and motion data, wherein the inter-layer data includes a bit indicating whether the inter-layer data includes residual data;
upsampling the inter-layer data; and
encoding the at least one frame to an enhanced layer using the upsampled inter-layer data based on a block type of the base layer, wherein the block type of the base layer indicates whether the inter-layer data includes either residual data or reconstruction data, wherein the resolution of the enhanced layer is greater than the resolution of the base layer.

9. The method of claim 8 , wherein the processing system includes one encoder.

10. The method of claim 8 , wherein the processing system includes a base layer encoder and an enhanced layer encoder.

11. The method of claim 10 further comprising generating, by the base layer encoder, the inter-layer data based on the at least one frame and transmit the inter-layer data to the enhanced layer encoder.

12. The method of claim 10 , wherein the inter-layer data is transmitted to the enhanced layer decoder over a plurality of data channels.

13. The method of claim 12 , wherein a same number of the plurality data channels are used for the transmission of the residual data or the reconstruction data included in the inter-layer data.

14. The method of claim 10 further comprising upsampling, by the enhanced layer encoder, the inter-layer data and encoding the at least one frame to the enhanced layer using the upsampled inter-layer data based on the block type of the base layer.

15. A non-transitory computer readable medium storing instructions that, when executed in a processing system, cause the processing system to perform instructions for performing scalable video encoding comprising:
receiving video data, wherein the video data includes one or more frames;
encoding at least one frame to a base layer;
generating inter-layer data based on the at least one frame, wherein the inter-layer data includes any one or a combination of residual data, reconstruction data, and motion data, wherein the inter-layer data includes a bit indicating whether the inter-layer data includes residual data;
upsampling the inter-layer data; and
encoding the at least one frame to an enhanced layer using the upsampled inter-layer data based on a block type of the base layer, wherein the block type of the base layer indicates whether the inter-layer data includes either residual data or reconstruction data, wherein the resolution of the enhanced layer is greater than the resolution of the base layer.

16. The non-transitory computer readable medium of claim 15 , wherein the processing system includes one encoder.

17. The non-transitory computer readable medium of claim 15 , wherein the processing system includes a base layer encoder and an enhanced layer encoder.

18. The non-transitory computer readable medium of claim 17 further comprising generating, by the base layer encoder, the inter-layer data based on the at least one frame and transmit the inter-layer data to the enhanced layer encoder.

19. The non-transitory computer readable medium of claim 17 , wherein the inter-layer data is transmitted to the enhanced layer decoder over a plurality of data channels.

20. The non-transitory computer readable medium of claim 19 , wherein a same number of the plurality data channels are used for the transmission of the residual data or the reconstruction data included in the inter-layer data.

21. The non-transitory computer readable medium of claim 17 further comprising upsampling, by the enhanced layer encoder, the inter-layer data and encoding the at least one frame to the enhanced layer using the upsampled inter-layer data based on the block type of the base layer.

Assignees

• Advanced Micro Devices Inc
• Ati Technologies Ulc

Inventors

• Zhang Lei
• Zhou Ji
• Chen Zhen
• Yu Min

Classifications

• H04N19/423 Primary

  characterised by memory arrangements (H04N19/433 takes precedence) · CPC title

• H04N19/80

  Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence) · CPC title

• H04N19/33 Primary

  in the spatial domain · CPC title

• H04N19/59

  involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution · CPC title

• H04N19/187

  the unit being a scalable video layer · CPC title