Bandwidth saving architecture for scalable video coding

Patent metadata

Field	Value
Publication number	US-11095910-B2
Application number	US-201916706297-A
Country	US
Kind code	B2
Filing date	Dec 6, 2019
Priority date	Nov 29, 2012
Publication date	Aug 17, 2021
Grant date	Aug 17, 2021

Abstract

A system and method for scalable video coding that includes base layer having lower resolution encoding, enhanced layer having higher resolution encoding and the data transferring between two layers. The system and method provides several methods to reduce bandwidth of inter-layer transfers while at the same time reducing memory requirements. Due to less memory access, the system clock frequency can be lowered so that system power consumption is lowered as well. The system avoids having prediction data from base layer to enhanced layer to be up-sampled for matching resolution in the enhanced layer as transferring up-sampled data can impose a big burden on memory bandwidth.

First claim

What is claimed is:

1. A system configured to perform scalable video encoding comprising:
a memory;
a buffer; and
a processing unit, wherein the processing unit is configured to:
generate a base layer bit stream based on one or more frames;
generate inter-layer data including either residual data or reconstruction data based on a block type of the base layer bit stream, wherein a same number of bits are used for the residual data and the reconstruction data in the inter-layer data;
upsample the inter-layer data;
generate an enhanced layer bit stream based on the one or more frames and the upsampled inter-layer data; and
merge the base layer bit stream and enhanced layer bit stream into a video stream.

2. The system of claim 1 , wherein the inter-layer data includes a bit indicating whether the inter-layer data includes residual data.

3. The system of claim 1 , wherein the processing unit includes one encoder.

4. The system of claim 1 , wherein the processing unit includes a base layer encoder and an enhanced layer encoder.

5. The system of claim 4 , wherein the base layer encoder is configured to generate the inter-layer data and transmit the inter-layer data to the enhanced layer encoder.

6. The system of claim 5 , wherein the inter-layer data is transmitted to the enhanced layer encoder over a plurality of data channels.

7. The system of claim 4 , wherein the enhanced layer encoder is configured to upsample the inter-layer data and generate an enhanced layer bit stream based on the one or more frames and the upsampled inter-layer data.

8. The system of claim 1 , wherein the processing unit is configured to store the inter-layer data in the buffer.

9. The system of claim 8 , wherein the processing unit is configured to fetch the inter-layer data from the buffer before upsampling the inter-layer data and encoding the one or more frames to an enhanced layer bit stream.

10. A method for use in a processing system for performing scalable video encoding comprising:
generating a base layer bit stream based on one or more frames;
generating inter-layer data including either residual data or reconstruction data based on a block type of the base layer bit stream, wherein a same number of bits are used for the residual data and the reconstruction data in the inter-layer data;
upsampling the inter-layer data;
generating an enhanced layer bit stream based on the one or more frames and the upsampled inter-layer data; and
merging the base layer bit stream and enhanced layer bit stream into a video stream.

11. The method of claim 10 , wherein the inter-layer data includes a bit indicating whether the inter-layer data includes residual data.

12. The method of claim 10 , wherein the encoding is performed by one encoder.

13. The method of claim 10 , wherein the encoding one or more frames to the base layer is performed by a base layer encoder and the encoding the one or more frames to the enhanced layer is performed by an enhanced layer encoder.

14. The method of claim 10 further comprising transmitting the inter-layer data to the enhanced layer encoder.

15. The method of claim 14 , wherein the inter-layer data is transmitted to the enhanced layer encoder over a plurality of data channels.

16. A non-transitory computer readable medium storing instructions that, when executed by a processor, cause the processor to perform instructions for performing scalable video encoding comprising:
generating a base layer bit stream based on one or more frames;
generating inter-layer data including either residual data or reconstruction data based on a block type of the base layer bit stream, wherein a same number of bits are used for the residual data and the reconstruction data in the inter-layer data;
upsampling the inter-layer data;
generating an enhanced layer bit stream based on the one or more frames and the upsampled inter-layer data; and
merging the base layer bit stream and enhanced layer bit stream into a video stream.

17. The non-transitory computer readable medium of claim 16 , wherein the inter-layer data includes a bit indicating whether the inter-layer data includes residual data.

18. The non-transitory computer readable medium of claim 16 , wherein the encoding one or more frames to the base layer is performed by a base layer encoder and the encoding the one or more frames to the enhanced layer is performed by an enhanced layer encoder.

Assignees

• Advanced Micro Devices Inc
• Ati Technologies Ulc

Inventors

• Zhang Lei
• Zhou Ji
• Chen Zhen
• Yu Min

Classifications

• H04N19/80

  Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence) · CPC title

• H04N19/59

  involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution · CPC title

• H04N19/423 Primary

  characterised by memory arrangements (H04N19/433 takes precedence) · CPC title

• H04N19/33 Primary

  in the spatial domain · CPC title

• H04N19/187

  the unit being a scalable video layer · CPC title