Bandwidth saving architecture for scalable video coding

Patent metadata

Field	Value
Publication number	US-11863769-B2
Application number	US-202117403191-A
Country	US
Kind code	B2
Filing date	Aug 16, 2021
Priority date	Nov 29, 2012
Publication date	Jan 2, 2024
Grant date	Jan 2, 2024

Abstract

A system configured to perform scalable video encoding is provided. The system includes a memory; and a processing unit, wherein the processing unit is configured to: receive inter-layer data and a current picture, wherein the current picture has a base layer; upsample the inter-layer data to generate residual data and reconstruction data, wherein the inter-layer data includes a base mode flag; and encode the current picture to an enhanced layer using the upsampled inter-layer data based on a block type of the base layer and the base mode flag.

First claim

What is claimed is:

1. A system configured to perform scalable video encoding comprising:
a memory; and
a processing unit, wherein the processing unit is configured to:
receive inter-layer data and a current picture, wherein the current picture has a base layer;
upsample the inter-layer data to generate residual data and reconstruction data, wherein the inter-layer data includes a base mode flag; and
encode the current picture to an enhanced layer using the upsampled inter-layer data based on a block type of the base layer and the base mode flag, wherein, based on the block type of the base layer, the base mode flag indicates whether the encoding uses the reconstruction data and whether a base layer motion vector is used for motion prediction.

2. The system of claim 1 , wherein the inter-layer data is upsampled using a bi-linear filter to upsample the residual data in a base layer for a current block.

3. The system of claim 1 , wherein the inter-layer data is upsampled using a 4-tap filter to up-sample the reconstruction data.

4. The system of claim 1 , wherein the residual data is upsampled in a base layer for a current block.

5. The system of claim 1 , wherein the current picture is encoded to the enhanced layer using residual data generated by subtracting a current block from up-sampled base layer reconstruction data when the block type of the base layer is set to intra and the base mode flag is set to true.

6. The system of claim 1 , wherein, when the base mode flag is set to true, inter layer motion prediction is active, and a base layer motion vector is used as a predictor with a motion vector for a current macroblock equal to a motion vector predictor.

7. The system of claim 1 , wherein, when the base mode flag is set to false, a base layer motion vector is used as a predictor.

8. The system of claim 1 , wherein the processing unit includes one encoder.

9. The system of claim 1 , wherein the processing unit includes a base layer encoder and an enhanced layer encoder.

10. The system of claim 9 , wherein the base layer encoder is configured to generate the inter-layer data based on at least one frame and transmit the inter-layer data to the enhanced layer encoder.

11. A method for use in a processing system for performing scalable video encoding comprising:
receiving inter-layer data and a current picture, wherein the current picture has a base layer;
upsampling the inter-layer data to generate residual data and reconstruction data, wherein the inter-layer data includes a base mode flag; and
encoding the current picture to an enhanced layer using the upsampled inter-layer data based on a block type of the base layer and the base mode flag, wherein, based on the block type of the base layer, the base mode flag indicates whether the encoding uses the reconstruction data and whether a base layer motion vector is used for motion prediction.

12. The method of claim 11 , wherein the inter-layer data is upsampled using a bi-linear filter to upsample the residual data in a base layer for a current block.

13. The method of claim 11 , wherein the inter-layer data is upsampled using a 4-tap filter to up-sample the reconstruction data.

14. The method of claim 11 , wherein the residual data is upsampled in a base layer for a current block.

15. The method of claim 11 , wherein the current picture is encoded to the enhanced layer using residual data generated by subtracting a current block from up-sampled base layer reconstruction data when the block type of the base layer is set to intra and the base mode flag is set to true.

16. The method of claim 11 , wherein, when the base mode flag is set to true, inter layer motion prediction is active, and a base layer motion vector is used as a predictor with a motion vector for a current macroblock equal to a motion vector predictor.

17. The method of claim 11 , wherein, when the base mode flag is set to false, a base layer motion vector is used as a predictor.

18. The method of claim 11 , wherein the processing system includes one encoder.

19. The method of claim 11 , wherein the processing system includes a base layer encoder and an enhanced layer encoder.

20. The method of claim 19 , further comprising generating, by the base layer encoder, the inter-layer data based on at least one frame and transmit the inter-layer data to the enhanced layer encoder.

Assignees

• Advanced Micro Devices Inc
• Ati Technologies Ulc

Inventors

• Zhang Lei
• Zhou Ji
• Chen Zhen
• Yu Min

Classifications

• H04N19/423 Primary

  characterised by memory arrangements (H04N19/433 takes precedence) · CPC title

• H04N19/117

  Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635) · CPC title

• H04N19/159

  Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction · CPC title

• H04N19/187

  the unit being a scalable video layer · CPC title

• H04N19/33 Primary

  in the spatial domain · CPC title