Methods of intra picture block prediction for multi-view video compression

Patent metadata

Field	Value
Publication number	US-11843802-B2
Application number	US-202117409526-A
Country	US
Kind code	B2
Filing date	Aug 23, 2021
Priority date	Sep 21, 2020
Publication date	Dec 12, 2023
Grant date	Dec 12, 2023

Abstract

A method, computer program, and computer system is provided for coding video data. Video data including a reference view and a current view is received. A co-located block in the reference view is identified for a current block in the current view. A predicted block vector is calculated based on an offset vector between the current block and the co-located block, and a disparity vector between the co-located block and the reference block in the reference view. The video data is encoded/decoded based on the calculated predicted block vector.

First claim

What is claimed is:

1. A method of video decoding, executable by a processor, the method comprising:
receiving a video bitstream of multi-view video data and comprising a reference data block of a reference view of the multi-view video data and a compressed data block of a current view, different than the reference view, of the multi-view video data, wherein the compressed data block of the current view is to be decoded based on the reference data block of the reference view;
identifying, for the compressed data block of the current view of the multi-view video data, the reference data block of the reference view as a co-located block of the reference view of the multi-view video data;
obtaining a predicted block vector based on an offset vector and a disparity vector both of which being between the compressed data block of the current view and the co-located block of the reference view, wherein the predicted block vector is added to a list of candidate vectors for an intra block copy merge mode or an intra skip mode, and wherein the list of candidate vectors are ranked based on a proximity between the current view and views, including the reference view of the multi-view video data, corresponding to the candidate vectors; and
decoding the compressed data block of the current view based on the calculated predicted block vector.

2. The method of claim 1 , wherein the compressed data block of the current view is decoded based on determining a location of a reference block in the reference view by applying the calculated predicted block vector to the current block in the current view.

3. The method of claim 2 , wherein a location of the co-located block and the location of the reference block are used in block vector estimation as one or more probable matching locations.

4. The method of claim 1 , wherein a list of candidate vectors for a block vector coding mode comprises the predicted block vector.

5. The method of claim 4 , wherein the list of candidate vectors are further ranked based on qualities in the reference views.

6. The method of claim 1 , wherein an endpoint of the predicted block vector is used as a search center in block vector estimation.

7. The method of claim 1 , wherein the disparity vector is derived based on a relation between the current view and the reference view indicated as:
X col= X curr− N *view_width+ Dx, and

Y col= Y curr− M *view_height+ Dy, where

Xcurr and Ycurr indicate coordinates in the current view,
Xcol and Ycol indicate coordinates in the reference view,
N and M indicate one or more numbers of views of the multi-view video data,
view_width and view_height indicate a size of at least one of the views of the multi-view video data, and
Dx and Dy are components of the disparity vector.

8. A computer system for decoding video data, the computer system comprising:
one or more computer-readable non-transitory storage media configured to store computer program code; and
one or more computer processors configured to access said computer program code and operate as instructed by said computer program code, said computer program code including:
receiving code configured to cause the one or more computer processors to receive a video bitstream of multi-view video data and comprising a reference data block of a reference view of the multi-view video data and a compressed data block of a current view, different than the reference view, of the multi-view video data, wherein the compressed data block of the current view is to be decoded based on the reference data block of the reference view;
identifying code configured to cause the one or more computer processors to identify, for the compressed data block of the current view of the multi-view video data, the reference data block of the reference view as a co-located block of the reference view of the multi-view video data;
obtaining code configured to cause the one or more computer processors to obtain a predicted block vector based on an offset vector and a disparity vector both of which being between the compressed data block of the current view and the co-located block of the reference view, wherein the predicted block vector is added to a list of candidate vectors for an intra block copy merge mode or an intra skip mode, and wherein the list of candidate vectors are ranked based on a proximity between the current view and views, including the reference view of the multi-view video data, corresponding to the candidate vectors; and

decoding code configured to cause the one or more computer processors to decode the compressed data block of the current view based on the calculated predicted block vector.

9. The computer system of claim 8 , wherein the compressed data block of the current view is decoded based on determining a location of a reference block in the reference view by applying the calculated predicted block vector to the current block in the current view.

10. The computer system of claim 8 , wherein a location of the co-located block and the location of the reference block are used in block vector estimation as one or more probable matching locations.

11. The computer system of claim 8 , wherein the list of candidate vectors for a block vector coding mode comprises the predicted block vector.

12. The computer system of claim 11 , wherein the list of candidate vectors are further ranked based on qualities in the reference views.

13. The computer system of claim 8 , wherein an of the predicted block vector is used as a search center in block vector estimation.

14. The computer system of claim 8 , wherein the disparity vector is derived based on a relation between the current view and the reference view indicated as:
X col= X curr− N *view_width+ Dx, and

Y col= Y curr− M *view_height+ Dy, where

Xcurr and Ycurr indicate coordinates in the current view,
Xcol and Ycol indicate coordinates in the reference view,
N and M indicate one or more numbers of views of the multi-view video data,
view_width and view_height indicate a size of at least one of the views of the multi-view video data, and
Dx and Dy are components of the disparity vector.

15. A non-transitory computer readable medium having stored thereon a computer program for coding video data, the computer program configured to cause one or more computer processors to:
receive a video bitstream of multi-view video data and comprising a reference data block of a reference view of the multi-view video data and a compressed data block of a current view, different than the reference view, of the multi-view video data, wherein the compressed data block of the current view is to be decoded based on the reference data block of the reference view;
identify, for the compressed data block of the current view of the multi-view video data, the reference data block of the reference view as a co-located block of the reference view of the multi-view video data;
obtaining a predicted block vector based on an offset vector and a disparity vector both of which being between the compressed data block of the current view and the co-located block of the reference view, wherein the predicted block vector is added to a list of candidate vectors for an intra block copy merge mode or an intra skip mode, and wherein the list of candidate vectors are ranked based on a proximity between the current view and views, including the reference view of the multi-view video data, corresponding to the candidate vectors; and
decode the compressed data block of the current view based on the calculated predicted block vector.

16. The computer readable

Assignees

• Tencent America LLC

Inventors

• Tian Jun
• Liu Shan
• Xu Xiaozhong
• Feng Weiwei
• Gao Wen

Classifications

• H04N19/597 Primary

  specially adapted for multi-view video sequence encoding · CPC title

• H04N19/105

  Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction · CPC title

• H04N19/159

  Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction · CPC title

• H04N19/167

  Position within a video image, e.g. region of interest [ROI] · CPC title

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title