Methods of inter picture motion prediction for multi-view video compression

Patent metadata

Field	Value
Publication number	US-11418810-B2
Application number	US-202017026922-A
Country	US
Kind code	B2
Filing date	Sep 21, 2020
Priority date	Sep 21, 2020
Publication date	Aug 16, 2022
Grant date	Aug 16, 2022

Abstract

A method, computer program, and computer system is provided for coding video data. Video data including (1) a first frame comprising a first current view and a first reference view and (2) a second frame comprising a second current view and a second reference view is received. A co-located block in the first reference view is identified for a current block in the first current view. A predicted offset vector is calculated based on the motion vector between the co-located block and its reference block in the second reference view. The video data is encoded/decoded based on the predicted offset vector.

First claim

What is claimed is:

1. A method of video coding, executable by a processor, the method comprising:
receiving multi-view video data comprising (1) a first frame comprising a first current view and a first reference view and (2) a second frame comprising a second current view and a second reference view;
identifying, for a current block in the first current view, a co-located block in the first reference view;
calculating a predicted motion vector based on a motion vector of the co-located block in its reference picture in the second reference view (a second frame);
adding the predicted motion vector to a list of candidate vectors for an inter merge mode or an inter skip mode, wherein the list of candidate vectors, when more than one is added, are ranked based on a proximity between the first current view and views corresponding to the candidate vectors; and
coding the video data of the current block based on the predicted motion vector.

2. The method of claim 1 , wherein the video data is coded based on predicting a location of the co-located block in the first reference view by applying a disparity vector, wherein the disparity vector is derived from a perspective transform to a current block in the first current view.

3. The method of claim 2 , wherein an encoder performs motion estimation based on using the location indicated by the predicted motion vector as a probable matching location.

4. The method of claim 1 , wherein the list of candidate vectors, when more than one is added, are ranked based on a ranking of qualities in the reference views.

5. The method of claim 1 , wherein the predicted motion vector is added to a list of candidate vectors for an inter motion vector coding mode.

6. The method of claim 5 , wherein the list of candidate vectors for the inter motion vector coding mode, when more than one is added, are ranked based on the proximity between the first current view and views corresponding to the candidate vectors, or based on the ranking of qualities in the reference views.

7. The method of claim 1 , wherein an encoder performs motion estimation based on using anthe endpoint of the predicted motion vector as a search center.

8. The method of claim 1 , the predicted motion vector is derived from applying a geometric transform of the motion vector of the co-located block.

9. A computer system for coding video data, the computer system comprising:
one or more computer-readable non-transitory storage media configured to store computer program code; and
one or more computer processors configured to access said computer program code and operate as instructed by said computer program code, said computer program code including:
receiving code configured to cause the one or more computer processors to receive multi-view video data comprising (1) a first frame comprising a first current view and a first reference view and (2) a second frame comprising a second current view and a second reference view;
identifying code configured to cause the one or more computer processors to identify, for a current block in the first current view, a co-located block in the first reference view;
calculating code configured to cause the one or more computer processors to calculate a predicted motion vector based on a motion vector of the co-located block in its reference picture in the second reference view (a second frame);
adding code configured to cause the one or more computer processors to add the predicted motion vector to a list of candidate vectors for an inter merge mode or an inter skip mode, and wherein the list of candidate vectors, when more than one is added, are ranked based on a proximity between the first current view and views corresponding to the candidate vectors; and
coding code configured to cause the one or more computer processors to code the video data of the current block based on the predicted motion vector.

10. The computer system of claim 9 , wherein the video data is coded based on predicting a location of the co-located block in the first reference view by applying a disparity vector, wherein the disparity vector is derived, from a perspective transform to a current block in the first current view.

11. The computer system of claim 10 , wherein an encoder performs motion estimation based on using the location indicated by the predicted motion vector as a probable matching location.

12. The computer system of claim 9 , wherein the list of candidate vectors, when more than one is added, are ranked based on a ranking of qualities in the reference views.

13. The computer system of claim 9 , wherein the predicted motion vector is added to a list of candidate vectors for an inter motion vector coding mode.

14. The computer system of claim 9 , wherein an encoder performs motion estimation based on using an endpoint of the predicted vector as a search center.

15. A non-transitory computer readable medium having stored thereon a computer program for coding video data, the computer program configured to cause one or more computer processors to:
receive multi-view video data comprising (1) a first frame comprising a first current view and a first reference view and (2) a second frame comprising a second current view and a second reference view;
identify, for a current block in the first current view, a co-located block in the first reference view;
calculate a predicted motion vector based on a motion vector of the co-located block in its reference picture in the second reference view (a second frame);
add the predicted motion vector to a list of candidate vectors for an inter merge mode or an inter skip mode, and wherein the list of candidate vectors, when more than one is added, are ranked based on a proximity between the first current view and views corresponding to the candidate vectors; and code the video data of the current block based on the predicted motion vector.

16. The computer readable medium of claim 15 , wherein the video data is coded based on predicting a location of thea co-located block in the first reference view by applying a disparity vector, wherein the disparity vector is derived from a perspective transform to a current block in the first current view.

17. The computer readable medium of claim 16 , wherein an encoder performs motion estimation based on using the location indicated by the predicted motion vector as a probable matching location.

18. The computer readable medium of claim 15 , wherein the predicted motion vector is added to a list of candidate vectors for an inter vector coding mode.

Assignees

• Tencent America LLC

Inventors

• Tian Jun
• Liu Shan
• Xu Xiaozhong
• Feng Weiwei

Classifications

• H04N19/167

  Position within a video image, e.g. region of interest [ROI] · CPC title

• H04N19/52 Primary

  by predictive encoding · CPC title

• H04N19/597 Primary

  specially adapted for multi-view video sequence encoding · CPC title

• H04N19/172

  the region being a picture, frame or field · CPC title

• H04N19/61

  in combination with predictive coding · CPC title