Immersive video coding techniques for three degree of freedom plus/metadata for immersive video (3DoF+/MIV) and video-point cloud coding (V-PCC)

Patent metadata

Field	Value
Publication number	US-12301869-B2
Application number	US-202017440534-A
Country	US
Kind code	B2
Filing date	May 14, 2020
Priority date	May 14, 2019
Publication date	May 13, 2025
Grant date	May 13, 2025

Abstract

Techniques related to immersive video coding are discussed and include immersive video sequences and output units for random access to the immersive video, coding improvements for camera parameters coding, and coding efficiency improvements for atlas parameters.

First claim

What is claimed is:

1. A method for immersive video coding, comprising:
receiving one or more of a sequence of depth atlas pictures, a sequence of texture atlas pictures, and a sequence of occupancy map atlas pictures representative of immersive video;
coding the one or more sequences of depth atlas pictures, texture atlas pictures, and occupancy map atlas pictures with a video encoder to provide coded immersive video data comprising a plurality of output times each corresponding to individual ones of the pictures of the one or more sequences, wherein, for each of a subset of the output times, the coded immersive video data comprises an intra coded picture for one or more of a coded depth atlas picture, a coded texture atlas picture, and a coded occupancy map atlas picture; and
transmitting the coded immersive video data.

2. The method of claim 1 , wherein the subset of output times comprise random access points to access the immersive video provided at intervals within the output times and the intra coded picture for one or more of the coded depth atlas picture, the coded texture atlas picture, and the coded occupancy map atlas picture comprises the intra coded picture for each of the coded depth atlas picture, the coded texture atlas picture, and the coded occupancy map atlas picture.

3. The method of claim 1 , wherein each of the subset of the output times corresponds to an output unit comprising the intra coded picture for one or more of the coded depth atlas picture, the coded texture atlas picture, and the coded occupancy map atlas picture.

4. The method of claim 1 , wherein the coded immersive video data further comprises an intra coded additional attributes atlas picture corresponding to the intra coded picture for the coded depth atlas picture, the coded texture atlas picture, and the coded occupancy map atlas picture.

5. The method of claim 1 , wherein the coded immersive video data further comprises an atlas parameter list corresponding to the intra coded picture for the coded depth atlas picture, the coded texture atlas picture, and the coded occupancy map atlas picture.

6. A method for immersive video coding, comprising:
receiving coded immersive video data comprising a plurality of output times each corresponding to individual ones of pictures of one or more of a sequence of depth atlas pictures, a sequence of texture atlas pictures, and a sequence of occupancy map atlas pictures representative of immersive video;
decoding the coded immersive video data to generate decoded sequences of the depth atlas pictures, the texture atlas pictures, and the occupancy map atlas pictures, wherein, for each of a subset of the output times, the decoded sequences comprise an intra coded depth atlas picture, a corresponding intra coded texture atlas picture, and a corresponding intra coded occupancy map atlas picture; and
preparing a presentation for a viewer using the decoded sequences.

7. The method of claim 6 , wherein the subset of output times comprises random access points to access the immersive video provided at intervals within the output times, the method further comprising:
monitoring the coded immersive video data for a first random access point, wherein said decoding is responsive to the first random access point.

8. The method of claim 6 , wherein each output time of the subset of the output times corresponds to an output unit comprising the intra coded depth atlas picture, the intra coded texture atlas picture, and the intra coded occupancy map atlas picture.

9. The method of claim 6 , wherein the coded immersive video data further comprises an intra coded additional attributes picture corresponding to the intra coded depth atlas picture, intra coded texture atlas picture, and intra coded occupancy map atlas picture.

10. The method of claim 6 , wherein the coded immersive video data further comprises an atlas parameter list corresponding to the intra coded depth atlas picture, intra coded texture atlas picture, and intra coded occupancy map atlas picture.

Assignees

• Intel Corp

Inventors

• Boyce Jill

Classifications

• G06T7/80

  Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration · CPC title

• H04N19/159

  Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction · CPC title

• H04N19/124

  Quantisation · CPC title

• H04N19/593

  involving spatial prediction techniques · CPC title

• H04N19/597 Primary

  specially adapted for multi-view video sequence encoding · CPC title