Method for processing immersive video and method for producing immersive video

Patent metadata

Field	Value
Publication number	US-11477429-B2
Application number	US-202016921563-A
Country	US
Kind code	B2
Filing date	Jul 6, 2020
Priority date	Jul 5, 2019
Publication date	Oct 18, 2022
Grant date	Oct 18, 2022

Abstract

An immersive video processing method according to the present disclosure includes determining a priority order of pruning for source view videos, generating a residual video for an additional view video based on the priority order of pruning, packing a patch generated based on the residual video into an atlas video, and encoding the atlas video.

First claim

What is claimed is:

1. An immersive video synthesizing method, the method comprising:
parsing video data and metadata from a bitstream;
decoding an atlas from the video data, wherein the atlas comprises a plurality of patches each of which is derived from a residual view generated by pruning a source view with a reference view during a pruning process;
determining a view index required for synthesizing a viewport video;
extracting a patch of a first source view which has the determined view index; and
synthesizing a viewport video based on first data reconstructed by the patch of the first source view,
wherein the metadata comprise pruning priority information for the first source view,
wherein the pruning priority information for the first source view comprises a root node flag specifying whether the first source view is a root node or not,
wherein when the first source view is not pruned during the pruning process, the root node flag has a first value that indicates that the first source view is the root node,
wherein when the first source view is pruned by at least one reference view, the root node flag has a second value that indicates that the first source view is not the root node,
wherein in response that the root node flag has the second value, the pruning priority information further comprises reference number information, indicating a number of parent nodes for the first source view, and a hierarchical view index, specifying a view index of at least one reference view which is used to prune the first source view during the pruning process, the hierarchical view index for the first source view being repeatedly decoded as many as the number of parent nodes indicated by the reference number information,
wherein a patch of a second source view further extracted from the atlas, the second source view being a reference view used to prune the first source view, and
wherein second data reconstructed by the patch of the second source view is further used to synthesize the viewport video.

2. The immersive video synthesizing method of claim 1 ,
wherein the patch of the second source view comprises redundant data between the first source view and the second source view.

3. The immersive video synthesizing method of claim 2 ,
wherein the second source view is an additional source view which is not the root node on a pruning hierarchical structure.

Assignees

• Electronics & Telecommunications Res Inst
• Iucf Hyu

Inventors

• Shin Hong Chang
• Lee Gwang Soon
• Eum Ho Min
• Jeong Jun Young
• Park Jong Il
• Yun Jun Young

Classifications

• H04N13/161

  Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) · CPC title

• H04N13/172

  image signals comprising non-image signal components, e.g. headers or format information · CPC title

• H04N13/111

  Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation · CPC title

• G06T3/4038 Primary

  Image mosaicing, e.g. composing plane images from plane sub-images · CPC title

• H04N13/139 Primary

  Format conversion, e.g. of frame-rate or size · CPC title