Techniques for encoding and decoding immersive video

Patent metadata

Field	Value
Publication number	US-11432009-B2
Application number	US-202016918667-A
Country	US
Kind code	B2
Filing date	Jul 1, 2020
Priority date	Jul 2, 2019
Publication date	Aug 30, 2022
Grant date	Aug 30, 2022

Abstract

An example apparatus for encoding immersive video includes a view optimizer to receive a plurality of input views from a source camera and select basic views and additional views from the plurality of input views. The apparatus also includes a view pruner to prune the additional views based on a comparison with the basic views. The apparatus further includes a patch packer to generate atlases based on the pruned additional views and the basic views. The apparatus includes a metadata composer to generate metadata including additional metadata. The apparatus also further includes a bitstream generator to generate a bitstream including the encoded video and the metadata.

First claim

What is claimed is:

1. An apparatus for decoding immersive video, comprising:
a decoder to:
receive a bitstream including encoded video and metadata, the metadata to include information related to additional views pruned during encoding, the information to identify a number of groups used to prune the additional views and a list of the additional views that correspond to each group; and
extract the information from the metadata; and

a view renderer to render a view based on the information.

2. The apparatus of claim 1 , wherein the information includes an atlas grouping parameter.

3. The apparatus of claim 1 , wherein the information includes a group index per atlas parameter.

4. The apparatus of claim 3 , wherein the group index per atlas parameter indicates a related group of an atlas.

5. The apparatus of claim 1 , wherein the information includes a per patch visibility list.

6. The apparatus of claim 1 , wherein the information includes visibility parameters and view identification information.

7. The apparatus of claim 6 , wherein the information includes a visibility list indicating a set of the additional views in which each patch is visible.

8. A method for decoding immersive video bitstreams, the method comprising:
receiving, via a processor, a bitstream including encoded video and metadata, the metadata including information related to additional views pruned during encoding, the information identifying a number of groups used to prune the additional views and a list of the additional views that correspond to each group;
extracting, via the processor, the information from the metadata; and
rendering, via the processor, a view based on the information.

9. The method of claim 8 , wherein the information includes an atlas grouping parameter.

10. The method of claim 8 wherein the information includes a group index per atlas parameter.

11. The method of claim 10 , wherein the group index per atlas parameter indicates a related group of an atlas.

12. The method of claim 8 , wherein the information includes a per patch visibility list.

13. The method of claim 12 , wherein the per patch visibility list is added per patch within an atlas patch parameters list included in the information.

14. The method of claim 8 , wherein the information includes a visibility list indicating a set of the additional views in which each patch is visible.

15. At least one computer readable storage for decoding immersive video bitstreams, the at least one computer readable storage comprising instructions that, in response to being executed on a computing device, cause the computing device to at least:
receive a bitstream comprising encoded video and metadata, the metadata to include information related to additional views pruned during encoding, the information to identify a number of groups used to prune the additional views and a list of the additional views that correspond to each group;
extract the information from the metadata; and render a view based on the information.

16. The at least one computer readable storage of claim 15 , wherein the information includes an atlas grouping parameter.

17. The at least one computer readable storage of claim 15 , wherein the information includes a group index per atlas parameter.

18. The at least one computer readable storage of claim 15 , wherein the group index per atlas parameter indicates a related group of an atlas.

19. The at least one computer readable storage of claim 15 , wherein the information includes a per patch visibility list.

20. The at least one computer readable storage of claim 15 , wherein the instructions are to cause the computing device to add a per patch visibility list per patch within an atlas patch parameters list included in the information.

Assignees

• Intel Corp

Inventors

• Salahieh Basel
• Boyce Jill M

Classifications

• H04N13/111

  Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation · CPC title

• H04N19/597 Primary

  specially adapted for multi-view video sequence encoding · CPC title

• H04N19/59

  involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution · CPC title

• H04N13/178

  Metadata, e.g. disparity information · CPC title