Method for transmitting 360 video, method for receiving 360 video, 360 video transmitting device, and 360 video receiving device

Patent metadata

Field	Value
Publication number	US-12177410-B2
Application number	US-202017610614-A
Country	US
Kind code	B2
Filing date	Mar 23, 2020
Priority date	May 24, 2019
Publication date	Dec 24, 2024
Grant date	Dec 24, 2024

Abstract

A method for transmitting video, according to embodiments, comprises: a pre-processing step of processing video data; a step of encoding the video data; and/or a step of transmitting a bitstream including the video data. A method for receiving video, according to embodiments, comprises the steps of: receiving video data; decoding the video data; and/or rendering the video data.

First claim

The invention claimed is:

1. A method for transmitting a video, comprising:
pre-processing video data, wherein pre-processing the video data comprises:
generating a central view from one or more source views included in the video data, and
pruning the one or more source views based on the central view, and
packing the pruned one or more source views based on a stride scheme,

wherein packing the pruned one or more source views comprises:
searching a position for packing the pruned one or more source views,
generating a packed view by mapping a texture included in the pruned one or more source views, wherein a position of a first region and a position of a second region are searched in the packed view, and
putting the first region next to the second region by allocating the first region in an invalid region in the packed view;

encoding the video data; and
transmitting a bitstream including the video data,
wherein pre-processing the video data includes packing the video data into packed regions,
wherein the packed regions for the video data have position information, and
wherein the position information is generated for packing the video data.

2. The method of claim 1 , wherein the bitstream includes metadata related to the video data.

3. A device for transmitting video, comprising:
a pre-processor configured to pre-process video data, wherein the pre-processor is configured to:
generate a central view from one or more source views included in the video data, and
prune the one or more source views based on the central view,

wherein the pre-processor comprises:
a packer configured to pack the pruned one or more source views based on a stride scheme,

wherein the packer is configured to:
search a position for packing the pruned one or more source views, wherein a position of a first region and a position of a second region are searched in the packed view,
generate a packed view by mapping a texture included in the pruned one or more source views, and
put the first region next to the second region by allocating the first region in an invalid region in the packed view;

an encoder configured to encode the video data; and
a transmitter configured to transmit a bitstream including the video data,
wherein the pre-processor is configured to perform packing the video data into packed regions,
wherein the packed regions for the video data have position information, and
wherein the position information is generated for packing the video data.

4. The device of claim 3 , wherein the bitstream includes metadata related to the video data.

5. A method for receiving video, comprising:
receiving a bitstream including video data;
decoding the video data; and
post-processing the video data, comprising:
unpacking a packed view in the video data into a sparse view based on a stride scheme,

wherein post-processing the video data further comprises:
reconstructing a source view from the sparse view based on a central view included in the bitstream,

wherein unpacking the packed view comprises:
searching a position of a first region and a position of a second region are searched in the packed view, wherein the first region is next to the second region in an invalid region in the packed view, and
unpacking a stridden packed view in the video data into the sparse view,

wherein the stridden packed view is unpacked into a stridden sparse view,
wherein post-processing the video data includes unpacking the video data into projected regions,
wherein the projected regions for the video data have position information, and
wherein the position information is generated for unpacking the video data.

6. The method of claim 5 , wherein the bitstream includes metadata related to the video data.

7. A device for receiving video, comprising:
a receiver configured to receive a bitstream including video data;
a decoder configured to decode the video data; and
a post-processor configured to post-process the video data, the post-processing comprising:
unpacking a packed view in the video data into a sparse view based on a stride scheme,

wherein post-processing the video data further comprises:
reconstructing a source view from the sparse view based on a central view included in the bitstream,

wherein unpacking the packed view comprises:
searching a position of a first region and a position of a second region are searched in the packed view, wherein the first region is next to the second region in an invalid region in the packed view, and
unpacking a stridden packed view in the video data into the sparse view,

wherein the stridden packed view is unpacked into a stridden sparse view,
wherein the post-processor is configured to perform unpacking the video data into projected regions,
wherein the projected regions for the video data have position information, and
wherein the position information is generated for the unpacking the video data.

8. The device of claim 7 , wherein the bitstream includes metadata related to the video data.

Assignees

• Lg Electronics Inc

Inventors

• Oh Hyunmook
• Oh Sejin
• Ryu Eunseok
• Jeong Jongbeom
• Jang Dongmin
• Lee Soonbin

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• H04N13/161

  Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) · CPC title

• H04N13/194

  Transmission of image signals · CPC title

• H04N13/178 Primary

  Metadata, e.g. disparity information · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title