360-degree VR video segmentation transmission system and method

Patent metadata

Field	Value
Publication number	US-11057605-B2
Application number	US-201916713417-A
Country	US
Kind code	B2
Filing date	Dec 13, 2019
Priority date	Nov 5, 2018
Publication date	Jul 6, 2021
Grant date	Jul 6, 2021

Abstract

A 360-degree virtual reality (VR) video segmentation transmission system and a method are disclosed. The system includes a transmitter and a receiver. The transmitter designs a frame for transmitting a 360-degree VR video divided into multiple channels, based on a motion picture expert group (MPEG) transport stream (TS), and transmits a signal combining the designed frame and a header for each of the multiple channels. The receiver receives the signal from the transmitter for each channel, combines contents contained in the received signal through synchronization, and outputs the combined contents.

First claim

What is claimed is:

1. A 360-degree virtual reality (VR) video segmentation transmission system comprising:
a transmitter configured to:
generate a plurality of frames of a 360-degree VR video comprising a low resolution content and a high resolution content for transmitting the 360-degree VR video through multiple channels based on a motion picture expert group (MPEG) transport stream (TS), the low resolution content comprising a plurality of low resolution content segments, the high resolution content comprising a plurality of high resolution content segments, each of the plurality of frames comprising metadata, one of the plurality of low resolution content segments, one of the plurality of high resolution content segments and a null packet;
generate a plurality of header packets, process each frame to generate a plurality of frame segments of each frame, and generate a plurality of channel signals, each of which contains one of the plurality of header packets and one of the plurality of frame segments; and
transmit each of the plurality of channel signals of each frame through a corresponding one of the multiple channels; and

a receiver configured to receive the plurality of channel signals from the transmitter transmitted through the multiple channels to combine contents contained in the received channel signals through synchronization, and to output the combined contents.

2. The system of claim 1 , wherein the transmitter is configured to design each frame such that a content bitrate of the frame matches a transmission bitrate.

3. The system of claim 2 ,
wherein the metadata in each frame contains content information of the 360-degree VR video;
wherein one of the low resolution segments and one of the high resolution segments in each frame form a super-frame connected with the metadata; and
wherein the null packet in each frame is connected with the super-frame and inserted for bitrate matching.

4. The system of claim 1 , wherein the transmitter has a transfer rate of 200 Mbps or more by using a maximum of eight channels.

5. The system of claim 1 , wherein the receiver is configured to detect a start portion based on the header packet of each channel signal transmitted through each channel, and to combine the received channel signals by using a drop and skip based on the detected start portion.

6. The system of claim 1 , wherein the header packet of each channel signal includes:
an MPEG-TS header having a size of 4 bytes;
a packet_ID having a size of 4 bytes and containing information for identifying multi-channel transmission;
a no_of_packet having a size of 2 bytes and containing information indicating a number of packets per channel;
a sync_index having a size of 4 bytes and containing information associated with synchronized combination of the content; and
a content_length having a size of 2 bytes and containing information indicating a length of content for each channel.

7. The system of claim 1 , wherein the metadata and the low resolution content segment of each frame are contained in different channel signals among the plurality of channel signals.

8. The system of claim 1 , wherein the metadata and the high resolution content segment of each frame are contained in different channel signals among the plurality of channel signals.

9. The system of claim 1 , wherein the metadata and the null packet of each frame are contained in different channel signals among the plurality of channel signals.

10. The system of claim 1 , wherein the low resolution content segment and the null packet of each frame are contained in different channel signals among the plurality of channel signals.

11. A 360-degree virtual reality (VR) video segmentation transmission method using a 360-degree VR video segmentation transmission system including a transmitter and a receiver, the method comprising:
generating, at the transmitter, a plurality of frames of a 360-degree VR video comprising a low resolution content and a high resolution content for transmitting the 360-degree VR video through multiple channels based on a motion picture expert group (MPEG) transport stream (TS), the low resolution content comprising a plurality of low resolution content segments, the high resolution content comprising a plurality of high resolution content segments, each of the plurality of frames comprising metadata, one of the plurality of low resolution content segments, and one of the plurality of high resolution content segments and a null packet;
generating a plurality of header packets, processing each frame to generate a plurality of frame segments of each frame, and further generating a plurality of channel signals, each of which contains one of the plurality of header packets and one of the plurality of frame segments; and
transmitting each of the plurality of channel signals of each frame to the receiver through a corresponding one of the multiple channels so that the receiver receives and processes the plurality of channel signals to output the 360-degree VR video.

12. The method of claim 11 , wherein a content bitrate of each frame matches a transmission bitrate.

13. The method of claim 11 , wherein the transmitter has a transfer rate of 200 Mbps or more by using a maximum of eight channels.

14. The method of claim 11 , wherein the receiver detects a start portion based on the header packet of the each channel signal transmitted through each channel, and combines the received channel signals by using a drop and skip based on the detected start portion.

15. The method of claim 11 , wherein the metadata and the low resolution content segment of each frame are contained in different channel signals among the plurality of channel signals.

16. The method of claim 11 , wherein the metadata and the high resolution content segment of each frame are contained in different channel signals among the plurality of channel signals.

17. The method of claim 11 , wherein the metadata and the null packet of each frame are contained in different channel signals among the plurality of channel signals.

18. The method of claim 11 , wherein the low resolution content segment and the null packet of each frame are contained in different channel signals among the plurality of channel signals.

Assignees

• Korea Electronics Technology

Inventors

• Wee Jungwook
• Park Woochool

Classifications

• H04N21/2365

  Multiplexing of several video streams · CPC title

• H04N13/178

  Metadata, e.g. disparity information · CPC title

• H04N13/194 Primary

  Transmission of image signals · CPC title

• H04N21/816 Primary

  involving special video data, e.g 3D video · CPC title

• H04N21/234363

  by altering the spatial resolution, e.g. for clients with a lower screen resolution · CPC title