Electronic device and method for tiled video multi-channel playback

Patent metadata

Field	Value
Publication number	US-10880534-B2
Application number	US-201916714202-A
Country	US
Kind code	B2
Filing date	Dec 13, 2019
Priority date	Nov 9, 2018
Publication date	Dec 29, 2020
Grant date	Dec 29, 2020

Abstract

An electronic device and a method for a tiled video multi-channel playback are disclosed. The electronic device includes a device communication unit and a device controller. The device communication unit establishes a communication channel with a streaming server. The device controller can detect a region of interest (ROI) of an image related to a media presentation description (MPD) tile provided by the streaming server, transmit ROI information to the streaming server and receive tiles of a tiled video having a first resolution and corresponding to the ROI information, a full video having a second resolution lower than the first resolution, and a plurality of 2D videos from the streaming server. The device controller can also generate a 360-degree VR video by synthesizing the video tiles and the full video, and control a simultaneous playback of the generated 360-degree VR video and the plurality of 2D videos.

First claim

What is claimed is:

1. An electronic device for a tiled video multi-channel playback, comprising:
a device communication unit configured to establish a communication channel with a streaming server; and
a device controller configured to:
detect a region of interest (ROI) of an image related to a media presentation description (MPD) file provided by the streaming server,
transmit ROI information to the streaming server,
receive tiles of a tiled video having a first resolution and corresponding to the ROI information, a full video having a second resolution lower than the first resolution, and a plurality of 2-dimesional (2D) videos from the streaming server,
generate a 360-degree virtual reality (VR) video by synthesizing the video tiles and the full video, and
control a simultaneous playback of the generated 360-degree VR video and the plurality of 2D videos.

2. The electronic device of claim 1 , wherein the device controller is further configured to:
distinguish a main object and a background object by using data parsed from the MPD file, and to detect a region of the main object as the ROI.

3. The electronic device of claim 1 , further comprising:
a sensor unit configured to sense a user's viewpoint looking at the MPD file,
wherein the device controller is further configured to:
detect, as the ROI, a region corresponding to the user's viewpoint sensed by the sensor unit.

4. The electronic device of claim 1 , wherein the device controller is further configured to:
control the simultaneous playback of the 360-degree VR video and the plurality of 2D videos by using two decoders.

5. The electronic device of claim 4 , wherein the device controller is further configured to:
control one of the MD decoders to decode the 360-degree VR video, and control the other decoder to decode the plurality of 2D videos and audio information.

6. The electronic device of claim 1 , wherein the device controller is further configured to:
perform rendering such that the 360-degree VR video is disposed in an entire screen and the plurality of 2D videos are disposed in non-ROIs of the 360-degree VR video.

7. The electronic device of claim 1 , wherein the device controller is further configured to perform the rendering in a stereo format.

8. A method of a tiled video multi-channel playback, comprising:
at an electronic device, receiving a media presentation description (MPD) file from a streaming server;
at the electronic device, detecting a region of interest (ROI) of an image related to the MPD file;
at the electronic device, transmitting ROI information to the streaming server;
at the electronic device, receiving tiles of a tiled video having a first resolution and corresponding, to the ROI information, a full video having a second resolution lower than the first resolution, and a plurality of 2D videos from the streaming server;
at the electronic device, generating a 360-degree VR video by synthesizing the video tiles and the full video; and
at the electronic device, performing a simultaneous playback of the generated 360-degree VR video and the plurality of 2D videos.

9. The method of claim 8 , wherein the simultaneous playback of the 360-degree VR video and the plurality of 2D videos is performed by using two decoders.

10. The method of claim 8 , wherein the simultaneous playback includes rendering performed such that the 360-degree VR video is disposed in an entire screen and the plurality of 2D videos are disposed in non-ROIs of the 360-degree VR video.

Assignees

• Korea Electronics Technology

Inventors

• Jang Junhwan
• Park Woochool
• Kim Youngwha
• Yang Jinwook
• Yoon Sangpil
• Kim Hyunwook
• Cho Eunkyung
• Choi Minsu
• Lee Junsuk
• Yang Jaeyoung

Classifications

• H04L65/613

  for the control of the source by the destination (control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637) · CPC title

• H04L65/612

  for unicast · CPC title

• H04L65/756

  adapting media to device capabilities · CPC title

• H04L65/75

  Media network packet handling · CPC title

• H04L65/762

  at the source  (reformatting of additional data in video distribution servers H04N21/2355) · CPC title