ROI-based VR content streaming server and method

Patent metadata

Field	Value
Publication number	US-11025880-B2
Application number	US-201916713797-A
Country	US
Kind code	B2
Filing date	Dec 13, 2019
Priority date	Nov 5, 2018
Publication date	Jun 1, 2021
Grant date	Jun 1, 2021

Abstract

A region of interest (ROI)-based virtual reality (VR) content streaming server and a method are disclosed. The streaming server includes a communication unit that receives a request signal for a media presentation description (MPD) file regarding tiles of a tiled video, ROI) information, and a request signal for a segment file from an electronic device, and transmits the MPD file and the segment file corresponding to the request signal to the electronic device. The streaming server further includes a controller configured to, when the request signal for the MPD file is received, control the MPD file corresponding to the request signal to be transmitted to the electronic device.

First claim

What is claimed is:

1. A region of interest (ROI)-based virtual reality (VR) content streaming server comprising:
a communication unit configured to receive a first request signal for a media presentation description (MPD) file regarding tiles of a tiled video, ROI information, and a second request signal for a segment file from an electronic device, and to transmit the MPD file and the segment file corresponding to the first request signal and the second request signal to the electronic device;
a storage device comprising a first segment cache for a predicted adaptation tile, a second segment cache for a recently dashed tile, and a third segment cache for a least recently used (LRU) tile; and
a controller configured to:
in response to receiving the first request signal for the MPD file, control the MPD file corresponding to the first request signal to be transmitted to the electronic device,
in response to receiving the ROI information, generate and cache the segment file in which first to nth resolutions (‘n’ is a natural number of 2 or greater) are assigned to the tiles of the tiled video, respectively, based on the ROI information, the first resolution being highest among the n resolutions, and
in response to receiving the second request signal for the segment file, control the cached segment file to be transmitted to the electronic device,

wherein the controller is configured to search caches in the order of the first segment cache, the second segment cache, and the third segment cache in response to the second request signal.

2. The server of claim 1 , wherein the controller is further configured to predict next ROI information based on the ROI information so as to generate the segment file in which the first to nth resolutions are assigned.

3. The server of claim 2 , wherein the controller is further configured to, based on a base tile corresponding to the ROI information among the tiles, predict a moving direction of an object contained in the base tile so as to predict the next ROI information.

4. The server of claim 1 , wherein the controller is further configured to assign the first resolution to a first tile among the tiles, the first tile corresponding to the ROI information, the controller being configured to assign the second to nth resolutions to the remaining tiles.

5. The server of claim 1 , wherein the controller is further configured to control the cached segment file to be transmitted in real time.

6. A region of interest (ROI)-based virtual reality (VR) content streaming method comprising:
at a streaming server, in response to receiving a first request signal for a media presentation description (MPD) file regarding tiles of a tiled video from an electronic device, transmitting the MPD file corresponding to the first request signal to the electronic device;
at the streaming server, in response to receiving ROI information from the electronic device, generating and caching a segment file in which first to nth resolutions (‘n’ is a natural number of 2 or greater) are assigned to the tiles of the tiled video, respectively, based on the ROI information, the first resolution being highest among the n resolutions; and
at the streaming server, in response to receiving a second request signal for the segment file from the electronic device, transmitting the cached segment file to the electronic device,
wherein the transmitting the cached segment file includes searching caches in the order of a first segment cache for a predicted adaptation tile, a second segment cache for a recently dashed tile, and a third segment cache for a least recently used (LRU) tile.

7. The method of claim 6 , wherein the caching includes predicting next ROI information based on the ROI information so as to generate the segment file in which the first to nth resolutions are assigned.

8. The method of claim 7 , wherein the caching includes, based on a base tile corresponding to the ROI information among the tiles, predicting a moving direction of an object contained in the base tile so as to predict the next ROI information.

9. The method of claim 6 , wherein the caching includes assigning the first resolution to a first tile among the tiles, the first tile corresponding to the ROI information among the tiles and assigning the second to nth resolutions to the remaining tiles.

10. The method of claim 6 , wherein the cached segment file is transmitted in real time.

Assignees

• Korea Electronics Technology

Inventors

• Jang Junhwan
• Park Woochool
• Kim Youngwha
• Yang Jinwook
• Yoon Sangpil
• Kim Hyunwook
• Cho Eunkyung
• Choi Minsu
• Lee Junsuk
• Yang Jaeyoung

Classifications

• H04L65/613

  for the control of the source by the destination (control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637) · CPC title

• H04L65/612

  for unicast · CPC title

• H04L65/756

  adapting media to device capabilities · CPC title

• H04N13/117 Primary

  the virtual viewpoint locations being selected by the viewers or determined by viewer tracking · CPC title

• H04N13/194 Primary

  Transmission of image signals · CPC title