Method for transmitting 360-degree video, method for receiving 360-degree video, 360-degree video transmitting device, and 360-degree video receiving device

Patent metadata

Field	Value
Publication number	US-2019199921-A1
Application number	US-201716328186-A
Country	US
Kind code	A1
Filing date	Jul 10, 2017
Priority date	Aug 29, 2016
Publication date	Jun 27, 2019
Grant date	—

Abstract

A method by which a 360-degree video transmission device transmits 360-degree video, according to the present invention, comprises the steps of: acquiring 360-degree video data captured by at least one camera; acquiring a projected picture by processing the 360-degree video data; acquiring a packed picture by applying a region-wise packing process to the projected picture; generating metadata for the 360-degree video data; encoding the packed picture; and performing processing for the storage or transmission of the encoded picture and the metadata, wherein the metadata includes 3D mapping information on a region of the packed picture, and the 3D mapping information indicates a yaw value and a pitch value of spherical coordinates of a spherical surface corresponding to a central point of the region.

First claim

What is claimed is:

1 . A 360-degree video data processing method performed by a 360 video transmission apparatus, comprising:
acquiring 360 video data captured by at least one camera; acquiring a projected picture by processing the 360 video data; acquiring a packed picture by applying region-wise packing to the projected picture; generating metadata for the 360 video data; encoding the packed picture; and performing processing for storage or transmission on the encoded picture and the metadata, wherein the metadata includes 3D mapping information on a region of the packed picture, and the 3D mapping information indicates a yaw value and a pitch value of spherical coordinates of a spherical surface corresponding to a center point of the region.

2 . The 360-degree video data processing method according to claim 1 , wherein the 3D mapping information further indicates a yaw range and a pitch range of a region on the spherical surface corresponding to the region.

3 . The 360-degree video data processing method according to claim 1 , wherein the 3D mapping information further indicates a maximum yaw value, a minimum yaw value, a maximum pitch value and a minimum pitch value of the region on the spherical surface corresponding to the region.

4 . The 360-degree video data processing method according to claim 2 , wherein the metadata includes a 3D mapping information flag indicating presence or absence of the 3D mapping information, and the metadata includes the 3D mapping information when the 3D mapping information flag indicates presence of the 3D mapping information.

5 . The 360-degree video data processing method according to claim 1 , wherein the metadata includes a packing application flag indicating whether the region-wise packing is applied, and the metadata includes information about an x-coordinate value and a y-coordinate value of the top-left pixel of the region on the projected picture when the packing application flag indicates that the region-wise packing is applied to the region.

6 . The 360-degree video data processing method according to claim 5 , wherein the metadata further includes information about the width and the height of the region on the projected picture.

7 . The 360-degree video data processing method according to claim 1 , wherein the 360 video data is mapped to one or more faces according to a projection format, and the metadata includes at least one of information indicating a type of a face corresponding to the region, information indicating the number of faces and information representing an arrangement type of the faces on the packed picture.

8 . The 360-degree video data processing method according to claim 7 , wherein the information indicating the type of the face indicates a rectangle when the projection format for the projected picture indicates cubic projection.

9 . The 360-degree video data processing method according to claim 7 , wherein the information indicating the type of the face indicates a triangle when the projection format for the projected picture indicates octahedral projection.

10 . The 360-degree video data processing method according to claim 1 , wherein the metadata includes region information on the region, and the region information indicates an x-coordinate value and a y-coordinate value of the top-left pixel of the region on the packed picture associated with a face according to a projection format.

11 . The 360 video-degree data processing method according to claim 10 , wherein the region information further indicates the width and the height of the region on the packed picture.

12 . The 360-degree video data processing method according to claim 11 , wherein the region information includes a rotation flag indicating whether the region is rotated, and the region information further indicates a rotation reference axis and a rotated angle when the rotation flag is 1.

13 . The 360-degree video data processing method according to claim 12 , wherein the metadata includes a region information flag indicating presence or absence of the region information, and the metadata includes the region information when the region information flag indicates presence of the region information.

14 . A 360-degree video data processing method performed by a 360 video reception apparatus, comprising:
receiving a signal including information on a packed picture with respect to 360-degree video data and metadata with respect to the 360-degree video data; acquiring the information on the packed picture and the metadata by processing the signal; decoding the packed picture on the basis of the information on the packed picture; and rendering the decoded picture on a 3D space by processing the decoded picture on the basis of the metadata, wherein the metadata includes 3D mapping information on a region of the packed picture, and the 3D mapping information indicates a yaw value and a pitch value of spherical coordinates of a spherical surface corresponding to a center point of the region.

15 . The 360-degree video data processing method according to claim 14 , wherein the 3D mapping information further indicates a yaw range and a pitch range of a region on the spherical surface corresponding to the region.

16 . The 360-degree video data processing method according to claim 14 , wherein the 3D mapping information further indicates a maximum yaw value, a minimum yaw value, a maximum pitch value and a minimum pitch value of the region on the spherical surface corresponding to the region.

17 . The 360-degree video data processing method according to claim 15 , wherein the metadata includes a 3D mapping information flag indicating presence or absence of the 3D mapping information, and the metadata includes the 3D mapping information when the 3D mapping information flag indicates presence of the 3D mapping information.

18 . The 360-degree video data processing method according to claim 14 , wherein the metadata includes a packing application flag indicating whether the region-wise packing is applied, and the metadata includes information about an x-coordinate value and a y-coordinate value of the top-left pixel of the region on the projected picture when the packing application flag indicates that the region-wise packing is applied to the region.

19 . The 360-degree video data processing method according to claim 18 , wherein the metadata further includes information about the width and the height of the region on the projected picture.

20 . A 360 video transmission apparatus comprising:
a data input unit for acquiring 360 video data captured by at least one camera; a projection processor for acquiring a projected picture by processing the 360 video data; a region-wise packing processor for acquiring a packed picture by applying region-wise packing to the projected picture; a metadata processor for generating metadata for the 360 video data; a data encoder for encoding the packed picture; and a transmission processor for performing processing for storage or transmission on the encoded picture and the metadata, wherein the metadata includes 3D mapping information on a region of the packed picture, and the 3D mapping information indicates a yaw value and a pitch value of spherical coordinates of a spherical surface corresponding to a center point of the region.

Assignees

• Lg Electronics Inc

Inventors

• Oh Sejin
• Suh Jongyeul
• Lee Jangwon

Classifications

• H04N23/698 Primary

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N19/46 Primary

  Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) · CPC title

• H04N19/17

  the unit being an image region, e.g. an object · CPC title

• H04N5/23238 Primary

  Electricity · mapped topic

• H04N19/172

  the region being a picture, frame or field · CPC title