Auxiliary data in 3D video broadcast

Patent metadata

Field	Value
Publication number	US-9986220-B2
Application number	US-201113809204-A
Country	US
Kind code	B2
Filing date	Jul 6, 2011
Priority date	Jul 12, 2010
Publication date	May 29, 2018
Grant date	May 29, 2018

Abstract

A system for transferring 3D video information has a transmitter ( 100 ) to broadcast a signal ( 104 ) to a receiver ( 110 ). The 3D video information includes auxiliary data for display in an overlay area on the 3D video data, like subtitles. The 3D video data has a left view and a right view arranged in a 2D frame in a main arrangement, e.g. side-by-side. An auxiliary left and right view of the auxiliary data are arranged in an auxiliary data stream according to a 2D transmission format in an auxiliary arrangement that corresponds to the main arrangement, e.g. also side-by-side. In addition, a 2D version of the auxiliary data and auxiliary disparity data indicative of the disparity to be applied to the 2D version of auxiliary data when overlayed on the left view and the right view is included in the transport stream. Advantageously the receiver may use a suitable version of the auxiliary data based on the receiver processing architecture.

First claim

The invention claimed is:

1. Method of processing three dimensional [3D] video information for generating a data transport stream for transferring of the 3D video information according to a 2D transmission format,
in a receiver,
receiving the 3D video information comprising 3D video data and auxiliary data, the 3D video data comprising at least a left view and a right view to be displayed for respective eyes of a viewer for generating a 3D effect, the auxiliary data being arranged for display in an overlay area on the 3D video data,

the method comprising:
arranging the 3D video data of the left view and the right view in a 2D frame for main video data according to the 2D transmission format in a main arrangement,
providing control data comprising parameters for a receiver for enabling the receiver to reproduce the main video data and overlaying the auxiliary data,
assembling the data transport stream including the 3D video data in the main arrangement, the auxiliary data and the control data,
providing an auxiliary left view and an auxiliary right view of the auxiliary data to be overlayed on the left view and the right view of the 3D video data, in an auxiliary arrangement corresponding to the main video transfer arrangement, and a 2D version of the auxiliary data and auxiliary disparity data indicative of the disparity to be applied to the 2D version of auxiliary data when overlayed on the left view and the right view,
arranging the auxiliary data of the auxiliary left view and the auxiliary right view in an auxiliary data stream according to the 2D transmission format in an auxiliary arrangement that corresponds to the main arrangement,
arranging the 2D version of the auxiliary data in a further auxiliary data stream,
including, in the transport stream, the further auxiliary data stream, the auxiliary disparity data and a disparity format indicator indicative of the further auxiliary data stream.

2. Method as claimed in claim 1 , wherein the control data includes a 3D format indicator according to a 3D extension of the 2D transmission format, indicative of the main arrangement of the 3D video data of the left view and the right view in the 2D frame.

3. Method as claimed in claim 2 , wherein the auxiliary arrangement is indicated only by the 3D format indicator indicative of the main arrangement.

4. Method as claimed in claim 1 , wherein the auxiliary disparity data comprises region disparity data for at least one region in the overlay area indicative of the disparity of the auxiliary data in the respective region when overlayed on the left view and the right view.

5. Method as claimed in claim 4 , wherein the auxiliary data stream comprises a page composition structure defining a composition of a page of auxiliary data to be displayed in the overlay area, the page composition structure comprising at least one region definition, which defines a location and the region disparity data of a respective region.

6. Method as claimed in claim 4 , wherein the auxiliary data stream comprises a region composition structure defining a composition of a region in a page of auxiliary data, the region composition structure comprising the region disparity data of the region.

7. Method as claimed in claim 1 , wherein the auxiliary data stream comprises a region composition structure defining a composition of a region in a page of auxiliary data to be displayed in the overlay area, the region composition structure comprises a sequence of object structures, which define a position of a graphical object, and the object structures including a disparity object comprising the auxiliary disparity data, or the auxiliary data stream comprises a display definition, which defines the overlay area for a page of auxiliary data, the display definition defining a position of the overlay area and the auxiliary disparity data.

8. Method as claimed in claim 1 , wherein the auxiliary data stream comprises objects, which objects define pixel data of graphical objects to be overlayed, and the auxiliary data stream and the further auxiliary data stream comprise references to the same objects for sharing the respective same objects between the auxiliary left view, the auxiliary right view and/or the 2D version of the auxiliary data.

9. Method as claimed in claim 1 , wherein the transport data stream comprises an additional segment type according to the 3D extension of the 2D transmission format, the additional segment type comprising a stereoscopic disparity descriptor comprising the auxiliary disparity data.

10. Method as claimed in claim 1 , wherein the transport data stream comprises packetized elementary stream [PES] data packets that, according to the 3D extension of the 2D transmission format, comprise the auxiliary disparity data.

11. Method as claimed in claim 1 , wherein the auxiliary data comprises subtitles.

12. Device ( 100 ) for processing three dimensional [3D] video information for generating a data transport stream for transferring of the 3D video information according to a 2D transmission format, the 3D video information comprising 3D video data and auxiliary data, the 3D video data comprising at least a left view and a right view to be displayed for respective eyes of a viewer for generating a 3D effect, the auxiliary data being arranged for display in an overlay area on the 3D video data, the device comprising:
a video processor ( 103 ) to arrange the 3D video data of the left view and the right view in a 2D frame for main video data according to the 2D transmission format in a main arrangement, provide control data comprising parameters for a receiver for enabling the receiver to reproduce the main video data and overlaying the auxiliary data, assemble the data transport stream including the 3D video data in the main arrangement, the auxiliary data and the control data, provides an auxiliary left view and an auxiliary right view of the auxiliary data to be overlayed on the left view and the right view of the 3D video data, in an auxiliary arrangement corresponding to the main video transfer arrangement, and a 2D version of the auxiliary data and auxiliary disparity data indicative of the disparity to be applied to the 2D version of auxiliary data when overlayed on the left view and the right view, arrange the auxiliary data of the auxiliary left view and the auxiliary right view in an auxiliary data stream according to the 2D transmission format in an auxiliary arrangement that corresponds to the main arrangement, arrange the auxiliary data of the 2D version in a further auxiliary data stream, wherein the transport stream includes the further auxiliary data stream, the auxiliary disparity data and a disparity format indicator indicative of the further auxiliary data stream.

13. Computer-readable, non-transitory medium having stored therein instructions for causing a processing unit to execute a method for processing three dimensional [3D] video information, the medium comprising code for:
in a receiver,
receiving the 3D video information comprising 3D video data and auxiliary data, the 3D video data comprising at least a left view and a right view to be displayed for respective eyes of a viewer for generating a 3D effect, the auxiliary data being arranged for display in an overlay area on the 3D video data,
arranging the 3D video data of the left view and the right view in a 2D frame for main video data according to the 2D transmission format in a main arrangement,
providing control data comprising parameters for a receiver for enabling the receiver to reproduce the main video data and overlaying the auxiliary data,
assembling the data transport stream inc

Assignees

• Newton Philip Steven
• Brondijk Robert Albertus
• De Haan Wiebe
• Koninklijke Philips Nv

Inventors

• Newton Philip Steven
• Brondijk Robert Albertus
• De Haan Wiebe

Classifications

• H04N13/004

  Electricity · mapped topic

• H04N13/0018 Primary

  Electricity · mapped topic

• H04N21/4884

  for displaying subtitles · CPC title

• H04N13/0059

  Electricity · mapped topic

• H04N13/007

  Electricity · mapped topic