3D display handling of subtitles including text based and graphics based components

Patent metadata

Field	Value
Publication number	US-9979902-B2
Application number	US-201113155436-A
Country	US
Kind code	B2
Filing date	Jun 8, 2011
Priority date	Jul 25, 2008
Publication date	May 22, 2018
Grant date	May 22, 2018

Abstract

A non-transitory three-dimensional image signal includes a first image component, a second component for creating a three-dimensional image in combination with the first image component, and a text component that includes text-based subtitles and/or presentation graphics-based bitmap images for including in the three-dimensional image. A shared Z-location component includes Z-location information describing the depth location of the text component within the three-dimensional image. The signal is rendered by rendering the three-dimensional image from the first image component and the second component. The rendering includes rendering the text-based subtitles and/or presentation graphics-based bitmap images in the three-dimensional image. Further, the rendering of the text component includes adjusting the depth location of the text-based subtitles and/or presentation graphics-based bitmap images based on the shared Z-location component. The Z-location for both text-based and presentation-graphics-based subtitles may be the same and only needs to be stored once per stream.

First claim

The invention claimed is:

1. A method of creating a three-dimensional video signal on a display, the method performed by a processor comprising acts of:
receiving a first video component comprising first images;
receiving a second video component comprising second images, with respective ones of the first and second images representing stereo pairs for a three-dimensional video;
receiving a first text component and a second text component, the first text component comprising text-based subtitles and the second text component comprising presentation graphics-based bitmap images for including in the three-dimensional video;
receiving a shared Z-location component in the three-dimensional video signal in packets embedded in an elementary stream of audio-visual content, the packets carrying parameters for decoding the content and comprising shared Z-location information describing a depth position within the three-dimensional video that is shared by both the text-based subtitles and the presentation graphics-based bitmap images of respectively the first and second text components using one of depth and disparity values; and
creating a three-dimensional video signal for display of a three-dimensional image on the display for a duration, the three-dimensional video signal comprising the first video component, the second video component and the first and second text components in accordance with the shared Z-location information for both the text-based subtitles and the presentation graphics-based bitmap images for the duration of the three-dimensional video signal.

2. The method of claim 1 , wherein the shared Z-location information is comprised in the three-dimensional video signal in a table defined as extension data of a list that indicates a sequence of audio-visual content items that together form the presentation of a title.

3. The method of claim 2 , wherein the table is an offset metadata table that contains different Z-locations of subtitles for various language streams.

4. The method of claim 2 , wherein the list contains items that allow playback of stereoscopic multi-angle video data comprising stereoscopic multi-angle video clips, and respective Z-location information is stored in the table for every stereoscopic multi-angle video clip.

5. The method of claim 1 , wherein the table is an offset metadata table that contains different Z-locations for overlay of subtitles for every stereoscopic multi-angle video clip.

6. The method of claim 1 , wherein the text-based subtitles are provided in subtitle streams, and the shared Z-location information comprises enumerated Z values for all subtitle streams.

7. The method of claim 1 , wherein the shared Z-location information is comprised in the three-dimensional video signal in one of:
a table defined as a list that indicates a sequence of three dimensional audio-visual content items that together form the presentation of a title; and
a table in a list that indicates a sequence of audio-visual content items that together form the presentation of a title, the table listing video and graphics streams associated to a respective audio-visual content item, in a particular case per item containing a loop with stream coding information for every text and bitmap subtitle stream.

8. The method of claim 1 , wherein the shared Z-location information is comprised in the three-dimensional video signal in one of:
a file that lists metadata related to a transport stream that contains audio-visual content and subtitle streams, in a particular case the file listing subtitle streams by a packet identifier [PID] and the Z-location information is provided for every PID listing that indicates the PID of a subtitle stream;
a program information table in a file, the program information table providing a list of elementary streams that together form a presentation of audio-visual content, in a particular case the table provides the Z-location information is provided for every elementary stream that contains subtitle information; and
a characteristic point information [CPI] table that lists entry points into the audio-visual content for trick play, in a particular case listings of entry points comprising a Z-location parameter that indicates per entry point a location in depth of where to overlay graphics.

9. A method of rendering a non-transitory three-dimensional video signal on a display comprising acts:
receiving the non-transitory three-dimensional video signal comprising a first video component comprising first images, a second video component comprising second images, with respective ones of the first and second images representing stereo pairs, a first text component comprising text-based subtitles and a second text component comprising presentation graphics-based bitmap images for including in the three-dimensional video, and a shared Z-location component in sign messages that are packets embedded in an elementary stream of audio-visual content, the packets carrying parameters that for decoding the content and comprising Z-location information describing a depth position within the three-dimensional video that is shared by both of the text-based subtitles and the presentation graphics-based bitmap images of respectively the first and second text components using one of depth and disparity values;
rendering on the display the first video component and the second video component for providing a three-dimensional video for a duration, the rendering including rendering the text-based subtitles and/or presentation graphics-based bitmap images in the three-dimensional video; and
adjusting the depth position of the text-based subtitles and/or presentation graphics-based bitmap images in a frame accurate manner based on the shared Z-location information shared by the text-based subtitles and the presentation graphics-based bitmap images for the duration of the three-dimensional video.

10. A device for creating a non-transitory three-dimensional video signal comprising:
a receiver configured to receive a first video component comprising first images, a second video component comprising second images, respective first images and corresponding second images representing stereo pairs, a first text component comprising text-based subtitles and a second text component comprising presentation graphics-based bitmap images for including in a three-dimensional video for a duration, and a shared Z-location component in sign messages that are packets embedded in an elementary stream of audio-visual content, the packets carrying parameters that for decoding the content and comprising shared Z-location information describing a depth position within the three-dimensional video that is shared by the text-based subtitles and the presentation graphics based bitmap images of respectively the first and second text components using one of depth and disparity values; and
a multiplexer configured to create the non-transitory three-dimensional video signal comprising the first video component, the second video component, the text component, and the shared Z-location information that is shared by the text-based subtitles and the presentation graphics-based bitmap image for the duration of the three-dimensional video.

11. A device for rendering a non-transitory three-dimensional video signal comprising:
a receiver configured to receive the non-transitory three-dimensional video signal comprising a first image component comprising first images, a second video component comprising second images, respective first images and corresponding second images representing stereo pairs, a text component comprising text-based subtitles and a second text component comprising presentation graphics-based bitmap i

Assignees

• Newton Philip Steven
• Bolio Dennis Daniel Robert Jozef
• Scalori Francesco
• Vanderheijden Gerardus Wilhelmus Theodorus
• Van Doveren Henricus Fransiscus Petrus Maria
• De Haan Wiebe
• Moll Hendrik Frank
• Koninklijke Philips Nv

Inventors

• Newton Philip Steven
• Bolio Dennis Daniël Robert Jozef
• Scalori Francesco
• Vanderheijden Gerardus Wilhelmus Theodorus
• Van Doveren Henricus Fransiscus Petrus Maria
• De Haan Wiebe
• Moll Hendrik Frank

Classifications

• G02B30/00

  Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images (in microscopes G02B21/22) · CPC title

• H04N5/278 Primary

  Subtitling · CPC title

• H04N2213/005

  Aspects relating to the "3D+depth" image format · CPC title

• G06T15/00

  Three-dimensional [3D] image rendering · CPC title

• H04N13/178

  Metadata, e.g. disparity information · CPC title