Providing frame packing type information for video coding

Patent metadata

Field	Value
Publication number	US-9596447-B2
Application number	US-201113082051-A
Country	US
Kind code	B2
Filing date	Apr 7, 2011
Priority date	Jul 21, 2010
Publication date	Mar 14, 2017
Grant date	Mar 14, 2017

Abstract

This disclosure includes techniques for signaling characteristics of a representation of multimedia content at a representation layer, such as frame packing arrangement information for the representation. In one example, an apparatus for receiving video data includes a processing unit configured to receive information indicative of whether a bitstream includes a packed frame of video data, wherein the packed frame comprises two frames corresponding to different views of a scene for three-dimensional playback, and wherein the information is present in a representation layer external to a codec layer of the bitstream, automatically determine whether the apparatus is capable of decoding and rendering the bitstream based on an analysis of the received information and decoding and rendering capabilities of the device, and retrieve the bitstream when the processing unit determines that the device is capable of decoding and rendering the bitstream.

First claim

The invention claimed is:

1. A method of retrieving video data, the method comprising:
receiving, by a client device, a manifest file for media content from a server device that is separate from the client device, wherein the manifest file describes a plurality of representations of a representation layer that is external to a codec layer for the media content, each of the representations including one or more files including video data, wherein each of the representations differs from the other representations by at least one of encoding characteristics, rendering characteristics, or bitrate and act as alternatives to each other, wherein the manifest file does not include the codec layer that includes the one or more files including the video data, wherein the manifest file does not include any of the files including the video data, wherein the representation layer is separate from and external to the codec layer such that the manifest file is separate from the one or more files including the video data, wherein the manifest file includes information indicative of whether the representations include a packed frame of video data, wherein the packed frame comprises two frames corresponding to different views of a scene for three-dimensional playback, and wherein receiving the manifest file comprises receiving the manifest file from the server device before receiving any of the files including the video data of any of the representations from the server device;
prior to requesting the video data of one of the representations that the manifest file indicates includes the packed frame, automatically determining, by a processing unit of the client device, whether the client device is capable of decoding and rendering each of the views of the video data of the one of the representations based on an analysis of the manifest file by the processing unit and decoding and rendering capabilities of the client device; and
requesting, by the client device, the video data of the one of the representations from the server device when the processing unit determines that the client device is capable of decoding and rendering each of the views of the one of the representations.

2. The method of claim 1 , wherein automatically determining comprises determining whether a video decoder of the client device is configured to decode packed frames that are packed in a manner as indicated by the received information.

3. The method of claim 1 , wherein the one of the representations comprises a first representation, the method further comprising, when the processing unit determines that the client device is not capable of decoding and rendering three-dimensional video data, retrieving a second representation of the representations instead of the first representation, wherein the manifest file indicates that the second representation comprises full resolution frames of video data for two-dimensional playback, and wherein the first representation and the second representation correspond to the same media content.

4. The method of claim 3 , further comprising, prior to retrieving the second representation, determining that the manifest file indicates that the second representation includes the full resolution frames of video data for two-dimensional playback.

5. The method of claim 1 , wherein the one of the representations comprises a first representation, the method further comprising, when the processing unit determines that the client device is not capable of decoding and rendering the first representation due to a frame packing type of the first representation, retrieving a second representation of the representations, wherein the manifest file indicates that the second representation comprises a packed frame comprising two frames corresponding to different views of a scene for three-dimensional playback, and wherein the two frames of the packed frame have a frame packing type supported by the client device.

6. The method of claim 5 , further comprising, prior to retrieving the second representation, determining that the manifest file includes information indicating that the second representation includes the packed frame having the supported frame packing type.

7. The method of claim 1 , further comprising decoding the video data of the one of the representations with a video decoder of the client device, wherein the video decoder is separate from the processing unit, wherein decoding the video data of the one of the representations comprises using second information indicative of whether the one of the representations includes the packed frame, and wherein the second information is present in the codec layer.

8. The method of claim 1 , further comprising receiving an indication of an aspect sub-sampling ratio for each of the views.

9. The method of claim 8 , wherein receiving the indication of the aspect sub-sampling ratio comprises receiving information for the indication in at least one selected from the group consisting of a codec layer, a file format layer in a media file container format, and a transport layer.

10. The method of claim 8 , wherein the indication of the aspect sub-sampling ratio comprises an indication that the views have an asymmetric spatial resolution.

11. The method of claim 1 , wherein the manifest file comprises a media presentation description (MPD).

12. The method of claim 1 , wherein the one of the representations comprises a first representation of the plurality of representations the method further comprising, when the processing unit determines that the client device is not capable of decoding and rendering each of the views of the first representation:
selecting a second, different representation of the plurality of representations that the manifest file indicates does not include packed frames; and
retrieving video data of the second, different representation.

13. An apparatus for retrieving video data, the apparatus comprising a client device including a processing unit configured to:
receive a manifest file for media content from a server device that is separate from the client device, wherein the manifest file describes a plurality of representations of a representation layer that is external to a codec layer for the media content, each of the representations including one or more files including video data, wherein each of the representations differs from the other representations by at least one of encoding characteristics, rendering characteristics, or bitrate and act as alternatives to each other, wherein the manifest file does not include the codec layer that includes the one or more files including the video data, wherein the manifest file does not include any of the files including the video data, wherein the representation layer is separate from and external to the codec layer such that the manifest file is separate from the one or more files including the video data, wherein the manifest file includes information indicative of whether the representations include a packed frame of video data, wherein the packed frame comprises two frames corresponding to different views of a scene for three-dimensional playback, and wherein the processing unit is configured to receive the manifest file from the server device before receiving any of the files including the video data of any of the representations from the server device;
prior to requesting the video data of one of the representations that the manifest file indicates includes the packed frame, automatically determine whether the apparatus is capable of decoding and rendering each of the views of the video data of the one of the representations based on an analysis of the manifest file by the processing un

Assignees

• Chen Ying
• Karczewicz Marta
• Wang Yong
• Qualcomm Inc

Inventors

• Chen Ying
• Karczewicz Marta
• Wang Yong

Classifications

• H04N19/61

  in combination with predictive coding · CPC title

• H04N21/816 Primary

  involving special video data, e.g 3D video · CPC title

• H04N13/0048 Primary

  Electricity · mapped topic

• H04N21/84

  Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)} · CPC title

• H04N19/70

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title