Selection of coded next generation audio data for transport

Patent metadata

Field	Value
Publication number	US-9854375-B2
Application number	US-201615365557-A
Country	US
Kind code	B2
Filing date	Nov 30, 2016
Priority date	Dec 1, 2015
Publication date	Dec 26, 2017
Grant date	Dec 26, 2017

Abstract

An example device for receiving audio data includes an audio decoder implemented using digital logic circuitry and configured to decode audio data conforming to MPEG-H or AC-4 part 2, and an audio data processing unit implemented in digital logic circuitry and configured to receive a manifest file describing a plurality of audio objects conforming to MPEG-H or AC-4 part 2, wherein the manifest file indicates whether each of the audio objects is available via broadcast, broadband, or both broadcast and broadband, receive selection data indicating which of the audio objects are to be presented, receive streamed media data including the audio objects based on the selection data, and provide the audio objects indicated by the selection data to the audio decoder.

First claim

What is claimed is:

1. A method of receiving media data, the method comprising:
receiving a manifest file including audio stream metadata describing a plurality of audio objects conforming to MPEG-H or AC-4 part 2, wherein the manifest file indicates whether each of the audio objects is available via broadcast, broadband, or both broadcast and broadband;
providing the audio stream metadata to an audio decoder configured to decode audio data conforming to MPEG-H or AC-4 part 2;
receiving data representative of the plurality of audio objects from the audio decoder in response to providing the audio stream metadata to the audio decoder;
receiving selection data indicating which of the audio objects are to be presented;
receiving streamed media data including the audio objects based on the selection data, wherein receiving the streamed media data comprises:
determining which of the audio objects of the plurality audio objects are to be presented using the selection data;
determining, for each of the audio objects that are to be presented, whether the audio object is available via broadcast or broadband using the manifest file; and
retrieving each of the audio objects that are to be presented via either broadcast or broadband based on the determination of whether the audio objects that are to be presented are available via broadcast or broadband and from network locations specified in the manifest file; and

providing the audio objects indicated by the selection data to the audio decoder.

2. The method of claim 1 , wherein the manifest file comprises a Dynamic Adaptive Streaming over HTTP (DASH) media presentation description (MPD), and wherein the audio objects are signaled as Adaptation Sets in the DASH MPD.

3. The method of claim 1 , wherein receiving the streamed media data comprises receiving either a single program stream conforming to MPEG-2 Transport Streams (TS) or multiple program streams conforming to MPEG-2 TS.

4. The method of claim 1 , wherein receiving the streamed media data comprises receiving one or more MPEG Media Transport (MMT) assets comprising the audio objects.

5. The method of claim 1 , further comprising using the manifest file to determine, for each of the audio adaptation sets:
whether the audio adaptation sets comprise a fully presentable audio presentation having a specific identifier (ID);
whether the audio adaptation set depends on one or more other audio adaptation sets and, when the audio adaptation set depends on one or more other audio adaptation sets, identifiers for the one or more other audio adaptation sets; and
an identifier for the audio adaptation set.

6. The method of claim 5 , further comprising determining relative qualities of each representation in the audio adaptation sets representing quality ranking attributes for each of the representations.

7. The method of claim 5 , wherein the manifest file indicates that each of the audio objects is provided in a distinct stream of data.

8. The method of claim 5 , wherein the manifest file indicates that two or more of the audio objects are multiplexed in a broadcast stream and that the other audio objects are available as distinct streams of data via broadband.

9. The method of claim 5 , wherein the manifest file indicates that each of the audio objects is multiplexed into a single stream of data.

10. The method of claim 9 , wherein the manifest file indicates that the single stream of data is available via broadcast.

11. The method of claim 5 , wherein the manifest file signals the specific ID of the fully presentable audio presentation as an audio object identifier of the audio object that comprises the fully presentable audio presentation.

12. The method of claim 5 , wherein the manifest file signals the specific ID of the fully presentable audio presentation as a track ID of a track in an ISO Base Media File Format file that includes the fully presentable audio presentation.

13. The method of claim 5 , wherein the manifest file signals the specific ID of the fully presentable audio presentation as a program identifier (PID) of an elementary stream in an MPEG-2 Transport Stream including the fully presentable audio presentation.

14. The method of claim 5 , wherein the manifest file includes descriptor data signaling the specific ID of an MPEG Media Transport (MMT) stream including the fully presentable audio presentation.

15. The method of claim 5 , wherein the manifest file signals dependencies between audio adaptation sets using an Essential Descriptor having a value providing identifiers for the adaptation sets on which a dependent adaptation set depends.

16. The method of claim 5 , wherein the manifest file signals identifiers for the audio objects using Content Component elements.

17. The method of claim 5 , further comprising retrieving one or more pre-selection elements from the manifest file.

18. The method of claim 17 , wherein the pre-selection elements each include a descriptor for selecting a subset of the audio objects.

19. The method of claim 17 , wherein the pre-selection elements each include one or more parameters that can be used for automatic selection.

20. The method of claim 17 , wherein the pre-selection elements each include data that indicates required codec capabilities for this pre-selection.

21. The method of claim 17 , wherein the pre-selection elements each include a text label for user selection.

22. The method of claim 21 , wherein the text label is provided in a language corresponding to a language of the respective audio data.

23. The method of claim 17 , wherein the pre-selection elements each include a priority value.

24. The method of claim 17 , further comprising selecting a subset of the audio objects using the pre-selection elements based on the received selection data.

25. A device for receiving audio data, the device comprising:
an audio decoder implemented using digital logic circuitry and configured to decode audio data conforming to MPEG-H or AC-4 part 2; and
an audio data processing unit implemented in digital logic circuitry and configured to:
receive a manifest file including audio stream metadata describing a plurality of audio objects conforming to MPEG-H or AC-4 part 2, wherein the manifest file indicates whether each of the audio objects is available via broadcast, broadband, or both broadcast and broadband;
provide the audio stream metadata to the audio decoder;
receive data representative of the plurality of audio objects from the audio decoder in response to providing the audio stream metadata to the audio decoder;
receive selection data indicating which of the audio objects are to be presented;
receive streamed media data including the audio objects based on the selection data, wherein to receive the streamed media data, the audio data processing unit is configured to:
determine which of the audio objects of the plurality audio objects are to be presented using the selection data;
determine, for each of the audio objects that are to be presented, whether the audio object is available via broadcast or broadband using the manifest file; and
retrieve each of the audio objects that are to be presented via either broadcast or broadband based on the determination of whether the audio objects that are to be presented are available via broadcast or broadband and from network locations specified in the manifest file; and

provide the audio objects indicated by the

Assignees

• Qualcomm Inc

Inventors

• Stockhammer Thomas

Classifications

• H04S2420/11

  Application of ambisonics in stereophonic audio systems · CPC title

• H04S2400/01

  Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved · CPC title

• H04S3/006 Primary

  in which a plurality of audio signals are transformed in a combination of audio signals and modulated signals, e.g. CD-4 systems · CPC title

• H04N21/8456

  by decomposing the content in the time domain, e.g. in time segments · CPC title

• H04N21/26258

  for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list (retrieval of multimedia data based on playlists G06F16/40) · CPC title