Fragment-aligned audio coding

Patent metadata

Field	Value
Publication number	US-11765415-B2
Application number	US-202117541188-A
Country	US
Kind code	B2
Filing date	Dec 2, 2021
Priority date	Mar 9, 2015
Publication date	Sep 19, 2023
Grant date	Sep 19, 2023

Abstract

Audio video synchronization and alignment or alignment of audio to some other external clock are rendered more effective or easier by treating fragment grid and frame grid as independent values, but, nevertheless, for each fragment the frame grid is aligned to the respective fragment's beginning. A compression effectiveness lost may be kept low when appropriately selecting the fragment size. On the other hand, the alignment of the frame grid with respect to the fragments' beginnings allows for an easy and fragment-synchronized way of handling the fragments in connection with, for example, parallel audio video streaming, bitrate adaptive streaming or the like.

First claim

The invention claimed is:

1. A decoder for decoding audio content from an encoded data stream,
wherein the encoded data stream comprises encoded representations of temporal fragments of the audio content, each of which has encoded thereinto a respective temporal fragment of the audio content in units of audio frames temporally aligned to a beginning of the respective temporal fragment so that the beginning of the respective temporal fragment coincides with a beginning of a first audio frame of the audio frames,
wherein the decoder is configured to
decode reconstructed versions of the temporal fragments of the audio content from the encoded representations of the temporal fragments; and
join, for playout, the reconstructed versions of the temporal fragments of the audio content together by
truncating the reconstructed version of a predetermined temporal fragment at a portion of a trailing audio frame of the audio frames in units of which the predetermined temporal fragment is coded into the encoded representation of the predetermined temporal fragment, which temporally exceeds a trailing end of the predetermined temporal fragment,
determining the portion of the trailing audio frame on the basis of truncation information in the encoded data stream, wherein the truncation information comprises
a frame length value indicating a temporal length of the audio frames in units of which the predetermined temporal fragment is coded into the encoded representation of the predetermined temporal fragment, and a fragment length value indicating a temporal length of the predetermined temporal fragment from the beginning of the reconstructed version of the predetermined fragment to the fragment boundary with which the beginning of the reconstructed version of the succeeding temporal fragment coincides, and/or

a truncation length value indicating a temporal length of the portion of the trailing audio frame or the difference between the temporal length of the portion of the trailing audio frame and the temporal length of the trailing audio frame.

2. The decoder according to claim 1 , configured to, in decoding a further predetermined temporal fragment from the encoded representation of the further predetermined temporal fragment, generate the reconstructed version of the further predetermined temporal fragment within a portion of a trailing audio frame of the audio frames in units of which the further predetermined temporal fragment is coded into the encoded representation of the further predetermined temporal fragment, which portion extends from a leading end of the trailing audio frame up to the fragment boundary at which a reconstructed version of a succeeding temporal fragment abuts, by flushing internal decoder states as manifesting themselves up to an audio frame immediately preceding the trailing audio frame.

3. The decoder according to claim 1 , configured to derive immediate playout information from the encoded representations of an even further predetermined temporal fragment, the immediate play-out information being related to the audio content at one or more pre-roll audio frames of the audio content which temporally precede(s) a beginning of the even further predetermined temporal fragment and use the immediate playout information so as to reconstruct the audio content at one or more audio frames of the even further predetermined temporal fragment immediately succeeding the beginning of the even further predetermined temporal fragment.

4. The decoder according to claim 3 , configured such that the immediate playout information is a reconstruction of the audio content at the one or more pre-roll audio frames.

5. The decoder according to claim 3 , configured to use the immediate playout information in reconstructing the audio content at the one or more audio frames of the even further predetermined temporal fragment immediately succeeding the beginning of the even further predetermined temporal fragment for time domain aliasing cancellation.

6. The decoder according to claim 1 , configured to decode the audio frames individually using an inverse of a lapped transform causing aliasing and incurring transform windows extending beyond the frames' boundaries.

7. The decoder according to claim 1 , configured to
in decoding reconstructed versions of the temporal fragments of the audio content from the encoded representations of the temporal fragments, decode the reconstructed versions of the temporal fragment of the audio content alternatively from two decoding cores.

Assignees

• Fraunhofer Ges Forschung

Inventors

• Czelhan Bernd
• Fuchs Harald
• Hofmann Ingo
• Thoma Herbert
• Schreiner Stephan

Classifications

• H04N21/8456

  by decomposing the content in the time domain, e.g. in time segments · CPC title

• H04N21/2335 Primary

  involving reformatting operations of audio signals, e.g. by converting from one coding standard to another (details of audio signal transcoding G10L19/173) · CPC title

• G10L25/57

  for processing of video signals · CPC title

• G10L19/167 Primary

  Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes · CPC title

• H04N21/242 Primary

  Synchronisation processes, e.g. processing of PCR [Programme Clock References] {(arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18)} · CPC title