Methods, apparatus and systems for generation, transportation and processing of immediate playout frames (IPFs)

Patent metadata

Field	Value
Publication number	US-11972769-B2
Application number	US-201917270036-A
Country	US
Kind code	B2
Filing date	Aug 20, 2019
Priority date	Aug 21, 2018
Publication date	Apr 30, 2024
Grant date	Apr 30, 2024

Abstract

Described herein is an audio decoder for decoding a bitstream of encoded audio data, wherein the bitstream of encoded audio data represents a sequence of audio sample values and comprises a plurality of frames, wherein each frame comprises associated encoded audio sample values, the audio decoder comprising: a determiner configured to determine whether a frame of the bitstream of encoded audio data is an immediate playout frame comprising encoded audio sample values associated with a current frame and additional information; and an initializer configured to initialize the decoder if the determiner determines that the frame is an immediate playout frame, wherein initializing the decoder comprises decoding the encoded audio sample values comprised by the additional information before decoding the encoded audio sample values associated with the current frame. Described are further a method for decoding said bitstream of encoded audio data as well as an audio encoder, a system of audio encoders and a method for generating said bitstream of encoded audio data with immediate playout frames. Described are moreover also an apparatus for generating immediate playout frames in a bitstream of encoded audio data or for removing immediate playout frames from a bitstream of encoded audio data and respective non-transitory digital storage media.

First claim

The invention claimed is:

1. An audio decoder for decoding a bitstream of encoded audio data, wherein the bitstream of encoded audio data represents a sequence of audio sample values and comprises a plurality of frames, wherein each frame comprises associated encoded audio sample values, the audio decoder comprising:
a determiner configured to determine whether a frame of the bitstream of encoded audio data is an immediate playout frame comprising encoded audio sample values associated with a current frame and additional information, wherein the bitstream of encoded audio data is an MPEG-4 Audio bitstream, wherein the additional information is transported via an MPEG-4 Audio bitstream extension mechanism that is an extension_payload element of a new extension payload element type EXT_AUDIO_PRE_ROLL, wherein the extension_payload element is located at a first position in the MPEG-4 Audio bitstream, and wherein the extension_payload element is contained inside a fill element (ID_FIL),
wherein the additional information comprises encoded audio sample values of a number of frames preceding the immediate playout frame, wherein the encoded audio sample values of the preceding frames are encoded using the same codec configuration as the current frame,
wherein the number of preceding frames, corresponding to pre-roll frames, corresponds to the number of frames needed by the decoder to build up the full signal so as to be in a position to output valid audio sample values associated with the current frame whenever an immediate playout frame is decoded; and
an initializer configured to initialize the decoder if the determiner determines that the frame is an immediate playout frame,
wherein initializing the decoder comprises decoding the encoded audio sample values comprised by the additional information before decoding the encoded audio sample values associated with the current frame,
wherein the initializer is configured to switch the audio decoder from a current codec configuration to a different codec configuration if the determiner determines that the frame is an immediate playout frame and if the audio sample values of the current frame have been encoded using the different codec configuration, and
wherein the decoder is configured to decode the current frame using the current codec configuration and to discard the additional information if the determiner determines that the frame is an immediate playout frame and if the audio sample values of the current frame have been encoded using the current codec configuration.

2. The audio decoder of claim 1 , further comprising a crossfader configured to perform crossfading of output sample values acquired by flushing the decoder in the previous codec configuration and output sample values acquired by decoding the encoded audio sample values associated with the current frame.

3. The audio decoder of claim 1 , wherein an earliest frame of the number of frames comprised in the additional information is not time-differentially encoded or entropy encoded relative to any frame previous to the earliest frame and wherein the immediate playout frame is not time-differentially encoded or entropy encoded relative to any frame previous to the earliest frame of the number of frames preceding the immediate playout frame or relative to any frame previous to the immediate playout frame.

4. A method for decoding a bitstream of encoded audio data, wherein the bitstream of encoded audio data represents a sequence of audio sample values and comprises a plurality of frames, wherein each frame comprises associated encoded audio sample values, comprising:
determining whether a frame of the bitstream of encoded audio data is an immediate playout frame comprising encoded audio sample values associated with a current frame and additional information, wherein the bitstream of encoded audio data is an MPEG-4 Audio bitstream, wherein the additional information is transported via an MPEG-4 Audio bitstream extension mechanism that is an extension_payload element of a new extension payload element type EXT_AUDIO_PRE_ROLL, wherein the extension_payload element is located at a first position in the MPEG-4 Audio bitstream, and wherein the extension_payload element is contained inside a fill element (ID_FIL),
wherein the additional information comprises encoded audio sample values of a number of frames preceding the immediate playout frame,
wherein the encoded audio sample values of the preceding frames are encoded using the same codec configuration as the immediate playout frame,
wherein the number of preceding frames, corresponding to pre-roll frames, corresponds to the number of frames needed by a decoder to build up the full signal so as to be in a position to output valid audio sample values associated with the current frame whenever an immediate playout frame is decoded;
initializing the decoder if it is determined that the frame is an immediate playout frame, wherein the initializing comprises decoding the encoded audio sample values comprised by the additional information before decoding the encoded audio sample values associated with the current frame;
switching the audio decoder from a current codec configuration to a different codec configuration if it is determined that the frame is an immediate playout frame and if the audio sample values of the immediate playout frame have been encoded using the different codec configuration; and
decoding the immediate playout frame using the current codec configuration and discarding the additional information if it is determined that the frame is an immediate playout frame and if the audio sample values of the immediate playout frame have been encoded using the current codec configuration.

5. The method of claim 4 , wherein the bitstream of encoded audio data comprises a first number of frames encoded using a first codec configuration and a second number of frames following the first number of frames and encoded using a second codec configuration, wherein the first frame of the second number of frames is the immediate playout frame.

6. A non-transitory digital storage medium having a computer program stored thereon to perform the method according to claim 4 when said computer program is run by computer or a processor.

7. An audio encoder for generating a bitstream of encoded audio data with immediate playout frames, wherein the bitstream of encoded audio data represents a sequence of audio sample values and comprises a plurality of frames, wherein each frame comprises associated encoded audio sample values, wherein the audio encoder comprises:
a core encoder configured to encode uncompressed audio sample values associated with the plurality of frames using a predefined codec configuration;
a buffer configured to store encoded audio sample values of a number of preceding frames of a current frame of the plurality of frames encoded using the predefined codec configuration; and
an embedder configured to write an immediate playout frame in the current frame of the plurality of frames, wherein the immediate playout frame comprises encoded audio sample values associated with said current frame and additional information corresponding to the encoded audio sample values of the number of preceding frames of said current frame, wherein the generated bitstream of encoded audio data is an MPEG-4 Audio bitstream, wherein the embedder is further configured to embed the additional information in the bitstream via an MPEG-4 Audio bitstream extension mechanism that is an extension_payload element of a new extension payload element type EXT_AUDIO_PRE_ROLL, to locate the extension_payload element at a first position in the MPEG-4 Audio bitstream, and to embed the extension_payload element inside a fill element (ID_FIL).

8.

Assignees

• Dolby Int Ab

Inventors

• Fersch Christof
• Fischer Daniel

Classifications

• G10L19/173

  Transcoding, i.e. converting between two coded representations avoiding cascaded coding-decoding · CPC title

• G10L19/167 Primary

  Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes · CPC title

• G06F3/165

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• G06F3/162 Primary

  Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs · CPC title