Adaptive processing with multiple media processing nodes

Patent metadata

Field	Value
Publication number	US-9842596-B2
Application number	US-201113989256-A
Country	US
Kind code	B2
Filing date	Dec 1, 2011
Priority date	Dec 3, 2010
Publication date	Dec 12, 2017
Grant date	Dec 12, 2017

Abstract

Techniques for adaptive processing of media data based on separate data specifying a state of the media data are provided. A device in a media processing chain may determine whether a type of media processing has already been performed on an input version of media data. If so, the device may adapt its processing of the media data to disable performing the type of media processing. If not, the device performs the type of media processing. The device may create a state of the media data specifying the type of media processing. The device may communicate the state of the media data and an output version of the media data to a recipient device in the media processing chain, for the purpose of supporting the recipient device's adaptive processing of the media data.

First claim

What is claimed is:

1. A method for processing audio data, comprising:
determining, by a first audio data processing device in a media processing chain, whether a type of audio data processing has been performed on an output version of audio data;
in response to determining, by the first audio data processing device, that the type of audio data processing has been performed on the output version of the audio data, performing:
creating or modifying, by the first audio data processing device, a state of the audio data, the state specifying the type of audio data processing performed on the output version of the audio data, and comprising a hash-based message authentication code determined by applying a cryptographic hash function to a message comprising a combination of the audio data and the state of the audio data, wherein the hash-based message authentication code is to be authenticated by a second audio data processing device downstream in the media processing chain;
communicating, from the first audio data processing device to the second audio data processing device downstream in the media processing chain, the output version of the audio data and the state of the audio data.

2. The method as recited in claim 1 , further comprising providing, to the second audio processing device, the state of the audio data as one or more of: (a) media fingerprints, (b) processing state metadata, (c) extracted media feature values, (d) media class types or sub-type description(s) and/or values, (e) media feature class and/or sub-class probability values, or (f) media processing signaling.

3. The method as recited in claim 1 , wherein the state of the audio data is carried with the output version of the audio data in an output media bitstream.

4. The method as recited in claim 1 , wherein the state of the audio data is carried in an auxiliary metadata bitstream associated with a separate media bitstream that carries the output version of the audio data.

5. The method as recited in claim 1 , wherein the state of the audio data comprises one or more sets of parameters that relate to the type of audio data processing.

6. The method as recited in claim 1 , further comprising performing, by the first audio data processing device, the type of audio data processing.

7. The method as recited in claim 1 , further comprising altering a plurality of bytes in the audio data to store at least a portion of the state of the audio data.

8. The method as recited in claim 1 , further comprising:
determining one or more media features from the audio data;
including a description of the one or more media features in the state of audio data.

9. A method for processing audio data, comprising:
receiving, by a first audio data processing device in a media processing chain, an input version of the audio data and a state of the audio data, wherein the state of the audio data comprises a first hash-based message authentication code;
determining, by the first audio data processing device, a second hash-based message authentication code by applying a cryptographic hash function to a message comprising a combination of the input version of the audio data and the state of the audio data;
authenticating, by the first audio data processing device in the media processing chain, the input version of the audio data and the state of the audio data, by comparing the first hash-based message authentication code and the second hash-based message authentication code; and
determining, by the first audio data processing device in the media processing chain, whether a type of audio data processing has already been performed on the input version of the audio data;
in response to determining, by the first audio data processing device, that the type of audio data processing has already been performed on the input version of the audio data, performing adapting processing of the audio data to disable performing the type of audio data processing in the first audio data processing device.

10. An apparatus for processing audio data, comprising a first audio data processing device in a media processing chain, and configured to perform:
determining, by the first audio data processing device in the media processing chain, whether a type of audio data processing has been performed on an output version of the audio data;
in response to determining, by the first audio data processing device, that the type of audio data processing has been performed on the output version of the audio data, performing:
creating or modifying, by the first audio data processing device, a state of the audio data, the state specifying the type of audio data processing performed on the output version of the audio data, and comprising a hash-based message authentication code determined by applying a cryptographic hash function to a message comprising a combination of the audio data and the state of the audio data, wherein the hash-based message authentication code is to be authenticated by a second audio data processing device downstream in the media processing chain;
communicating, from the first audio processing device to the second audio processing device downstream in the media processing chain, the output version of the audio data and the state of the audio data.

11. The apparatus as recited in claim 10 , wherein the apparatus is further configure to perform: providing, to the second audio processing device, the state of the audio data as one or more of: (a) media fingerprints, (b) processing state metadata, (c) extracted media feature values, (d) media class types or sub-type description(s) and/or values, (e) media feature class and/or sub-class probability values, or (f) media processing signaling.

12. The apparatus as recited in claim 10 , wherein the state of the audio data is carried with the output version of the audio data in an output media bitstream.

13. The apparatus as recited in claim 10 , wherein the state of the audio data is carried in an auxiliary metadata bitstream associated with a separate media bitstream that carries the output version of the audio data.

14. The apparatus as recited in claim 10 , wherein the state of the audio data comprises one or more sets of parameters that relate to the type of audio data processing.

15. The apparatus as recited in claim 10 , wherein the apparatus is further configured to perform, by the first audio data processing device, the type of audio data processing.

16. The apparatus as recited in claim 10 , wherein the apparatus is further configured to perform: altering a plurality of bytes in the audio data to store at least a portion of the state of the audio data.

17. The apparatus as recited in claim 10 , wherein the apparatus is further configured to perform:
determining one or more media features from the audio data;
including a description of the one or more media features in the state of audio data.

18. An apparatus for processing audio data, comprising a first audio data processing device in a media processing chain, and configured to perform:
receiving, by the first audio data processing device in the media processing chain, an input version of the audio data and a state of the audio data, wherein the state of the audio data comprises a first hash-based message authentication code;
determining, by the first audio data processing device, a second hash-based message authentication code by applying a cryptographic hash function to a message comprising a combination of the input version of the audio data and the state of the audio data;
authenticating, by the first audio data

Assignees

• Riedmiller Jeffrey
• Radhakrishnan Regunathan
• Pribadi Marvin
• Farahani Farhad
• Smithers Michael
• Dolby Laboratories Licensing Corp

Inventors

• Riedmiller Jeffrey
• Radhakrishnan Regunathan
• Pribadi Marvin
• Farahani Farhad
• Smithers Michael

Classifications

• G10L19/167

  Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes · CPC title

• G10L21/00

  Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility (G10L19/00 takes precedence) · CPC title

• G10L19/26

  Pre-filtering or post-filtering · CPC title

• G10L21/0316

  by changing the amplitude · CPC title

• G10L19/008 Primary

  Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing · CPC title