Method and apparatus for compressing and decompressing a Higher Order Ambisonics representation for a sound field

Patent metadata

Field	Value
Publication number	US-9646618-B2
Application number	US-201314651313-A
Country	US
Kind code	B2
Filing date	Dec 4, 2013
Priority date	Dec 12, 2012
Publication date	May 9, 2017
Grant date	May 9, 2017

Abstract

The invention improves HOA sound field representation compression. The HOA representation is analyzed for the presence of dominant sound sources and their directions are estimated. Then the HOA representation is decomposed into a number of dominant directional signals and a residual component. This residual component is transformed into the discrete spatial domain in order to obtain general plane wave functions at uniform sampling directions, which are predicted from the dominant directional signals. Finally, the prediction error is transformed back to the HOA domain and represents the residual ambient HOA component for which an order reduction is performed, followed by perceptual encoding of the dominant directional signals and the residual component.

First claim

The invention claimed is:

1. A method for compressing a Higher Order Ambisonics representation (denoted HOA) for a sound field, said method comprising:
from a current time frame of HOA coefficients, estimating dominant sound source directions;
decomposing said HOA representation into dominant directional signals in a time domain and a residual HOA component, wherein said residual HOA component is transformed into a discrete spatial domain in order to obtain plane wave functions at uniform sampling directions representing said residual HOA component, and wherein said plane wave functions are predicted from said dominant directional signals, thereby providing parameters describing said prediction, and a corresponding prediction error from said prediction is transformed back into an HOA domain;
reducing the current order of said residual HOA component to a lower order, resulting in a reduced-order residual HOA component;
de-correlating said reduced-order residual HOA component to obtain corresponding residual HOA component time domain signals;
perceptually encoding said dominant directional signals and said residual HOA component time domain signals so as to provide compressed dominant directional signals and compressed residual component signals.

2. The method according to claim 1 , wherein said de-correlating of said reduced-order residual HOA component is performed by transforming said reduced-order residual HOA component to a corresponding order number of equivalent signals in the spatial domain using a Spherical Harmonic Transform.

3. The method according to claim 1 , wherein said de-correlating of said reduced-order residual HOA component is performed by transforming said reduced-order residual HOA component to a corresponding order number of equivalent signals in the spatial domain using a Spherical Harmonic Transform, where a grid of the uniform sampling directions is rotated, and by providing side information enabling a reversion of said de-correlating.

4. The method according to claim 1 , wherein said perceptually encoding comprises joint compression of said dominant directional signals and said residual HOA component time domain signals.

5. The method according to claim 1 , wherein said decomposing includes:
computing from the estimated sound source directions in for a current frame of HOA coefficients dominant directional signals, followed by temporal smoothing resulting in smoothed dominant directional signals;
computing from said estimated sound source directions in and said smoothed dominant directional signals an HOA representation of smoothed dominant directional signals;
representing a corresponding residual HOA representation by directional signals on a uniform grid;
from said smoothed dominant directional signals and said residual HOA representation by directional signals, predicting directional signals on uniform grid and computing therefrom an HOA representation of predicted directional signals on uniform grid, followed by temporal smoothing;
computing from said smoothed predicted directional signals on uniform grid, from a two-frames delayed version of said current frame of HOA coefficients, and from a frame delayed version of said smoothed dominant directional signals an HOA representation of a residual ambient sound field component.

6. The method according to claim 1 whereby the compressing of Higher Order Ambisonics representation comprises compressing of a digital audio signal.

7. An apparatus for compressing a Higher Order Ambisonics representation (denoted HOA) for a sound field, said apparatus comprising:
an estimator which estimates dominant sound source directions from a current time frame of HOA coefficients;
a decomposer which decomposes said HOA representation into dominant directional signals in time domain and a residual HOA component, wherein said residual HOA component is transformed into a discrete spatial domain in order to obtain plane wave functions at uniform sampling directions representing said residual HOA component, and wherein said plane wave functions are predicted from said dominant directional signals, thereby providing parameters describing said prediction, and a corresponding prediction error from said prediction is transformed back into the HOA domain;
an order reducer which reduces the current order of said residual HOA component to a lower order, resulting in a reduced-order residual HOA component;
a de-correlator which de-correlates said reduced-order residual HOA component to obtain corresponding residual HOA component time domain signals;
an encoder which perceptually encodes said dominant directional signals and said residual HOA component time domain signals so as to provide compressed dominant directional signals and compressed residual component signals.

8. The apparatus according to claim 7 , wherein said de-correlating of said reduced-order residual HOA component is performed by transforming said reduced-order residual HOA component to a corresponding order number of equivalent signals in the spatial domain using a Spherical Harmonic Transform.

9. The apparatus according to claim 7 , wherein said de-correlating of said reduced-order residual HOA component is performed by transforming said reduced-order residual HOA component to a corresponding order number of equivalent signals in the spatial domain using a Spherical Harmonic Transform, where a grid of the uniform sampling directions is rotated, and by providing side information enabling reversion of said de-correlating.

10. The apparatus according to claim 7 , wherein said perceptual encoding of said dominant directional signals and said residual HOA component time domain signals is performed jointly.

11. The apparatus according to claim 7 , wherein said decomposing includes:
computing from the estimated sound source directions in for a current frame of HOA coefficients dominant directional signals, followed by temporal smoothing resulting in smoothed dominant directional signals;
computing from said estimated sound source directions in and said smoothed dominant directional signals an HOA representation of smoothed dominant directional signals;
representing a corresponding residual HOA representation by directional signals on a uniform grid;
from said smoothed dominant directional signals and said residual HOA representation by directional signals, predicting directional signals on uniform grid and computing therefrom an HOA representation of predicted directional signals on uniform grid, followed by temporal smoothing;
computing from said smoothed predicted directional signals on uniform grid, from a two-frames delayed version of said current frame of HOA coefficients, and from a frame delayed version of said smoothed dominant directional signals an HOA representation of a residual ambient sound field component.

12. The apparatus according to claim 11 , wherein said predicting of directional signals on the uniform grid is computed by a delay and a full-band scaling from the assigned dominant directional signal.

13. The apparatus according to claim 11 , wherein in said predicting of directional signals on uniform grid scaling factors for perceptually oriented frequency bands are determined.

14. A method for decompressing a compressed Higher Order Ambisonics (denoted HOA) representation, said method comprising:
perceptually decoding compressed dominant directional signals and compressed residual component signals so as to provide decompressed dominant directional signals and decompressed time domain signals representing a residual HOA component in a spatial domain;
re-correlating said decompressed time domain

Assignees

• Dolby Laboratories Licensing Corp

Inventors

• Krueger Alexander
• Kordon Sven
• Boehm Johannes

Classifications

• G10L19/008 Primary

  Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing · CPC title

• H04S3/008

  in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02) · CPC title

• H04S2400/01

  Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved · CPC title

• H04S2420/11

  Application of ambisonics in stereophonic audio systems · CPC title

• H04S7/302 Primary

  Electronic adaptation of stereophonic sound system to listener position or orientation (H04S7/301 takes precedence) · CPC title