Method and apparatus for compressing and decompressing a higher order ambisonics representation for a sound field

Patent metadata

Field	Value
Publication number	US-10038965-B2
Application number	US-201715435175-A
Country	US
Kind code	B2
Filing date	Feb 16, 2017
Priority date	Dec 12, 2012
Publication date	Jul 31, 2018
Grant date	Jul 31, 2018

Abstract

The invention improves HOA sound field representation compression. The HOA representation is analyzed for the presence of dominant sound sources and their directions are estimated. Then the HOA representation is decomposed into a number of dominant directional signals and a residual component. This residual component is transformed into the discrete spatial domain in order to obtain general plane wave functions at uniform sampling directions, which are predicted from the dominant directional signals. Finally, the prediction error is transformed back to the HOA domain and represents the residual ambient HOA component for which an order reduction is performed, followed by perceptual encoding of the dominant directional signals and the residual component.

First claim

The invention claimed is:

1. A method for compressing a Higher Order Ambisonics representation (denoted HOA) for a sound field, the method comprising:
from a current time frame of HOA coefficients, estimating dominant sound source directions;
decomposing the HOA representation into dominant directional signals in a time domain and a residual HOA component, wherein the residual HOA component is transformed into a discrete spatial domain in order to obtain plane wave functions at uniform sampling directions representing the residual HOA component, and wherein the plane wave functions are predicted from the dominant directional signals, thereby providing parameters describing the prediction;
de-correlating the residual HOA component to obtain corresponding residual HOA component time domain signals;
perceptually encoding the dominant directional signals and the residual HOA component time domain signals to determine compressed dominant directional signals and compressed residual component signals.

2. The method according to claim 1 , wherein the decomposing includes:
computing from the estimated sound source directions for a current frame of HOA coefficients dominant directional signals,
temporally smoothing the dominant directional signals to determine smoothed dominant directional signals;
computing from the estimated sound source directions and the smoothed dominant directional signals an HOA representation of smoothed dominant directional signals;
representing a corresponding residual HOA representation by directional signals on a uniform grid;
from the smoothed dominant directional signals and the residual HOA representation by directional signals, predicting directional signals on uniform grid and computing therefrom an HOA representation of predicted directional signals on uniform grid, followed by temporal smoothing;
computing from the smoothed predicted directional signals on uniform grid, from a two-frames delayed version of the current frame of HOA coefficients, and from a frame delayed version of the smoothed dominant directional signals an HOA representation of a residual ambient sound field component.

3. An apparatus for compressing a Higher Order Ambisonics representation (denoted HOA) for a sound field, the apparatus comprising:
an estimator which estimates dominant sound source directions from a current time frame of HOA coefficients;
a decomposer which decomposes the HOA representation into dominant directional signals in a time domain and a residual HOA component, wherein the residual HOA component is transformed into a discrete spatial domain in order to obtain plane wave functions at uniform sampling directions representing the residual HOA component, and wherein the plane wave functions are predicted from the dominant directional signals, thereby providing parameters describing the prediction;
a de-correlator which de-correlates the residual HOA component to obtain corresponding residual HOA component time domain signals;
an encoder which perceptually encodes the dominant directional signals and the residual HOA component time domain signals so as to provide compressed dominant directional signals and compressed residual component signals.

4. The apparatus according to claim 3 , wherein the decomposer is further configured to:
compute from the estimated sound source directions, for a current frame of HOA coefficients, dominant directional signals;
temporally smooth the dominant directional signals resulting in smoothed dominant directional signals;
compute from the estimated sound source directions and the smoothed dominant directional signals an HOA representation of smoothed dominant directional signals;
represent a corresponding residual HOA representation by directional signals on a uniform grid;
from the smoothed dominant directional signals and the residual HOA representation by directional signals, predict directional signals on uniform grid and computing therefrom an HOA representation of predicted directional signals on uniform grid, followed by temporal smoothing;
compute from the smoothed predicted directional signals on uniform grid, from a two-frames delayed version of the current frame of HOA coefficients, and from a frame delayed version of the smoothed dominant directional signals an HOA representation of a residual ambient sound field component.

5. A method for decompressing a compressed Higher Order Ambisonics (denoted HOA) representation, the method comprising:
perceptually decoding compressed dominant directional signals and compressed residual component signals so as to provide decompressed dominant directional signals and decompressed time domain signals representing the residual HOA component in a spatial domain;
re-correlating the decompressed time domain signals to obtain a corresponding reduced-order residual HOA component;
determining a decompressed residual HOA component based on the corresponding reduced-order residual HOA component;
determining predicted directional signals based on at least a parameter;
determining an HOA sound field representation based on the decompressed dominant directional signals, the predicted directional signals, and the decompressed residual HOA component.

6. An apparatus for decompressing a Higher Order Ambisonics (denoted HOA) representation, the apparatus comprising:
a decoder which perceptually decodes compressed dominant directional signals and compressed residual component signals so as to provide decompressed dominant directional signals and decompressed time domain signals representing the residual HOA component in a spatial domain;
a re-correlator which re-correlates the decompressed time domain signals to obtain a corresponding reduced-order residual HOA component;
a processor configured to determine a decompressed residual HOA component based on the corresponding reduced-order residual HOA component, the processor further configured to determine predicted directional signals based on at least a parameter;
wherein the processor is further configured to determine an HOA sound field representation based on the decompressed dominant directional signals, the predicted directional signals, and the decompressed residual HOA component.

Assignees

• Dolby Laboratories Licensing Corp

Inventors

• Krueger Alexander
• Kordon Sven
• Boehm Johannes

Classifications

• G10L19/008 Primary

  Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing · CPC title

• H04S3/008

  in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02) · CPC title

• H04S2420/11

  Application of ambisonics in stereophonic audio systems · CPC title

• H04H20/89

  using three or more audio channels, e.g. triphonic or quadraphonic · CPC title

• H04S2400/01

  Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved · CPC title