Residual encoding in an object-based audio system

Patent metadata

Field	Value
Publication number	US-9779739-B2
Application number	US-201514620544-A
Country	US
Kind code	B2
Filing date	Feb 12, 2015
Priority date	Mar 20, 2014
Publication date	Oct 3, 2017
Grant date	Oct 3, 2017

Abstract

Lossy compression and transmission of a downmixed composite signal having multiple tracks and objects, including a downmixed signal, is accomplished in a manner that reduces the bit-rate requirement as compared to redundant transmission or lossless compression, while reducing upmix artifacts. A compressed residual signal is generated and transmitted along with a compressed total mix and at least one compressed audio objects. In the reception and upmix aspect the invention decompresses a downmixed signal and other compressed objects, calculates an approximate upmix signal, and corrects specific base signals derived from the upmix, by subtracting a decompressed residual signal. The invention thus allows lossy compression to be used in combination with downmixed audio signals for transmission through a communication channel (or for storage). Upon later reception and upmix, additional base signals are recoverable in capable systems providing multi-object capability (while legacy systems can easily decode a total mix without upmix).

First claim

We claim:

1. A method of decompressing and upmixing a compressed and downmixed, composite audio signal, comprising the steps:
receiving a compressed representation of a total mix signal C, a compressed representation of a residual signal Δ; and a set of compressed representations of respective object signals {Bi};
wherein the set of compressed representations of at least one object signal includes at least one compressed representation of a corresponding object signal Bi;
decompressing the compressed representation of the total mix signal and the compressed representation of the residual signal, to obtain an approximate total mix signal C′;
decompressing the compressed representation of the residual signal Δ to obtain a reconstructed residual signal;
decompressing the set of compressed representations object signal {Bi} to obtain a set of object signals {Bi′}, said set having one or more object signals Bi′ as members;
subtractively mixing the approximate total mix signal C′ and the complete set of object signals {Bi′} to obtain a first approximation of a base signal A′; and
subtractively mixing the reconstructed residual signal with the first approximation of the base signal, to obtain an improved approximation of the base signal.

2. The method of claim 1 , wherein said set of compressed representations of object signals comprises one compressed representation of a corresponding object signal.

3. The method of claim 1 , wherein at least one of the compressed representations is prepared by a lossy method of compression.

4. The method of claim 3 wherein the compressed representation of the residual signal Δ is prepared by:
subtractively mixing a reference signal R with a reconstructed approximation A′ of a base signal A to obtain a residual signal Δ representing the difference; and
compressing the residual signal Δ.

5. The method of claim 4 wherein the reference signal comprises the base signal A.

6. The method of claim 4 wherein the reference signal comprises an approximation of the base signal A.

7. The method of claim 1 further comprising:
causing at least one of the corrected base signal A′, the reconstructed object signals {Bi}, and the approximate total mix signal C′ to be reproduced as a sound.

8. The method of claim 1 , wherein
The step of decompressing the set of compressed representations of at respective object signals {Bi} comprises decompressing a plurality compressed representations to obtain a respective plurality of object signals {Bi′}; and
wherein said step of subtractively mixing the approximate total mix signal C′ and the complete set of object signals includes subtracting from C′ the complete plurality of object signals {Bi′}, to obtain the first approximation of the base signal.

9. The method of claim 8 , wherein at least one of the compressed representations is prepared by a lossy method of compression.

10. The method of claim 9 wherein the compressed representation of the residual signal Δ is prepared by:
subtractively mixing a reference signal R with a reconstructed approximation A′ of a base signal A to obtain a residual signal Δ representing the difference; and
compressing the residual signal Δ.

11. The method of claim 10 wherein the reference signal comprises the base signal A.

12. The method of claim 10 wherein the reference signal comprises an approximation of the base signal A.

13. The method of claim 8 further comprising:
causing at least one of the corrected base signal A′, the reconstructed object signals {Bi}, and the approximate total mix signal C′ to be reproduced as a sound.

14. A method of compressing a composite audio signal comprising a total mix signal C, a set of at least one object signals {Bi}, and a base signal A, wherein said total mix signal C comprises a base signal A mixed with the set of audio object signals {Bi}, said set of audio object signals {Bi} having at least one member object signal Bi, the method comprising the steps:
compressing the total mix signal C and the complete set of audio object signals {Bi} by a lossy method of compression, to produce compressed total mix signal E(C) and a compressed set of object signals E({Bi}), respectively;
decompressing the compressed total mix signal E(C) and the set of compressed object signals E({Bi}) to obtain a reconstructed Q(C) and a reconstructed set of at least one object signals Q({Bi});
subtractively mixing the reconstructed signal Q(C) and a complete mix of the set of reconstructed signals Q({Bi}) to produce an approximate base signal Q′(A);
subtracting a reference signal from said approximate base signal Q′(A) to yield a residual signal Δ; and
Compressing the residual signal Δ to obtain a compressed residual signal Ec(Δ).

15. The method of claim 14 , wherein said set of at least one object signals {Bi} comprises only one object signal.

16. The method of claim 15 , further comprising the step:
Transmitting a composite signal comprising the compressed total mix signal E(C), the compressed object signal E({Bi}) and the compressed residual signal E(Δ).

17. The method of claim 15 , wherein said reference signal comprises the base signal A.

18. The method of claim 15 , wherein said reference signal comprises an approximation of the base signal A derived by compressing the base signal A by a lossy compression method, then decompressing to obtain an approximation of the base signal Q(A).

19. The method of claim 15 wherein said step of compressing the residual signal comprises compressing the residual signal by a method different from a method used to compress the total mix signal C.

20. The method of claim 14 wherein said set of at least one object signals {Bi} comprises a plurality of object signals.

21. The method of claim 20 , wherein said reference signal comprises the base signal A.

22. The method of claim 20 , wherein said reference signal comprises an approximation of the base signal A derived by compressing the base signal A by a lossy compression method, then decompressing to obtain an approximation of the base signal Q(A).

23. The method of claim 20 wherein said step of compressing the residual signal comprises compressing the residual signal by a method different from a method used to compress the total mix signal C.

24. A method to improve digital audio reproduction by refining an approximate audio base signal A derived from an approximate total mix signal C′ and a set of approximately reconstructed audio object signals {Bi′} having at least one member signal Bi′, the method comprising the steps:
decompressing a compressed representation of a residual signal E(Δ) to obtain a residual signal Δ;
subtractively mixing the approximate total mix signal C′ and the complete set of approximately reconstructed object signals {Bi′} to obtain a first approximation of a base signal A′; and
subtractively mixing the reconstructed residual signal Δ with the first approximation of the base signal A′, to obtain an improved approximation of the base signal.

25. The method of claim 24 wherein the compressed representation of the residual signal E(Δ) is prepared by:
subtractively mixing a reference signal R with a reconstructed approximation A′ of a base signal A to obtain a residual signal Δ representing the difference; and
compressing the residual signal Δ.

26. The method of claim 25 wherein the reference signal comprises a base signal A.

2

Assignees

• Dts Inc

Inventors

• Kalker Antonius
• Seroussi Gadiel

Classifications

• G10L19/008 Primary

  Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing · CPC title

• G10L19/20

  using sound class specific coding, hybrid encoders or object based coding · CPC title

• G10L19/00

  Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis (in musical instruments G10H) · CPC title