Encoding of multiple audio signals

Patent metadata

Field	Value
Publication number	US-11094330-B2
Application number	US-202016805289-A
Country	US
Kind code	B2
Filing date	Feb 28, 2020
Priority date	Nov 20, 2015
Publication date	Aug 17, 2021
Grant date	Aug 17, 2021

Abstract

A device includes an encoder configured to determine, during a first period, that a first audio signal is a leading signal and that a second audio signal is a lagging signal. The encoder is also configured to generate a first frame of at least one encoded signal based on a first modified version of the second audio signal that is generated by adjusting the second audio signal based on a first mismatch value. The encoder is configured to determine, during a second period, that the first audio signal is the leading signal and that the second audio signal is the lagging signal. The encoder is configured to generate a second frame of the at least one encoded signal based on a second modified version of the second audio signal that is generated by adjusting the second audio signal based on the first mismatch value and a second mismatch value.

First claim

What is claimed is:

1. A device comprising:
an encoder configured to:
determine, during a first period, a first mismatch value indicative of an amount of temporal mismatch between a first audio signal and a second audio signal;
determine, based on the first mismatch value, and based at least in part on a previous mismatch value corresponding to a previous period, that the first audio signal is a leading audio signal and that the second audio signal is a lagging audio signal; and
generate a first frame of at least one encoded signal based on the first audio signal and a first modified version of the second audio signal, the first modified version of the second audio signal generated by a) adjusting the second audio signal based on the first mismatch value to generate a shifted second audio signal and b) adjusting the shifted second audio signal based on a first relative gain value between the first audio signal and the shifted second audio signal to generate the first modified version of the second audio signal.

2. The device of claim 1 , wherein second samples of the lagging audio signal are temporally delayed relative to first samples of the leading audio signal.

3. The device of claim 2 , wherein the first samples and the second samples correspond to the same sound emitted from a sound source.

4. The device of claim 1 , wherein adjusting the second audio signal based on the first mismatch value includes temporally offsetting the second audio signal based on the first mismatch value.

5. The device of claim 1 , wherein the at least one encoded signal includes a mid signal, a side signal, or both.

6. The device of claim 1 , wherein the first audio signal includes one of a right signal or a left signal, and wherein the second audio signal includes the other of the right signal or the left signal.

7. The device of claim 1 , wherein the encoder is configured to generate the at least one encoded signal based on adjusting one of the first audio signal and the second audio signal.

8. The device of claim 1 , further comprising:
a first input interface configured to receive the first audio signal from a first microphone; and
a second input interface configured to receive the second audio signal from a second microphone.

9. A method of communication comprising:
determining, at a device during a first period, a first mismatch value indicative of an amount of temporal mismatch between a first audio signal and a second audio signal;
determining, based on the first mismatch value, and based at least in part on a previous mismatch value corresponding to a previous period, that a first audio signal is a leading audio signal and that a second audio signal is a lagging audio signal; and
generating a first frame of at least one encoded signal based on the first audio signal and a first modified version of the second audio signal, the first modified version of the second audio signal generated by a) adjusting the second audio signal based on the first mismatch value to generate a shifted second audio signal and b) adjusting the shifted second audio signal based on a first relative gain value between the first audio signal and the shifted second audio signal to generate the first modified version of the second audio signal.

10. The method of claim 9 , wherein a sound source is closer to a first microphone than to a second microphone, wherein first samples of the first audio signal and second samples of the second audio signal correspond to the same sound emitted from the sound source, and wherein the same sound is detected earlier at the first microphone than at the second microphone.

11. The method of claim 9 , wherein the device comprises a mobile device.

12. The method of claim 9 , wherein the device comprises a base station.

13. A computer-readable storage device storing instructions that, when executed by a processor, cause the processor to perform operations comprising:
determining, during a first period, a first mismatch value indicative of an amount of temporal mismatch between a first audio signal and a second audio signal;
determining, based on the first mismatch value, and based at least in part on a previous mismatch value corresponding to a previous period, that the first audio signal is a leading audio signal and that the second audio signal is a lagging audio signal;
generating a first frame of at least one encoded signal based on the first audio signal and a first modified version of the second audio signal, the first modified version of the second audio signal generated by a) adjusting the second audio signal based on the first mismatch value to generate a shifted second audio signal and b) adjusting the shifted second audio signal based on a first relative gain value between the first audio signal and the shifted second audio signal to generate the first modified version of the second audio signal.

14. The computer-readable storage device of claim 13 , wherein the at least one encoded signal includes a mid signal, a side signal, or both.

15. An apparatus comprising:
means for determining a first mismatch value indicative of an amount of temporal mismatch between a first audio signal and a second audio signal, the first mismatch value determined during a first period and indicating that a first audio signal is a leading audio signal and that a second audio signal is a lagging audio signal;
means for determining, based on the first mismatch value, and based at least in part on a previous mismatch value corresponding to a previous period, that the first audio signal is a leading audio signal and that the second audio signal is a lagging audio signal;
means for generating a first frame of at least one encoded signal based on the first audio signal and a first modified version of the second audio signal, the first modified version of the second audio signal generated by a) adjusting the second audio signal based on the first mismatch value to generate a shifted second audio signal and b) adjusting the shifted second audio signal based on a first relative gain value between the first audio signal and the shifted second audio signal to generate the first modified version of the second audio signal.

Assignees

• Qualcomm Inc

Inventors

• Atti Venkatraman
• Chebiyyam Venkata Subrahmanyam Chandra Sekhar
• Sinder Daniel Jared

Classifications

• G10L25/51

  for comparison or discrimination · CPC title

• G10L25/06

  the extracted parameters being correlation coefficients · CPC title

• G10L19/008 Primary

  Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing · CPC title

• G10L19/005 Primary

  Correction of errors induced by the transmission channel, if related to the coding algorithm · CPC title

• G10L21/00

  Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility (G10L19/00 takes precedence) · CPC title