Measuring and compensating for jitter on systems running latency-sensitive audio signal processing

Patent metadata

Field	Value
Publication number	US-10313218-B2
Application number	US-201715675359-A
Country	US
Kind code	B2
Filing date	Aug 11, 2017
Priority date	Aug 11, 2017
Publication date	Jun 4, 2019
Grant date	Jun 4, 2019

Abstract

A system and method receives one or more captured signals through a captured audio path and produces one or more playback signals through a playback audio path. The system and method executes one or more signal processing functions and measures the delays within the playback audio path and captured audio path during operation of the one or more signal processing functions. The system and method stores the measured delays in a memory and compensates the one or more signal processing functions for the playback delay and the capture delay.

First claim

What is claimed is:

1. A system for real-time audio signal processing that receives one or more captured signals through a captured audio path which includes a microphone, and produces one or more playback signals through a playback audio path which includes a speaker, and executes one or more signal processing functions comprising:
a processor configured to measure a playback delay corresponding to delays of the playback audio path and a capture delay corresponding to delays of the captured audio path during operation of the one or more signal processing functions, wherein measuring the playback delay and the capture delay includes measuring delay of a test signal played and received over a feedback channel, and wherein the feedback channel passes through components of the playback audio path and the captured audio path that produce jitter, and wherein the test signal is processed synchronously with the one or more captured signals and the one or more playback signals, and wherein the test signal is not output through the speaker; and
a memory for storing the measured delays;
where the processor is further configured to compensate the one or more signal processing functions for the playback delay and the capture delay.

2. The system of claim 1 , wherein measuring the playback delay and the capture delay occurs when the processor first boots up.

3. The system of claim 1 , wherein measuring the playback delay and the capture delay occurs continuously during the operation of the one or more signal processing functions.

4. The system of claim 1 where measurement of the playback delay and the capture delay determines a synchronization time, when boot-up of a playback event and capture event is completed.

5. The system of claim 1 where the processor is further configured to compare the measured playback delay and the capture delay to prior measurements of playback delay and capture delays stored in memory.

6. The system of claim 5 where the processor is configured to modify the one or more signal processing functions when the measured playback delay and the capture delay change relative to prior measurements.

7. The system of claim 5 where time differences between the compared measurements adjust the delay of the capture and/or playback audio paths by dropping or adding samples to the capture and/or playback audio paths.

8. The system of claim 1 where measurement of the playback delay and capture delay comprise counting the number of audio samples and/or audio buffers in the capture audio path and the playback audio path.

9. The system of claim 1 where the one or more signal processing functions include an active noise control.

10. The system of claim 9 where the playback delay and capture delay adjust offline estimates of a secondary path from loudspeakers to microphones.

11. The system of claim 10 where adjusting the secondary path estimates comprise integer or fractional sample delays of secondary path impulse responses.

12. The system of claim 10 where adjusting the secondary path estimates comprise modifying the phase responses of the secondary path.

13. The system of claim 1 where the one or more signal processing functions comprise an echo cancellation and a feedback cancellation.

14. The system of claim 13 where estimated echo paths are adjusted in response to measured playback and capture delays.

15. The system of claim 1 where the system comprises a vehicle.

16. A method that receives one or more captured signals through a captured audio path which includes a microphone, and produces one or more playback signals through a playback audio path which includes a speaker, and executes one or more signal processing functions comprising:
measuring a playback delay corresponding to delays of the playback audio path and a capture delay corresponding to delays of the captured audio path during operation of the one or more signal processing functions, wherein measuring the playback delay and the capture delay includes measuring delay of a test signal played and received over a feedback channel, and wherein the feedback channel passes through components of the playback audio path and the captured audio path that produce jitter, and wherein the test signal is processed synchronously with the one or more captured signals and the one or more playback signals, and wherein the test signal is not output through the speaker;
storing the measured delays in a memory; and
compensating the one or more signal processing functions for the playback delay and the capture delay.

17. The method of claim 16 , wherein measuring the playback delay and the capture delay occurs during the first boot up.

18. The method of claim 16 , wherein measuring the playback delay and the capture delay occurs continuously during the operation of the one or more signal processing functions.

19. A non-transitory machine-readable medium encoded with machine-executable instructions for receiving one or more captured signals through a captured audio path which includes a microphone, and producing one or more playback signals through a playback audio path which includes a speaker, wherein execution of the machine-executable instructions is for:
measuring a playback delay corresponding to delays of the playback audio path and a capture delay corresponding to delays of the captured audio path during operation of the one or more signal processing functions, wherein measuring the playback delay and the capture delay includes measuring delay of a test signal played and received over a feedback channel, and wherein the feedback channel passes through components of the playback audio path and the captured audio path that produce jitter, and wherein the test signal is processed synchronously with the one or more captured signals and the one or more playback signals, and wherein the test signal is not output through the speaker;
storing the measured delays in a memory; and
compensating the one or more signal processing functions for the playback delay and the capture delay.

Assignees

• Ontario Inc 2236008

Inventors

• Every Mark Robert
• Neufeld Leona Arlene

Classifications

• G10K2210/504

  Calibration · CPC title

• G10K11/17817

  between the output signals and the error signals, i.e. secondary path · CPC title

• G10K11/17881

  the reference signal being an acoustic signal, e.g. recorded with a microphone · CPC title

• H04L51/04

  Real-time or near real-time messaging, e.g. instant messaging [IM] · CPC title

• H04M3/2236

  Quality of speech transmission monitoring · CPC title