Dynamic audio synchronization

Patent metadata

Field	Value
Publication number	US-9967437-B1
Application number	US-201313787114-A
Country	US
Kind code	B1
Filing date	Mar 6, 2013
Priority date	Mar 6, 2013
Publication date	May 8, 2018
Grant date	May 8, 2018

Abstract

A method and apparatus for synchronizing media content emitted from various sources is presented. Arrival timing of outputs from the various sources to a particular location is determined and adjusted to reduce synchronization delays at the particular location. Synchronization delays may be determined by detecting the media output from a combination of sources arriving at the location. Control messages are generated by processing the detected output and determining delays to be applied to corresponding sources.

First claim

What is claimed is:

1. A method of synchronizing audio output signals, comprising:
detecting, by a microphone of a device at a first location, first audio output from a first speaker at a second location, wherein the first audio is based on a first audio signal input to the first speaker by a first source device;
detecting, by the microphone, second audio output from a second speaker at a third location, wherein the second audio:
is based on a second audio signal input to the second speaker by a second source device,
is similar to the first output audio sound, and
as acquired by the microphone, has a first time delay relative to the first output audio;

receiving, by synchronization logic of the device, a combined audio signal from the microphone, the combined audio signal representing at least a portion of the first output audio and at least a portion of the second output audio;
performing, by the synchronization logic, an auto-correlation of the combined audio signal, the auto-correlation outputting an auto-correlation signal that has a plurality of peaks in magnitude over time, the auto-correlation signal indicating a level of similarity between the combined audio signal and time-delayed versions of the combined audio signal, the plurality of peaks including a first peak and at least one offset peak shifted in time relative the first peak;
selecting, by the synchronization logic, a second peak of the at least one offset peak that has a largest magnitude of the at least one offset peak;
determining, by the synchronization logic, a first time difference between the first peak and the second peak, the first time difference corresponding to the first time delay;
sending, from the synchronization logic, to the first source device, a timing adjustment message including information indicative of the first time difference; and
delaying, by the first source device, the first audio signal input based on the timing adjustment message to reduce the first time delay,
wherein the first source device and the second source device are different devices receiving a same media content, the first audio signal input and the second audio signal input being audio from the same media content.

2. The method of claim 1 , further comprising:
determining a first timing adjustment to configure a controller of the first source device to delay the first audio signal to reduce the first time difference,
wherein the information indicative of the time difference comprises the first timing adjustment.

3. The method of claim 2 , further comprising:
detecting, in the combined audio signal, a speaker-specific message embedded in the first output audio; and
identifying the first output audio based on the speaker-specific message,
wherein determining the timing adjustment is based in part on having identifying the first output audio.

4. The method of claim 1 , comprising:
determining a second time difference between the first output audio and a video output signal;
determining a first timing adjustment to reduce the second time difference; and
sending, from the device to a source of the video output signal, the timing adjustment message including the first timing adjustment.

5. The method of claim 1 , wherein the first location, second location, and third location are separate locations.

6. A method of synchronizing audio output signals, comprising:
receiving, by a microphone of a device at a first time, a first output audio sound from a first speaker, wherein the first output audio sound is based on a first audio signal input at a second time instance to the first speaker;
receiving, by the microphone at the first time, a second output audio sound from a second speaker, wherein the second output audio sound is based on a digitally processed second audio signal, the digitally processed second audio signal including a processing delay relative to the second time instance;
receiving, by synchronization logic of the device, a combined audio signal from the microphone, the combined audio signal being based on the first output audio sound and the second output audio sound, wherein the second output audio sound, as represented in the combined audio signal, exhibits a first time delay relative to the first output audio sound;
producing, by the synchronization logic, an auto-correlation of the combined audio signal, the auto-correlation outputting an auto-correlation signal indicating a level of similarity between the combined audio signal and time-delayed versions of the combined audio signal;
determining, by the synchronization, a first time difference between the first output audio sound and the second output audio sound based on the auto-correlation signal; and
sending, from the synchronization logic to a first source of the first audio signal input, a first timing adjustment message including information indicative of the first time difference.

7. The method of claim 6 , further comprising:
determining a timing adjustment to configure a controller of the first source to delay the first audio signal input to reduce the first time difference,
wherein the information indicative of the first time difference comprises the timing adjustment.

8. The method of claim 7 , comprising:
sensing, in the combined audio signal, a first source-specific sound in the first output audio sound; and
identifying the first output audio sound based on the sensing of the first source-specific sound,
wherein determining the timing adjustment is based in part on having identified the first output audio sound.

9. The method of claim 6 , comprising wirelessly receiving, by the second speaker, the digitally processed second audio signal.

10. The method of claim 6 , further comprising:
acquiring a first video output from a first video display by a camera, wherein the first video output is based on a first video signal input to the first video display;
determining a second time difference between the first video output and the second output audio sound;
determining a second timing adjustment that reduces the second time difference between the first video output and the second output audio sound; and
sending the timing adjustment message including the second timing adjustment from the device to a source of the first video output.

11. The method of claim 6 , further comprising:
receiving, by the microphone at the first time, a third output audio sound from a third speaker, wherein the third output audio sound is based on a third audio signal input to the third speaker at the second time instance, and the combined audio signal is further based on the third output audio sound;
determining a second time difference between the first output audio sound and the third output audio sound; and
transmitting, to one or more of the first source, a second source of the second audio signal input, and a third source of the third audio signal input, a second timing adjustment message including information indicative of the second time difference.

12. The method of claim 11 , wherein one of the first speaker, the second speaker, and the third speaker is part of the device, and each of the other speakers are separate from the device and each other, and are located at different locations.

13. The method of claim 6 , further comprising:
receiving the timing adjustment at the first source;
delaying, by the first source, outputting of the first audio signal input at a second time instance; and
determining, by the device, that sending the first timing adjustment message produced a second time difference between the first output audio sound and the second output audio sound as received in the comb

Assignees

• Amazon Tech Inc

Inventors

• Meyers James David
• O'Neill Jeffrey

Classifications

• H04S7/301

  Automatic calibration of stereophonic sound system, e.g. with test microphone · CPC title

• H04N5/04 Primary

  Synchronising (for television systems using pulse code modulation H04N7/56) · CPC title

• H04N21/43076

  of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices · CPC title

• H04N5/60

  for the sound signals · CPC title

• H04N21/8106

  involving special audio data, e.g. different tracks for different languages · CPC title