Audio stream mixing system and method

Patent metadata

Field	Value
Publication number	US-10459686-B1
Application number	US-201816058200-A
Country	US
Kind code	B1
Filing date	Aug 8, 2018
Priority date	Aug 8, 2018
Publication date	Oct 29, 2019
Grant date	Oct 29, 2019

Abstract

Provided are a system and method of mixing a second audio stream with a first audio stream in an audio output device. The system is configured to execute the method, comprising buffering and outputting the first audio stream via the audio output device as unmodified output, determining at least one insertion spot within the first audio stream, modifying the first audio stream at an insertion spot to avoid content loss, outputting the second audio stream at the insertion spot, and resuming unmodified output of the first audio stream at or near a completion of the second audio stream. Modifying the first audio stream can include pausing and/or warping the first audio stream at the insertion spot. The audio output device can be a vehicle head unit or a wireless device, such as a mobile phone.

First claim

What is claimed is:

1. A method of mixing a second audio stream with a first audio stream in an audio output device, the method comprising:
buffering the first audio stream;
determining an insertion spot within the first audio stream;
outputting the buffered first audio stream, including modifying output of at least a portion of the first audio stream to accommodate output of the second audio stream at the insertion spot to minimize or avoid content degradation or loss of the first audio stream, wherein modifying the first audio stream at the insertion spot includes one of (i) modifying a time-frequency structure of the first audio stream, or (ii) warping the first audio stream at or near the insertion spot;
outputting the second audio stream at the insertion spot; and
continuing output of the buffered first audio stream after completion of the second audio stream.

2. The method of claim 1 , wherein the second audio stream is received during output of the first audio stream.

3. The method of claim 1 , wherein the buffering of the first audio stream occurs in response to receipt of the second audio stream.

4. The method of claim 1 , wherein the first audio stream is a radio stream.

5. The method of claim 1 , wherein the first audio stream is playback of content from a tangible storage medium local to the audio output device.

6. The method of claim 5 , wherein the tangible storage medium is a compact disc, unified serial bus medium, hard drive, or a computer memory.

7. The method of claim 1 , wherein the second audio stream is received by the audio output device with an urgency or maximum delay indicator.

8. The method of claim 7 , wherein the method includes:
identifying a maximum delay for output of the second audio stream based on the urgency or maximum delay indicator.

9. The method of claim 7 , further comprising:
determining the insertion spot based, at least in part, on the urgency or maximum delay indicator.

10. The method of claim 1 , wherein determining the insertion spot includes finding a gap or pause within the first audio stream.

11. The method of claim 1 , wherein determining the insertion spot includes analyzing the first audio stream using one or more speech analysis techniques to find ends of sentences, phrases, words, or other natural points of interruption.

12. The method of claim 11 , wherein the one or more speech analysis techniques includes at least one of Voice Activity Detection (VAD), Automatic Speech Recognition (ASR), and Natural Language Understanding (NLU).

13. The method of claim 1 , wherein outputting the second audio stream at the insertion spot includes modifying the second audio stream.

14. The method of claim 13 , wherein modifying the second audio stream includes modifying a time-frequency structure of the second audio stream.

15. The method of claim 13 , wherein modifying the second audio stream includes modifying a voice style of the second audio stream to improve intelligibility relative to the first audio stream.

16. The method of claim 1 , wherein the audio output device is or forms part of a vehicle head unit.

17. The method of claim 16 , wherein the second audio stream is an announcement or an alert from a vehicle navigation system, vehicle monitoring system, or a text to speech system.

18. The method of claim 1 , wherein the second audio stream is an announcement or an alert from an advertising system.

19. The method of claim 1 , wherein the audio output device is a wireless portable device comprising a mobile phone, tablet, or phablet.

20. A method of mixing a second audio stream with a first audio stream in an audio output device, the method comprising:
buffering the first audio stream;
determining an insertion spot within the first audio stream, wherein determining the insertion spot includes finding a low volume level within the first audio stream;
outputting the buffered first audio stream, including modifying output of at least a portion of the first audio stream to accommodate output of the second audio stream at the insertion spot to minimize or avoid content degradation or loss of the first audio stream;
outputting the second audio stream at the insertion spot; and
continuing output of the buffered first audio stream after completion of the second audio stream.

21. The method of claim 20 , wherein modifying the first audio stream at the insertion spot includes pausing the first audio stream at the insertion spot.

Assignees

• Nuance Communications Inc

Inventors

• Lenke Nils
• Couvreur Christophe

Classifications

• G11B27/038

  Cross-faders therefor · CPC title

• G10L25/48

  specially adapted for particular use · CPC title

• G10L21/04

  Time compression or expansion · CPC title

• G10L25/78

  Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10) · CPC title

• G06F3/165 Primary

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title