Audio stream mixing system and method

Patent metadata

Field	Value
Publication number	US-10747497-B2
Application number	US-201916663426-A
Country	US
Kind code	B2
Filing date	Oct 25, 2019
Priority date	Aug 8, 2018
Publication date	Aug 18, 2020
Grant date	Aug 18, 2020

Abstract

Provided are a system and method of mixing a second audio stream with a first audio stream in an audio output device. The system is configured to execute the method, comprising buffering and outputting the first audio stream via the audio output device as unmodified output, determining at least one insertion spot within the first audio stream, modifying the first audio stream at an insertion spot to avoid content loss, outputting the second audio stream at the insertion spot, and resuming unmodified output of the first audio stream at or near a completion of the second audio stream. Modifying the first audio stream can include pausing and/or warping the first audio stream at the insertion spot. The audio output device can be a vehicle head unit or a wireless device, such as a mobile phone.

First claim

What is claimed is:

1. An audio stream mixing system, comprising:
one or more processors coupled to one or more computer storage devices, one or more first audio stream sources, one or more second audio stream sources, and one or more audio output devices, wherein the one or more processors are configured to:
buffer the first audio stream from a first audio stream source in the one or more computer storage devices;
determine an insertion spot within the first audio stream;
output the buffered first audio stream via the one or more audio output devices, wherein the one or more processors are configured to modify output of at least a portion of the first audio stream to accommodate output of a second audio stream at the insertion spot to minimize or avoid content degradation or loss of the first audio stream, the second audio stream received from a second audio stream source;
output the second audio stream via the one or more audio output devices at the insertion spot; and
continue output of the buffered first audio stream via the one or more audio output devices after completion of the second audio stream.

2. The system of claim 1 , wherein the second audio stream is received during output of the first audio stream.

3. The system of claim 1 , wherein the one or more processors are configured to buffer the first audio stream in response to receipt of the second audio stream.

4. The system of claim 1 , wherein the first audio stream is a radio stream.

5. The system of claim 1 , wherein the first audio stream is playback of content from a tangible storage medium local to the audio output device.

6. The system of claim 5 , wherein the tangible storage medium is a compact disc, unified serial bus medium, hard drive, or a computer memory.

7. The system of claim 1 , wherein the second audio stream is received by the audio output device with an urgency or maximum delay indicator.

8. The system of claim 7 , wherein the one or more processors are configured to:
identify a maximum delay for output of the second audio stream based on the urgency or maximum delay indicator.

9. The system of claim 7 , wherein the one or more processors are configured to:
determine the insertion spot based, at least in part, on the urgency or maximum delay indicator.

10. The system of claim 1 , wherein the one or more processors are configured to find a gap or pause within the first audio stream to determine the insertion spot.

11. The system of claim 1 , wherein the one or more processors are configured to analyze the first audio stream using one or more speech analysis techniques to find ends of sentences, phrases, words, or other natural points of interruption to determine the insertion spot.

12. The system of claim 11 , wherein the one or more speech analysis techniques includes at least one of Voice Activity Detection (VAD), Automatic Speech Recognition (ASR), and Natural Language Understanding (NLU).

13. The system of claim 1 , wherein the one or more processors are configured to find a low volume level within the first audio stream to determine the insertion spot.

14. The system of claim 1 , wherein the one or more processors are configured to pause the first audio stream at the insertion spot as a modification of the first audio stream.

15. The system of claim 1 , wherein the one or more processors are configured to modify a time-frequency structure of the first audio stream as a modification of the first audio stream.

16. The system of claim 1 , wherein the one or more processors are configured to warp the first audio stream at or near the insertion spot as a modification to the first audio stream.

17. The system of claim 1 , wherein the one or more processors are configured to modify the second audio stream and output the second audio stream as a modified second audio stream at the insertion spot.

18. The system of claim 17 , wherein the modified second audio stream includes a modified time-frequency structure.

19. The system of claim 17 , wherein the one or more processors are configured to modify a voice style of the second audio stream to improve intelligibility relative to the first audio stream.

20. The system of claim 1 , wherein the audio output device is or forms part of a vehicle head unit.

21. The system of claim 20 , wherein the second audio stream is an announcement or an alert from a vehicle navigation system, vehicle monitoring system, or a text to speech system.

22. The system of claim 1 , wherein the second audio stream is an announcement or an alert from an advertising system.

23. The system of claim 1 , wherein the audio output device is a wireless portable device comprising a mobile phone, tablet, or phablet.

Assignees

• Cerence Operating Co

Inventors

• Lenke Nils
• Couvreur Christophe

Classifications

• G11B27/038

  Cross-faders therefor · CPC title

• G10L25/78

  Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10) · CPC title

• G10L25/48

  specially adapted for particular use · CPC title

• G10L21/04

  Time compression or expansion · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title