Automatic discovery and localization of voice degradation faults using ultrasound techniques

Patent metadata

Field	Value
Publication number	US-11736307-B2
Application number	US-202117231316-A
Country	US
Kind code	B2
Filing date	Apr 15, 2021
Priority date	Apr 15, 2021
Publication date	Aug 22, 2023
Grant date	Aug 22, 2023

Abstract

A method comprises, at a local participant device, establishing audio connections with remote participant devices over a network for an online voice conference. The method includes generating ultrasound signals for corresponding ones of the remote participant devices, and transmitting the ultrasound signals over corresponding ones of the audio connections. The method further includes collecting indications, transmitted by corresponding ones of the remote participant devices over the network, that indicate whether the corresponding ones of the remote participant devices detected the ultrasound signals. The method includes identifying which of the remote participant devices detected the ultrasound signals based on the indications, and localizing degraded voice quality to particular ones of the local participant device and the remote participant devices based, at least in part, on results of identifying.

First claim

What is claimed is:

1. A method comprising:
at a local participant device:
establishing audio connections with remote participant devices over a network for an online voice conference to be supervised by a controller;
generating, using an audio codec, ultrasound signals encoded into audio packets, wherein the ultrasound signals are encoded with a digital identifier of the local participant device;
transmitting the audio packets to, and for detection by, the remote participant devices;
collecting information conveyed in ultrasound confirmation messages transmitted by the remote participant devices to the controller in response to the ultrasound signals, wherein each ultrasound confirmation message includes a data packet having an identifier of a remote participant device, the digital identifier of the local participant device, and an indication of whether the remote participant device successfully detected one of the ultrasound signals;
identifying which of the remote participant devices detected the ultrasound signals based on the information; and
localizing degraded voice quality to particular ones of the local participant device and the remote participant devices based, at least in part, on results of identifying.

2. The method of claim 1 , further comprising, at the local participant device:
generating for display, by the local participant device and the remote participant devices, indications of degraded voice quality for the particular ones of the local participant device and the remote participant devices to which the degraded voice quality is localized.

3. The method of claim 1 , further comprising, at the local participant device:
using the audio codec, encoding voice detected by a microphone of the local participant device into audio packets that convey the voice, and second transmitting the audio packets that convey the voice over the audio connections.

4. The method of claim 1 , wherein the ultrasound signals are in a frequency range above 20 kHz.

5. The method of claim 1 , wherein:
the data packet further includes an indication that an ultrasound loopback test performed by the remote participant device failed or passed.

6. The method of claim 1 , wherein:
generating the ultrasound signals includes generating the ultrasound signals as periodic ultrasound pulses.

7. The method of claim 6 , wherein:
generating includes generating the ultrasound signals as the periodic ultrasound pulses based on periodicities as set by the controller.

8. The method of claim 1 , further comprising, at the local participant device:
when identifying indicates that none of the remote participant devices has detected the ultrasound signals, localizing includes localizing the degraded voice quality to the local participant device.

9. The method of claim 1 , further comprising, at the local participant device:
when identifying indicates that at least one of the remote participant devices has detected the ultrasound signals, but one or more of the remote participant devices have not detected the ultrasound signals, localizing includes localizing the degraded voice quality to each of the one or more of the remote participant devices that have not detected the ultrasound signals.

10. The method of claim 1 , further comprising, at the local participant device:
performing a local ultrasound loopback test that passes or fails when an ultrasound signal transmitted by a loudspeaker of the local participant device is detected or not detected using a microphone of the local participant device, respectively; and
localizing the degraded voice quality to the local participant device when the local ultrasound loopback test fails.

11. The method of claim 1 , further comprising, at each of the remote participant devices:
listening for an ultrasound signal on one of the audio connections; and
when the ultrasound signal is detected or is not detected based on listening, second transmitting, to the network, an ultrasound confirmation message indicating that the ultrasound signal was detected or was not detected, respectively.

12. The method of claim 1 , wherein:
the controller includes a database for storing status information associated with the local participant device and the remote participant devices.

13. The method of claim 1 , further comprising, at the local participant device:
performing generating, transmitting, collecting, identifying, and localizing without exchanging voice signals between the local participant device and the remote participant devices.

14. An apparatus comprising:
a network interface unit to communicate with a network; and
a processor, of a local participant device, coupled to the network interface unit and configured to perform:
establishing audio connections with remote participant devices over the network for an online voice conference to be supervised by a controller;
generating, using an audio codec, ultrasound signals encoded into audio packets, wherein the ultrasound signals are encoded with a digital identifier of the local participant device;
transmitting the audio packets to, and for detection by, the remote participant devices;
collecting information conveyed in ultrasound confirmation messages transmitted by the remote participant devices to the controller in response to the ultrasound signals, wherein each ultrasound confirmation message includes a data packet having an identifier of a remote participant device, the digital identifier of the local participant device, and an indication of whether the remote participant device successfully detected one of the ultrasound signals;
identifying which of the remote participant devices detected the ultrasound signals based on the information; and
localizing degraded voice quality to particular ones of the local participant device and the remote participant devices based, at least in part, on results of identifying.

15. The apparatus of claim 14 , wherein the processor is further configured to perform:
generating for display, by the local participant device and the remote participant devices, indications of degraded voice quality for the particular ones of the local participant device and the remote participant devices to which the degraded voice quality is localized.

16. The apparatus of claim 14 , wherein the processor is further configured to perform:
using the audio codec, encoding voice detected by a microphone of the local participant device into audio packets that convey the voice, and second transmitting the audio packets that convey the voice over the audio connections.

17. The apparatus of claim 14 , wherein the ultrasound signals are in a frequency range above 20 kHz.

18. A non-transitory computer readable medium encoded with instructions that, when executed by a processor of a local participant device, cause the processor to perform:
establishing audio connections with remote participant devices over a network for an online voice conference to be supervised by a controller;
generating, using an audio codec, ultrasound signals encoded into audio packets, wherein the ultrasound signals are encoded with a digital identifier of the local participant device;
transmitting the audio packets to, and for detection by, the remote participant devices;
collecting information conveyed in ultrasound confirmation messages transmitted by the remote participant devices to the controller in response to the ultrasound signals, wherein each ultrasound confirmation message includes a data packet having an identifier of a remote participant device, the digital ident

Assignees

• Cisco Tech Inc

Inventors

• Bahl Rohit

Classifications

• H04L12/1827 Primary

  Network arrangements for conference optimisation or adaptation · CPC title

• G10L19/167

  Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes · CPC title

• G10L19/24

  Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding · CPC title

• H04L12/1822

  Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission · CPC title