System and method for providing intelligent and automatic mute notification

Patent metadata

Field	Value
Publication number	US-9560208-B2
Application number	US-201414149028-A
Country	US
Kind code	B2
Filing date	Jan 7, 2014
Priority date	Jan 7, 2014
Publication date	Jan 31, 2017
Grant date	Jan 31, 2017

Abstract

A communication device is described along with various methods and systems for controlling the same. Methods are provided that monitor audio from a local and remote audio stream when determining whether to provide a mute notification on a muted call. In general, when a mute function of a communication device is active and a user attempts to speak, the system can analyze the user's local audio stream and the call's remote audio stream to determine whether characteristics exist to provide a mute notification to the user. The system provides mechanisms for controlling false positive determinations of speaking through mute by utilizing a combination of recorded characteristics and initiated timers that can be adjusted based on determinations made.

First claim

What is claimed is:

1. A method, comprising:
monitoring a local audio stream collected by an audio input device associated with a communication device in a multi-party call for local audio content, wherein the multi-party call includes a plurality of communication devices communicatively connected across a communication network;
monitoring a remote audio stream associated with the multi-party call for remote audio content, wherein the remote audio stream represents a combined signal of audio content received from each communication device participating in the multi-party call;
determining, by the communication device and based on the remote audio content, whether the local audio content is absent from the remote audio content; and
providing, by a notification service associated with the communication device, a mute notification to the communication device when the local audio content is determined to be absent from the remote audio content, wherein the mute notification causes the communication device to present at least one audible and visual alert to an output device of the communication device.

2. The method of claim 1 , wherein the audio input device is configured to detect local audio when a mute function of the communication device is active and wherein the at least one audible and visual alert is configured to notify a user that the mute function is active.

3. The method of claim 2 , wherein the audio input device is separate from an audio receiver input device of the communication device, wherein the audio receiver input device of the communication device is configured to receive the local audio content and provide the local audio content to the plurality of communication devices in the multi-party call when a mute function of the communication device is inactive and prevent the local audio content from being provided to the plurality of communication devices in the multi-party call when the mute function of the communication device is active.

4. The method of claim 1 , wherein prior to providing the mute notification to the communication device the method further comprises:
analyzing the remote audio content for at least one speech characteristic;
determining whether the at least one speech characteristic of the remote audio content matches a predetermined speech characteristic stored in a memory; and
wherein the mute notification is provided only when it is determined that the at least one speech characteristic of the remote audio content matches the predetermined speech characteristic stored in the memory.

5. The method of claim 1 , wherein prior to monitoring the local audio stream, the method further comprises:
receiving an input associated with an activation of a mute function of the communication device; and
initiating a timer having an expiration time, in response to receiving the input associated with the activation of a mute function.

6. The method of claim 5 , wherein prior to providing the mute notification to the communication device the method further comprises:
analyzing the local audio content for at least one speech characteristic; and
determining whether the at least one speech characteristic of the local audio content is provided to the audio input device prior to or after the expiration time of the timer.

7. The method of claim 6 , wherein the mute notification is provided only when it is determined that the at least one speech characteristic of the local audio content is provided after the expiration time of the timer.

8. The method of claim 7 , wherein the method further comprises:
detecting whether the mute function of the communication device is deactivated within a time period of providing the mute notification to the communication device; and
storing, in a memory and in response to detecting whether the mute function of the communication device is deactivated, information associated with the mute function deactivation.

9. The method of claim 8 , wherein the method further comprises:
adjusting the expiration time of the timer based at least partially on the stored information associated with the mute function deactivation, wherein at least one of the expiration time is increased when the stored information indicates that the mute function is not deactivated within the time period, and the expiration time is decreased when the stored information indicates that the mute function is deactivated within the time period.

10. The method of claim 6 , wherein prior to providing the mute notification to the communication device the method further comprises:
determining that the at least one speech characteristic of the local audio content is provided prior to the expiration time of the timer;
determining whether the at least one speech characteristic of the local audio content matches a private conversation characteristic stored in memory; and
wherein the mute notification is provided only when it is determined that at least one of the at least one speech characteristic of the local audio content fails to match the private conversation characteristic stored in the memory and a subsequent speech characteristic is provided after the expiration time of the timer.

11. A non-transitory computer readable medium having stored thereon instructions that, when executed by a processor, perform a method comprising:
monitoring a local audio stream collected by an audio input device associated with a communication device in a multi-party call for local audio content, wherein the multi-party call includes a plurality of communication devices communicatively connected across a communication network;
monitoring a remote audio stream associated with the multi-party call for remote audio content, wherein the remote audio stream represents a combined signal of audio content received from each communication device participating in the multi-party call;
determining, by the communication device and based on the remote audio content, whether the local audio content is absent from the remote audio content; and
providing, by a notification service associated with the communication device, a mute notification to the communication device when the local audio content is determined to be absent from the remote audio content, wherein the mute notification causes the communication device to present at least one audible and visual alert to an output device of the communication device.

12. The non-transitory computer readable medium of claim 11 , wherein prior to the mute notification to the communication device the method further comprises:
analyzing the remote audio content for at least one speech characteristic;
determining whether the at least one speech characteristic of the remote audio content matches a predetermined speech characteristic stored in a memory; and
wherein the mute notification is provided only when it is determined that the at least one speech characteristic of the remote audio content matches the predetermined speech characteristic stored in the memory.

13. The non-transitory computer readable medium of claim 11 , wherein prior to monitoring the local audio stream, the method further comprises:
receiving an input associated with an activation of a mute function of the communication device; and
initiating a timer having an expiration time, in response to receiving the input associated with the activation of a mute function.

14. The non-transitory computer readable medium of claim 13 , wherein prior to the mute notification to the communication device the method further comprises:
analyzing the local audio content for at least one speech characteristic; and
determining whether the at least one

Assignees

• Avaya Inc

Inventors

• Krack Michael
• Pugalia Jai
• Zumbiel Doug
• Wong Wayne
• Wong Jeffrey

Classifications

• H04M3/569 Primary

  using the instant speaker's algorithm (speech detection per se G10L25/78) · CPC title

• H04M3/4285

  Notifying, informing or entertaining a held party while on hold, e.g. Music On Hold · CPC title

• H04M2203/2027

  Live party detection · CPC title