Systems and methods for resolving overlapping speech in a communication session

Patent metadata

Field	Value
Publication number	US-11740856-B2
Application number	US-202117143879-A
Country	US
Kind code	B2
Filing date	Jan 7, 2021
Priority date	Jan 7, 2021
Publication date	Aug 29, 2023
Grant date	Aug 29, 2023

Abstract

Systems, methods, and non-transitory computer-readable media can be configured to determine first audio associated with a first user and second audio associated with a second user, the first user and the second user associated with a communication session. The second audio can be muted based on a determination that the first audio and the second audio overlap. The second audio can be provided based on completion of the first audio.

First claim

What is claimed is:

1. A computer-implemented method comprising:
determining, by a computing system, first audio associated with a first user and second audio associated with a second user, the first user and the second user associated with a communication session;
determining, by the computing system, a first number of times the first user was prioritized in the communication session and a second number of times the second user was prioritized in the communication session;
muting, by the computing system, the second audio based on a determination that the first audio and the second audio overlap and the first number of times the first user was prioritized is less than the second number of times the second user was prioritized;
providing, by the computing system, a first notification for the second user with a first option to provide a transcription of the second audio;
providing, by the computing system, the transcription of the second audio based on a selection of the first option by the second user.

2. The computer-implemented method of claim 1 , wherein the muting the second audio is further based on a first topic associated with the first audio and a second topic associated with the second audio.

3. The computer-implemented method of claim 2 , wherein the first topic is determined based on first speech included in the first audio, the second topic is determined based on second speech included in the second audio, and the first topic is determined to be more similar to a topic of a discussion associated with the communication session than the second topic.

4. The computer-implemented method of claim 1 , wherein the muting the second audio is further based on first user information associated with the first user and second user information associated with the second user.

5. The computer-implemented method of claim 1 , wherein the muting the second audio is further based on a first frequency with which the first user speaks in the communication session and a second frequency with which the second user speaks in the communication session, and wherein the second frequency is higher than the first frequency.

6. The computer-implemented method of claim 1 , wherein the muting the second audio is further based on a first time associated with the first audio and a second time associated with the second audio, and wherein the first time is earlier than the second time.

7. The computer-implemented method of claim 1 , wherein the transcription of the second audio is provided in a chat associated with the communication session.

8. The computer-implemented method of claim 1 , further comprising providing a second notification for users associated with the communication session that a recording of the second audio will be provided.

9. The computer-implemented method of claim 1 , further comprising providing the second audio in the communication session based on a selection of a second option by the second user.

10. The computer-implemented method of claim 1 , wherein the second audio is prioritized over audio of users associated with the communication session after the completion of the first audio.

11. A system comprising:
at least one processor; and
a memory storing instructions that, when executed by the at least one processor, cause the system to perform operations comprising:
determining first audio associated with a first user and second audio associated with a second user, the first user and the second user associated with a communication session;
determining a first number of times the first user was prioritized in the communication session and a second number of times the second user was prioritized in the communication session;
muting the second audio based on a determination that the first audio and the second audio overlap and the first number of times the first user was prioritized is less than the second number of times the second user was prioritized;
providing a first notification for the second user with a first option to provide a transcription of the second audio;
providing the transcription of the second audio based on a selection of the first option by the second user.

12. The system of claim 11 , wherein the muting the second audio is further based on a first topic associated with the first audio and a second topic associated with the second audio.

13. The system of claim 12 , wherein the first topic is determined based on first speech included in the first audio, the second topic is determined based on second speech included in the second audio, and the first topic is determined to more similar to a topic of a discussion associated with the communication session than the second topic.

14. The system of claim 11 , wherein the muting the second audio is further based on first user information associated with the first user and second user information associated with the second user.

15. The system of claim 11 , wherein the muting the second audio is further based on a first frequency with which the first user speaks in the communication session and a second frequency with which the second user speaks in the communication session, and wherein the second frequency is higher than the first frequency.

16. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform operations comprising:
determining first audio associated with a first user and second audio associated with a second user, the first user and the second user associated with a communication session;
determining a first number of times the first user was prioritized in the communication session and a second number of times the second user was prioritized in the communication session;
muting the second audio based on a determination that the first audio and the second audio overlap and the first number of times the first user was prioritized is less than the second number of times the second user was prioritized;
providing a first notification for the second user with a first option to provide a transcription of the second audio;
providing the transcription of the second audio based on a selection of the first option by the second user.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the muting the second audio is further based on a first topic associated with the first audio and a second topic associated with the second audio.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the first topic is determined based on first speech included in the first audio, the second topic is determined based on second speech included in the second audio, and the first topic is determined to be more similar to a topic of a discussion associated with the communication session than the second topic.

19. The non-transitory computer-readable storage medium of claim 16 , wherein the muting the second audio is further based on first user information associated with the first user and second user information associated with the second user.

20. The non-transitory computer-readable storage medium of claim 16 , wherein the muting the second audio is further based on a first frequency with which the first user speaks in the communication session and a second frequency with which the second user speaks in the communication session, and wherein the second frequency is higher than the first frequency.

Assignees

• Meta Platforms Inc

Inventors

• El Ghazzal Sammy

Classifications

• G06Q10/40

  Business processes related to social networking or social networking services · CPC title

• G06F3/165 Primary

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• G10L15/1815

  Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G10L25/90

  Pitch determination of speech signals · CPC title