Translational bot for group communication

Patent metadata

Field	Value
Publication number	US-11328130-B2
Application number	US-201816182474-A
Country	US
Kind code	B2
Filing date	Nov 6, 2018
Priority date	Nov 6, 2017
Publication date	May 10, 2022
Grant date	May 10, 2022

Abstract

The present disclosure is directed to systems, methods and devices for providing real-time translation for group communications. A speech input may be received from a first group communication device associated with a first language. One or more groups to distribute the speech input may be determined, wherein each of the one or more groups comprises at least one group communication device associated with a language that is different than the first language. The received speech input may be translated into a corresponding language for each of the one or more groups, and the translated speech may be sent to each group communication device of the one or more groups in a language corresponding to each of the one or more groups.

First claim

The invention claimed is:

1. A method comprising:
performing, at a remote management server configured for managing group communications between multiple communication devices, a process for providing real-time translation for group communications, including:
registering a first communication device with the remote management server, including associating the first communication device with:
a first language preference,
a primary group communication setting identifying a first set of communication devices, and
a secondary group communication setting identifying a second set of communication devices;

receiving, from the first communication device, a speech input and a first device identifier for the first communication device;
accessing an account log associated with the first communication device based on the first device identifier;
determining a plurality of communication devices to distribute the speech input to based on the primary group communications setting from the account log;
determining a preferred language associated with each of the plurality of group communication devices;
grouping each of the plurality of communication devices into one or more groups based on corresponding preferred languages, each group associated with a separate language;
for languages different from the first language preference, translating the speech input into a translated speech input corresponding to the preferred languages for each of the one or more groups prior to sending the speech input; and
sending the translated speech input to each communication device of the one or more groups.

2. The method of claim 1 , wherein the first communication device is associated with the first language preference based on a user-provided language setting.

3. The method of claim 2 , wherein:
the first device identifier includes an IP address associated with the first communication device; and
the remote management server determines the first language preference based on the IP address.

4. The method of claim 3 , wherein the remote management server comprises a list of a plurality of IP addresses, and wherein each of the plurality of IP addresses is associated with a unique communication device and a corresponding user-provided language setting.

5. The method of claim 1 , further comprising:
performing natural language processing on the speech input; and
detecting, based on the natural language processing, a language that the speech input corresponds to.

6. The method of claim 5 , further comprising:
receiving separate speech inputs from each of the plurality of communication devices;
performing natural language processing on the separate speech inputs from each of the plurality of communication devices; and
detecting, based on the natural language processing, a language corresponding to each of the separate speech inputs from each of the plurality of communication devices.

7. The method of claim 1 , further comprising:
parsing, by a voice messaging application, the speech input into one or more audio messaging packets; and
encoding the one or more audio messaging packets with an identification key for determining the one or more groups to distribute the speech input to.

8. The method of claim 7 , wherein the one or more audio messaging packets are Opus audio codec packets and wherein each Opus audio packet includes N audio data packet fragments.

9. The method of claim 7 , wherein the first communication device, and the plurality of communication devices associated with a language that is different than the first language preference, each comprise a push-to-talk audio transmission interface.

10. The method of claim 7 , wherein the sending of the translated speech input in a language corresponding to each of the one or more groups comprises sending the one or more audio messaging packets to a remote management platform for distribution to the one or more groups.

11. A system comprising:
a remote management server configured for managing group communications between a plurality of group communication devices, including:
a memory for storing program code; and
a processor, functionally coupled to the memory, configured to execute the program code to perform a process for providing real-time translation for group communications, including:
register a first communication device with the remote management server based on receiving:
a first language preference,
a primary group communication setting identifying a first set of communication devices, and
a secondary group communication setting identifying a second set of communication devices;

receive, from the first communication device, a speech input and a first device identifier for the first communication device;
determine at least one communication device to distribute the speech input to based on the first device identifier;
determine a preferred language associated with corresponding each of the at least one communication device;
identify one or more groups of communication devices from the at least one communication device based on corresponding preferred languages, each group associated with a separate language different from the first language preference;
for languages different from the first language preference, translate the speech input into a translated speech input corresponding to the preferred languages for each of the one or more groups prior to sending the speech input; and
send the translated speech input to each communication device of the one or more groups.

12. The system of claim 11 , wherein the first communication device is associated with the first language preference based on a user-provided language setting.

13. The system of claim 12 , wherein:
the first device identifier includes an IP address associated with the first communication device; and
the remote management platform determines the first language preference based on the IP address.

14. The system of claim 13 , wherein the remote management server comprises a list of a plurality of IP addresses, and wherein each of the plurality of IP addresses is associated with a unique communication device and a corresponding user-provided language setting.

15. The system of claim 14 , wherein the processor is further configured to:
receive separate speech inputs from each of the at least one communication device;
perform natural language processing on the separate speech inputs from each of the at least one communication device; and
detect, based on the natural language processing, a language corresponding to each of the separate speech inputs from each of the at least one communication device.

16. A memory device storing instructions that, when executed, cause a processor to perform a method comprising:
registering a first communication device with a remote management server configured for managing group communications between a plurality of communication devices, based on receiving:
a first language preference,
a primary group communication setting identifying a first set of communication devices, and
a secondary group communication setting identifying a second set of communication devices;

receiving, from the first communication device, a speech input and a first device identifier for the first communication device;
determining, at the remote management server, at least one communication device to distribute the speech input to based on the first device identifier;
determining, at the remote management server, a preferred language associated with corresponding each of the at least one communication device;
for languages different

Assignees

• Orion Labs
• Orion Labs Inc

Inventors

• Black Justin
• Albrecht Gregory
• Phung Dan

Classifications

• G10L13/086

  Detection of language · CPC title

• G06F40/58 Primary

  Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation · CPC title

• H04L65/403

  Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15) · CPC title