Dynamic multilingual speech recognition

Patent metadata

Field	Value
Publication number	US-11526681-B2
Application number	US-201916729875-A
Country	US
Kind code	B2
Filing date	Dec 30, 2019
Priority date	Sep 28, 2018
Publication date	Dec 13, 2022
Grant date	Dec 13, 2022

Abstract

A method, computer program product, and a system where a processor(s), monitors multilingual switches performed on a client on behalf of a given user. Based on the monitoring, the processor(s) identifies switch patterns of the given user to generate a service profile for the user of machine learned multilingual switch patterns for the given user. The processor(s) determines a priority order for languages comprising the voice input streams, for the given user. The processor(s) obtains a new translation request initiated by the client, on behalf of the given user and applies the priority order to identify one or more languages spoken in a voice input stream of the new translation request. The processor(s) transmits indicators of the identified one or more languages to the client, where upon receiving the indicators, the client translates the voice input stream from the identified one or more languages to one or more target languages.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
monitoring, by one or more processors, multilingual switches performed on one or more clients on behalf of a given user, wherein service requests initiated by the one or more clients on behalf of the given user comprise a portion of the multilingual switches, wherein a portion of the service requests each comprise a voice input stream;
based on the monitoring, identifying, by the one or more processors, based on the multilingual switches performed on the one or more clients, switch patterns of the given user;
generating, by the one or more processors, a service profile for the user, wherein the service profile comprises machine learned multilingual switch patterns for the given user;
determining, by the one or more processors, based on the machine learned multilingual switch patterns for the given user, a priority order for languages comprising the voice input streams, for the given user;
obtaining, by the one or more processors, a new service request comprising a voice input stream, initiated by a given client of the one or more clients, on behalf of the given user;
applying, by the one or more processors, the priority order to identify one or more languages spoken in the voice input stream of the new service request; and
transmitting, by the one or more processors, indicators of the identified one or more languages to the given client, wherein upon receiving the indicators, the given client translates the voice input stream from the identified one or more languages to one or more target languages.

2. The computer-implemented method of claim 1 , wherein the portion of the service requests further comprise contextual data related to the voice input stream.

3. The computer-implemented method of claim 1 , wherein the given user is selected from the group consisting of: an individual user and a group of users.

4. The computer-implemented method of claim 1 , wherein identifying switch patterns of the given user to generate the service profile for the user further comprises:
identifying, by the one or more processors, for the monitored service requests, dependencies between factors in the contexts of the service requests and input languages of the voice input streams of the portion of the service requests; and
generating, by the one or more processors, a set of rules representing the identified dependencies, wherein the machine learned multilingual switch patterns comprise the set of rules.

5. The computer-implemented method of claim 1 , wherein the monitoring further comprises:
generating, by the one or more processors, based on an initial service request from a client of the one or more client of the service requests from the client, a data structure; and
applying, by the one or more processors, the data structure to subsequent service requests from the one or more clients of the service requests from the one or more clients, wherein applying the data structure tracks multilingual switching operations for the service requests from the one or more clients.

6. The computer-implemented method of claim 1 , wherein the given client translates the voice input stream comprising the new request in real-time.

7. The computer-implemented method of claim 1 , wherein the multilingual switches further comprise activities performed by the given user by utilizing applications executing on the one or more clients.

8. The computer-implemented method of claim 7 , wherein the activities are selected from the group consisting of: usage of the given user of a web browser, usage of the given user of a word processing programs, and usage of the given user of an accounting program.

9. The computer-implemented method of claim 1 , wherein generating the service profile for the user, further comprises:
determining, by the one or more processors, a location of the user.

10. The computer-implemented method of claim 9 , wherein the location determining the priority order for the languages comprising the voice input streams is further based on the location of the user.

11. The computer-implemented method of claim 1 , wherein the obtaining the new service request initiated by the given client further comprises:
identifying, by the one or more processors, the given user as an initiator of the new service request.

12. A computer program product comprising:
a computer readable storage medium readable by one or more processors and storing instructions for execution by the one or more processors for performing a method comprising:
monitoring, by the one or more processors, multilingual switches performed on one or more clients on behalf of a given user, wherein service requests initiated by the one or more clients on behalf of the given user comprise a portion of the multilingual switches, wherein a portion of the service requests each comprise a voice input stream;
based on the monitoring, identifying, by the one or more processors, based on the multilingual switches performed on the one or more clients, switch patterns of the given user;
generating, by the one or more processors, a service profile for the user, wherein the service profile comprises machine learned multilingual switch patterns for the given user;
determining, by the one or more processors, based on the machine learned multilingual switch patterns for the given user, a priority order for languages comprising the voice input streams, for the given user;
obtaining, by the one or more processors, a new service request comprising a voice input stream, initiated by a given client of the one or more clients, on behalf of the given user;
applying, by the one or more processors, the priority order to identify one or more languages spoken in the voice input stream of the new service request; and
transmitting, by the one or more processors, indicators of the identified one or more languages to the given client, wherein upon receiving the indicators, the given client translates the voice input stream from the identified one or more languages to one or more target languages.

13. The computer program product of claim 12 , wherein the given user is selected from the group consisting of: an individual user and a group of users.

14. The computer program product of claim 12 , wherein identifying switch patterns of the given user to generate the service profile for the user further comprises:
identifying, by the one or more processors, for the monitored service requests, dependencies between factors in the contexts of the service requests and input languages of the voice input streams of the portion of the service requests; and
generating, by the one or more processors, a set of rules representing the identified dependencies, wherein the machine learned multilingual switch patterns comprise the set of rules.

15. The computer program product of claim 12 , wherein the monitoring further comprises:
generating, by the one or more processors, based on an initial service request from a client of the one or more clients of the service requests from the client, a data structure; and
applying, by the one or more processors, the data structure to subsequent service requests from the one or more clients of the service requests from the client, wherein applying the data structure tracks multilingual switching operations for the service requests from the one or more clients.

16. The computer program product of claim 12 , wherein the given client translates the voice input stream comprising the new request in real-time.

17. The computer program product of claim 12 , wherein the multiling

Assignees

• IBM

Inventors

• Liu Su
• Hwang Inseok
• Rozner Eric
• Yoo Chungkuk

Classifications

• G06N5/01

  Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound · CPC title

• G06N20/00

  Machine learning · CPC title

• G06F40/263

  Language identification · CPC title

• G10L2015/227

  of the speaker; Human-factor methodology · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title