Assisted language learning

Patent metadata

Field	Value
Publication number	US-10540451-B2
Application number	US-201615278538-A
Country	US
Kind code	B2
Filing date	Sep 28, 2016
Priority date	Sep 28, 2016
Publication date	Jan 21, 2020
Grant date	Jan 21, 2020

Abstract

An approach for predictive translation. The approach monitors one or more audio inputs, wherein monitoring the one or more audio inputs includes collecting a plurality of audio input data from one or more audio input devices. The approach determines one or more user triggers, wherein determining includes detecting the one or more user triggers from the one or more of audio input devices. Responsive to detecting the one or more user triggers, the approach determines whether the one or more audio inputs match one or more stored phrases. Responsive to a determination that the one or more audio inputs match at least one of the one or more stored phrases, the approach presents one or more cues to the user via the audio input device.

First claim

What is claimed is:

1. A method for predictive translation, the method comprising:
collecting a plurality of audio input data of speech by a user from one or more audio input devices connected to a mobile device of the user, some audio data of the plurality of audio input data being speech in a target language, the target language being learned by the user;
detecting one or more user triggers in the plurality of audio input data;
responsive to detecting the one or more user triggers, determining whether other audio data of the plurality of audio input data contain a phrase spoken in a known language of the user;
responsive to a determination that the other audio data contain the spoken phrase in the known language of the user, querying one or more translation servers, configured to provide language translations, for a translation of the spoken phrase in the known language into a translated phrase in the target language, by:
presenting the other audio data containing the spoken phrase in the known language to the one or more translation servers; and
identifying the target language to the one or more translation servers;

receiving the translated phrase in the target language, including a phrase portion, from the one or more translation servers;
presenting the phrase portion in the target language to the user via the mobile device;
monitoring a second plurality of audio input data of the user while reciting the spoken phrase in the target language including the phrase portion for a pause in speech;
responsive to detecting the pause in speech when reciting the spoken phrase in the target language presenting the translated phrase in the target language, including the phrase portion, to the user.

2. The method of claim 1 , further comprising
determining whether the others of the plurality of audio input data match at least one of one or more stored phrases;
responsive to a determination that the plurality of audio input data match at least one of the one or more stored phrases, presenting one or more cues to the user via the mobile device.

3. The method of claim 2 , wherein determining whether the others of the plurality of audio input data match at least one of the one or more stored phrases, further comprises:
responsive to a determination that the others of the plurality of audio input data include content and one or more contextual indicators that relate to the one or more stored phrases, determining, by the one or more computer processors, the others of the plurality of audio input data match the one or more stored phrases.

4. The method of claim 3 , wherein determining whether the others of the plurality of audio input data match at least one of the one or more stored phrases, further comprises:
responsive to a determination that the others of the plurality of audio input data include content and one or more contextual indicators that do not relate to the one or more stored phrases, determining, by the one or more computer processors, the others of the plurality of audio input data do not match the one or more stored phrases.

5. A computer program product for predictive translation, the computer program product comprising:
one or more computer readable storage devices and program instructions stored on the one or more computer readable storage devices, the stored program instructions comprising:
program instructions to collect a plurality of audio input data of speech by a user from one or more audio input devices connected to a mobile device of the user, some audio data of the plurality of audio input data being speech in a target language, the target language being learned by the user;
program instructions to detect one or more user triggers in the plurality of audio input data;
program instructions to, responsive to detecting the one or more user triggers, determine whether other audio data of the plurality of audio input data contain a phrase spoken in a known language of the user;
program instruction to, responsive to a determination that the other audio data contain the spoken phrase in the known language of the user, querying one or more translation servers, configured to provide language translations, for a translation of the spoken phrase in the known language into a translated phrase in the target language, by:
presenting the other audio data containing the spoken phrase in the known language to the one or more translation servers; and
identifying the target language to the one or more translation servers;

program instructions to receive the translated phrase in the target language, including a phrase portion, from the one or more translation servers;
program instructions to present the phrase portion in the target language to the user via the mobile device,
program instructions to monitor a second plurality of audio input data of the user while reciting the spoken phrase in the target language including the phrase portion for a pause in speech;
program instruction to, responsive to detecting the pause in speech when reciting the spoken phrase in the target language presenting the translated phrase in the target language, including the phrase portion, to the user.

6. The computer program product of claim 5 , further comprising:
program instruction to determine whether the others of the plurality of audio input data match at least one of one or more stored phrases;
program instructions to, responsive to a determination that the plurality of audio input data match at least one of the one or more stored phrases, present one or more cues to the user via the mobile device.

7. The computer program product of claim 6 , wherein determining whether the others of the plurality of audio input data match at least one of the one or more stored phrases, further comprises:
program instructions to, responsive to a determination that the others of the plurality of audio input data include content and one or more contextual indicators that relate to the one or more stored phrases, determine the others of the plurality of audio input data match the one or more stored phrases.

8. The computer program product of claim 7 , wherein determining whether the others of the plurality of audio input data match one or more stored phrases, further comprises:
program instruction to, responsive to a determination that the others of the plurality of audio input data include content and one or more contextual indicators that do not relate to the one or more stored phrases, determine the others of the plurality of audio input data do not match the one or more stored phrases.

9. A computer system for predictive translation, the computer system comprising:
one or more computer processors;
one or more computer readable storage devices;
program instructions stored on the one or more computer readable storage devices for execution by at least one of the one or more computer processors, the stored program instructions comprising:
program instructions to collect a plurality of audio input data of speech by a user from one or more audio input devices connected to a mobile device of the user, some audio data of the plurality of audio input data being speech in a target language, the target language being learned by the user;
program instructions to detect one or more user triggers in the plurality of audio input data;
program instruction to, responsive to detecting the one or more user triggers, determine whether other audio data of the plurality of audio input data contain a phrase spoken in a known language of the user;
program instruction to, responsive to a determination that the other audio data contain the spoken phrase in the known language of the user, querying one or more translation servers, configured to provide lan

Assignees

• IBM

Inventors

• Prendergast Orla M
• Ryan Michael J

Classifications

• G06F40/58 Primary

  Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation · CPC title

• G10L2015/228

  of application context · CPC title

• G10L15/005 Primary

  Language recognition · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G06F17/289 Primary

  Physics · mapped topic