Method and device for voice recognition training

Patent metadata

Field	Value
Publication number	US-9691377-B2
Application number	US-201314142210-A
Country	US
Kind code	B2
Filing date	Dec 27, 2013
Priority date	Jul 23, 2013
Publication date	Jun 27, 2017
Grant date	Jun 27, 2017

Abstract

A method on a mobile device for voice recognition training is described. A voice training mode is entered. A voice training sample for a user of the mobile device is recorded. The voice training mode is interrupted to enter a noise indicator mode based on a sample background noise level for the voice training sample and a sample background noise type for the voice training sample. The voice training mode is returned to from the noise indicator mode when the user provides a continuation input that indicates a current background noise level meets an indicator threshold value.

First claim

We claim:

1. A computer-implemented method comprising:
receiving audio data while a mobile device is (i) in a voice training mode in which a speaker is prompted to provide one or more samples of the speaker's voice and (ii) displaying a voice training user interface;
determining a background noise level associated with the audio data;
determining that the background noise level associated with the audio data is greater than or equal to a predetermined threshold value;
in response to determining that the background noise level associated with the audio data is greater than or equal to the predetermined threshold, switching the mobile device from the voice training mode to a background noise indicator mode in which the mobile device (i) displays a background noise indicator user interface that is configured to display a background noise level associated with audio data that is received while the mobile device is in the background noise indicator mode and (ii) is configured to not process a sample of the speaker's voice; and
providing, for display by the mobile device, the background noise indicator user interface.

2. The method of claim 1 , comprising:
receiving additional audio data while the mobile device is in the background noise indicator mode;
determining a background noise level associated with the additional audio data; and
based on the background noise level associated with the additional audio data, updating the background noise indicator user interface.

3. The method of claim 2 , wherein updating the background noise indicator user interface comprises:
updating a needle of a dial type interface of the background noise indicator user interface, wherein the needle represents the background noise level associated with the additional audio data.

4. The method of claim 1 , comprising:
receiving additional audio data while the mobile device is in the background noise indicator mode;
determining a background noise level associated with the additional audio data;
determining that the background noise level associated with the additional audio data is less than the predetermined threshold value;
based on determining that the background noise level associated with the additional audio data is less than the predetermined threshold value, providing, for display in the background noise indicator user interface, a selectable indicator that is configured to switch the mobile device to the voice training mode upon selection by the speaker;
receiving data that indicates a selection of the selectable indicator; and
in response to receiving the data that indicates the selection of the selectable indicator, switching the mobile device from the background noise indicator mode to the voice training mode.

5. The method of claim 1 , wherein the background noise indicator user interface includes a noise indicator that represents the background noise level associated with the audio data that is received while the mobile device is in the background noise indicator mode and one or more indicator thresholds, one of which represents the predetermined threshold value.

6. The method of claim 1 , comprising:
receiving additional audio data while the mobile device is in the background noise indicator mode;
determining a background noise level associated with the additional audio data;
determining that the background noise level associated with the additional audio data is greater than or equal to the predetermined threshold value; and
based on determining that the background noise level associated with the additional audio data is greater than or equal to the predetermined threshold value, updating the background noise indicator user interface to indicate the background noise level in the additional audio data.

7. A system comprising:
one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
receiving audio data while a mobile device is (i) in a voice training mode in which a speaker is prompted to provide one or more samples of the speaker's voice and (ii) displaying a voice training user interface;
determining a background noise level associated with the audio data;
determining that the background noise level associated with the audio data is greater than or equal to a predetermined threshold value;
in response to determining that the background noise level associated with the audio data is greater than or equal to the predetermined threshold, switching the mobile device from the voice training mode to a background noise indicator mode in which the mobile device displays a background noise indicator user interface that is configured to display a background noise level associated with audio data that is received while the mobile device is in the background noise indicator mode and (ii) is configured to not process a sample of the speaker's voice; and
providing, for display by the mobile device, the background noise indicator user interface.

8. The system of claim 7 , wherein the operations further comprise:
receiving additional audio data while the mobile device is in the background noise indicator mode;
determining a background noise level associated with the additional audio data; and
based on the background noise level associated with the additional audio data, updating the background noise indicator user interface.

9. The system of claim 8 , wherein updating the background noise indicator user interface comprises:
updating a needle of a dial type interface of the background noise indicator user interface, wherein the needle represents the background noise level associated with the additional audio data.

10. The system of claim 7 , wherein the operations further comprise:
receiving additional audio data while the mobile device is in the background noise indicator mode;
determining a background noise level associated with the additional audio data;
determining that the background noise level associated with the additional audio data is less than the predetermined threshold value;
based on determining that the background noise level associated with the additional audio data is less than the predetermined threshold value, providing, for display in the background noise indicator user interface, a selectable indicator that is configured to switch the mobile device to the voice training mode upon selection by the speaker;
receiving data that indicates a selection of the selectable indicator; and
in response to receiving the data that indicates the selection of the selectable indicator, switching the mobile device from the background noise indicator mode to the voice training mode.

11. The system of claim 7 , wherein the background noise indicator user interface includes a noise indicator that represents the background noise level associated with the audio data that is received while the mobile device is in the background noise indicator mode and one or more indicator thresholds, one of which represents the predetermined threshold value.

12. The system of claim 7 , wherein the operations further comprise:
receiving additional audio data while the mobile device is in the background noise indicator mode;
determining a background noise level associated with the additional audio data;
determining that the background noise level associated with the additional audio data is greater than or equal to the predetermined threshold value; and
based on determining that the background noise level associated with the additional audio data is greater than or equal to the predetermined threshold value, updating the backgr

Assignees

• Google Technology Holdings LLC

Inventors

• Gunn Michael E
• Bekkerman Boris
• Jasiuk Mark A
• Kamdar Pratik M
• Sierawski Jeffrey A

Classifications

• G10L15/063 Primary

  Training · CPC title

• G10L15/20

  Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech (G10L21/02 takes precedence) · CPC title

• G10L2015/0638

  Interactive procedures · CPC title

• H04W88/02

  Terminal devices · CPC title

• G10L17/20

  Pattern transformations or operations aimed at increasing system robustness, e.g. against channel noise or different working conditions · CPC title