Method and system for voice recognition employing multiple voice-recognition techniques

Patent metadata

Field	Value
Publication number	US-9570076-B2
Application number	US-201313774398-A
Country	US
Kind code	B2
Filing date	Feb 22, 2013
Priority date	Oct 30, 2012
Publication date	Feb 14, 2017
Grant date	Feb 14, 2017

Abstract

A method and system for voice recognition are disclosed. In one example embodiment, the method includes receiving voice input information by way of a receiver on a mobile device and performing, by way of at least one processing device on the mobile device, first and second processing operations respectively with respect to first and second voice input portions, respectively, which respectively correspond to and are based at least indirectly upon different respective portions of the voice input information. The first processing operation includes a speech-to-text operation and the second processing operation includes an alternate processing operation. Additionally, the method includes generating recognized voice information based at least indirectly upon results from the first and second processing operations, and performing at least one action based at least in part upon the recognized voice information, where the at least one action includes outputting at least one signal by an output device.

First claim

The invention claimed is:

1. A computer-implemented method comprising:
receiving audio data that encodes an utterance;
obtaining, as a result of performing speech-to-text voice recognition on the audio data, a first transcription of the utterance;
segmenting the first transcription into two or more discrete terms;
determining that a first particular term from among the two or more discrete terms is included among a predefined set of terms that are associated with a word spotting process that involves determining whether an acoustic fingerprint of a given portion of audio data is an acoustic match with one or more given terms without performing speech-to-text voice recognition;
determining that the two or more discrete terms other than the first particular term are included among an additional predefined set of terms that are associated with the predefined set of terms that are associated with a word spotting process;
in response to determining that the two or more discrete terms other than the first particular term are included among the additional predefined set of terms that are associated with the predefined set of terms that are associated with the word spotting process, obtaining, as a result of performing the word spotting process on a portion of the audio data that corresponds to a second particular term from among the two or more discrete terms other than the first particular term without re-performing speech-to-text voice recognition on the portion of the audio data, an indication that an acoustic fingerprint associated with the portion of the audio data that corresponds to the second particular term is an acoustic match with one or more terms of the predefined set of terms that are associated with the word spotting process;
obtaining, as a result of re-performing speech-to-text voice recognition on a portion of the audio data that does not correspond to the second particular term, a second transcription of the utterance using the portion of the audio data that does not correspond to the second particular term;
generating a third transcription of the utterance based at least on (i) the second transcription of the utterance that was obtained as a result of re-performing speech-to-text voice recognition on the portion of the audio data that does not correspond to the second particular term, and (ii) the one or more terms of the predefined set of terms that are indicated, as a result of performing the word spotting process on the portion of the audio data that corresponds to the second particular term without re-performing speech-to-text voice recognition of the audio data, as an acoustic match with the portion of the audio data that corresponds to the second particular term; and
providing the third transcription of the utterance for output.

2. The method of claim 1 , wherein segmenting the first transcription into two or more discrete terms is based on a grammar structure of the first transcription.

3. The method of claim 1 , wherein the predefined set of terms that are associated with the word spotting process includes terms entered by a user.

4. The method of claim 1 , wherein the first transcription and the second transcription are obtained using different speech-to-text algorithms.

5. The method of claim 1 , wherein providing the third transcription of the utterance for output comprises:
providing the third transcription of the utterance to an application.

6. The method of claim 1 , wherein generating the third transcription comprises:
concatenating (i) the second transcription of the utterance that was obtained as a result of re-performing speech-to-text voice recognition on the portion of the audio data that does not correspond to the second particular term, and (ii) the one or more terms of the predefined set of terms that are indicated, as a result of performing the word spotting process on the portion of the audio data that corresponds to the second particular term without re-performing speech-to-text voice recognition of the audio data, as an acoustic match with the portion of the audio data that corresponds to the second particular term.

7. The method of claim 1 , comprising:
performing the word spotting process on a portion of the audio data that corresponds to the second particular term.

8. A system comprising:
one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
receiving audio data that encodes an utterance;
obtaining, as a result of performing speech-to-text voice recognition on the audio data, a first transcription of the utterance;
segmenting the first transcription into two or more discrete terms;
determining that a first particular term from among the two or more discrete terms is included among a predefined set of terms that are associated with a word spotting process that involves determining whether an acoustic fingerprint of a given portion of audio data is an acoustic match with one or more given terms without performing speech-to-text voice recognition;
determining that the two or more discrete terms other than the first particular term are included among an additional predefined set of terms that are associated with the predefined set of terms that are associated with a word spotting process;
in response to determining that the two or more discrete terms other than the first particular term are included among the additional predefined set of terms that are associated with the predefined set of terms that are associated with the word spotting process, obtaining, as a result of performing the word spotting process on a portion of the audio data that corresponds to a second particular term from among the two or more discrete terms other than the first particular term without re-performing speech-to-text voice recognition on the portion of the audio data, an indication that an acoustic fingerprint associated with the portion of the audio data that corresponds to the second particular term is an acoustic match with one or more terms of the predefined set of terms that are associated with the word spotting process;
obtaining, as a result of re-performing speech-to-text voice recognition on a portion of the audio data that does not correspond to the second particular term, a second transcription of the utterance using the portion of the audio data that does not correspond to the second particular term;
generating a third transcription of the utterance based at least on (i) the second transcription of the utterance that was obtained as a result of re-performing speech-to-text voice recognition on the portion of the audio data that does not correspond to the second particular term, and (ii) the one or more terms of the predefined set of terms that are indicated, as a result of performing the word spotting process on the portion of the audio data that corresponds to the second particular term without re-performing speech-to-text voice recognition of the audio data, as an acoustic match with the portion of the audio data that corresponds to the second particular term; and
providing the third transcription of the utterance for output.

9. The system of claim 8 , wherein segmenting the first transcription into two or more discrete terms is based on a grammar structure of the first transcription.

10. The system of claim 8 , wherein the predefined set of terms that are associated with the word spotting process includes terms entered by a user.

11. The system of claim 8 , wherein the first transcription and the second transcription are obtained using different speech-to-text algorithms.

12. Th

Assignees

• Google Technology Holdings LLC

Inventors

• Sierawski Jeffrey A
• Bekkerman Boris
• Labowicz Michael P
• Ondo Kazuhiro

Classifications

• H04M2250/74

  with voice recognition means · CPC title

• G10L15/18

  using natural language modelling · CPC title

• H04M1/72552

  Electricity · mapped topic

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G10L15/32

  Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems · CPC title