Mapping input to form fields

Patent metadata

Field	Value
Publication number	US-2016300573-A1
Application number	US-201514681408-A
Country	US
Kind code	A1
Filing date	Apr 8, 2015
Priority date	Apr 8, 2015
Publication date	Oct 13, 2016
Grant date	—

Abstract

In some implementations, user input is received while a form that includes text entry fields is being accessed. In one aspect, a process may include mapping user input to fields of a form and populating the fields of the form with the appropriate information. This process may allow a user to fill out a form using speech input, by generating a transcription of input speech, determining a field that best corresponds to each portion of the speech, and populating each field with the appropriate information.

First claim

1 - 5 . (canceled)

6 . A computer-implemented method comprising:
obtaining a form on a user device, where the form includes one or more text entry fields, wherein each text entry field is associated with a respective target data type; receiving an input including one or more words; generating multiple n-grams from the one or more words; determining, based at least on the target data type associated with a particular text entry field of the one or more text entry fields included in the form, a mapping score that indicates a degree of confidence that the particular text entry field associated with the target data type is to be populated with a particular n-gram; selecting, from among the multiple n-grams generated from the one or more words, a particular n-gram for a particular text entry field based at least on the mapping score that indicates the degree of confidence that the particular text entry field associated with the target data type is to be populated with the particular n-gram; and populating the particular text entry field included in the form on the user device with the particular n-gram.

7 . The computer-implemented method of claim 6 , wherein determining, based at least on the target data type associated with a particular text entry field of the one or more text entry fields included in the form, a mapping score that indicates a degree of confidence that the particular text entry field associated with the target data type is to be populated with a particular n-gram comprises:
determining, based at least on the target data type associated with the particular text entry field, a mapping score that indicates a degree of confidence that (i) the particular text entry field and (ii) one or more of the text entry fields that are different from the particular text entry field, are to be populated with (I) the particular n-gram and (II) one or more of the multiple n-grams that are different from the particular n-gram, respectively.

8 . The computer-implemented method of claim 7 comprising:
selecting, from among the multiple n-grams generated from the one or more words, one of the n-grams that is different from the particular n-gram for one of the text entry fields that is different from the particular text entry field, based at least on the mapping score; and
populating the text entry field that is different from the particular text entry field with the n-gram that is different from the particular n-gram.

9 . The computer-implemented method of claim 6 comprising:
receiving user input that represents data provided by a user for populating the form; and
determining one or more transcription hypotheses for the user input, the one or more transcription hypotheses including one or more words, wherein receiving the input including one or more words comprises receiving the one or more transcription hypotheses.

10 . The computer-implemented method of claim 9 , wherein generating multiple n-grams from the one or more words comprises generating one or more n-grams from each of the one or more transcription hypotheses.

11 . The computer-implemented method of claim 10 , wherein receiving user input that represents data provided by a user for populating the form comprises receiving data that reflects an utterance of one or more words spoken by the user, and wherein determining one or more transcription hypotheses for the user input, the one or more transcription hypotheses including one or more words comprises determining one or more transcription hypotheses for the one or more words spoken by the user.

12 . The computer-implemented method of claim 11 comprising:
determining one or more confidence scores for each of one or more of the transcription hypotheses that each indicate a degree of confidence in one or more words of the respective transcription hypothesis correctly representing one or more of the words spoken by the user, and wherein selecting, from among the multiple n-grams generated from the one or more words, the particular n-gram for the particular text entry field based at least on the mapping score that indicates the degree of confidence that the particular text entry field associated with the target data type is to be populated with the particular n-gram, comprises selecting, from among the multiple n-grams generated from the one or more words, the particular n-gram for the particular text entry field based at least on the mapping score that indicates the degree of confidence that the particular text entry field associated with the target data type is to be populated with the particular n-gram and one or more confidence scores associated with a particular transcription hypothesis from which the particular n-gram was generated.

13 . The computer-implemented method of claim 6 comprising:
determining the respective target data types associated with text entry fields of the form; and
accessing, based on the respective target data types associated with text entry fields of the form, one or more target data type models that indicate one or more of grammatical and lexical characteristics associated with words of the respective target data types, and wherein selecting, from among the multiple n-grams generated from the one or more words, the particular n-gram for the particular text entry field based at least on the mapping score that indicates the degree of confidence that the particular text entry field associated with the target data type is to be populated with the particular n-gram, comprises selecting, from among the multiple n-grams generated from the one or more words, the particular n-gram for the particular text entry field based at least on (i) one or more of grammatical and lexical characteristics associated with words of the target data type associated with the particular text entry field, and (ii) one or more of grammatical and lexical characteristics associated with the particular n-gram.

14 . The computer-implemented method of claim 13 wherein determining the respective target data types associated with text entry fields of the form, comprises determining the respective target data types associated with text entry fields of the form based at least on one or more labels included in the form that are associated with text entry fields of the form.

15 . A system comprising:
one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
obtaining a form on a user device, where the form that includes one or more text entry fields, wherein each text entry field is associated with a respective target data type;
receiving an input including one or more words;
generating multiple n-grams from the one or more words;
determining, based at least on the target data type associated with a particular text entry field of the one or more text entry fields included in the form, a mapping score that indicates a degree of confidence that the particular text entry field associated with the target data type is to be populated with a particular n-gram;
selecting, from among the multiple n-grams generated from the one or more words, a particular n-gram for a particular text entry field based at least on the mapping score that indicates the degree of confidence that the particular text entry field associated with the target data type is to be populated with the particular n-gram; and
populating the particular text entry field included in the form on the user device with the particular n-gram.

16 . The system of claim 15 , wherein determining, based at least on the target data type associated with a particular text entr

Assignees

• Google Inc

Inventors

• Carbune Victor
• Keysers Daniel M
• Deselaers Thomas

Classifications

• G10L17/22 Primary

  Interactive procedures; Man-machine interfaces · CPC title

• G10L15/26 Primary

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• G06F40/166

  Editing, e.g. inserting or deleting · CPC title

• G10L25/48

  specially adapted for particular use · CPC title

• G10L15/193

  Formal grammars, e.g. finite state automata, context free grammars or word networks · CPC title