Identification of voice inputs providing credentials

Patent metadata

Field	Value
Publication number	US-10446143-B2
Application number	US-201615268360-A
Country	US
Kind code	B2
Filing date	Sep 16, 2016
Priority date	Mar 14, 2016
Publication date	Oct 15, 2019
Grant date	Oct 15, 2019

Abstract

Systems and processes for identifying of a voice input providing one or more user credentials are provided. In one example process, a voice input can be received. A first character, a phrase identifying a second character, and a word can be identified based on the voice input. In response to the identification, the first character, the second character, and the word can be converted to text. The text can be caused to display, with a display, in a sequence corresponding to an order of the first character, the second character, and the word in the voice input.

First claim

What is claimed is:

1. An electronic device, comprising:
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
receiving a voice input including a combination of one or more characters, one or more phrases, and one or more words;
identifying, based on the voice input, a first character, a phrase identifying a second character, and a word,
wherein the phrase identifying the second character comprises two or more words, and
wherein the identifying of the first character, the phrase, or the word includes:
identifying an utterance of the voice input;
determining a type of the utterance; and
obtaining, based on the determined type of the utterance, a representation of the first character, the second character identified by the phrase, or the word corresponding to the utterance; and

in response to the identification, converting the first character, the second character, and the word to text.

2. The electronic device of claim 1 , wherein the first character includes at least one of a letter, a numerical digit, a control character, or a space.

3. The electronic device of claim 2 , wherein the control character comprises a punctuation mark identified by a punctuation word.

4. The electronic device of claim 1 , wherein the phrase comprises a spelling word for assisting the identification of the second character.

5. The electronic device of claim 1 , wherein the word comprises a plurality of characters.

6. The electronic device of claim 5 , wherein the plurality of characters represent at least one of a domain extension or an acronym.

7. The electronic device of claim 1 , wherein identifying, based on the voice input, the first character, the phrase identifying the second character, and the word comprises:
identifying at least one of the first character, the phrase identifying the second character, or the word based on one or more speech recognition models stored in the electronic device.

8. The electronic device of claim 1 , wherein identifying, based on the voice input, the first character, the phrase identifying the second character, and the word comprises:
providing data representing the voice input to a server; and
receiving, from the server, data representing at least one of the first character, the phrase identifying the second character, or the word,
wherein identifying, based on the voice input, the first character, the phrase identifying the second character, and the word comprises
identifying at least one of the first character, the phrase identifying the second character, or the word based on one or more language models stored in the server.

9. The electronic device of claim 1 , wherein determining the type of the utterance comprises performing at least one of:
determining whether the type of the utterance corresponds to a character;
determining whether the type of the utterance corresponds to a phrase identifying a character; and
determining whether the type of the utterance corresponds to a word.

10. The electronic device of claim 9 , wherein determining whether the type of utterance corresponds to a character comprises:
determining, for the utterance, whether the utterance corresponds to a control character;
in accordance with a determination that the utterance corresponds to a control character, determining, for the utterance, whether the utterance corresponds to a punctuation word; and
wherein obtaining, based on the determined type of the utterance, the representation of the character comprises:
in accordance with a determination that the utterance corresponds to a punctuation word, obtaining a representation of a punctuation mark corresponding to the punctuation word,
in accordance with a determination that the utterance does not corresponds to a punctuation word, obtaining a representation of the control character other than a punctuation word.

11. The electronic device of claim 1 , wherein identifying, based on the voice input, the first character, the phrase identifying the second character, and the word further comprises:
obtaining a confidence level for the representation;
determining whether the confidence level is greater than or equal to a threshold; and

wherein converting the first character, the second character, and the word to text comprises:
in accordance with a determination that the confidence level is greater than or equal to the threshold, converting the representation of the first character, the second character identified by the phrase, or the word corresponding to the utterance to text;
in accordance with a determination that the confidence level is less than the threshold, providing one or more candidate representations, an error message or a combination thereof.

12. The electronic device of claim 1 , wherein the one or more programs further include instructions for:
identifying at least one command based on the voice input, wherein the at least one command enables editing of the displayed text.

13. The electronic device of claim 12 , wherein identifying the at least one command comprises:
identifying at least one utterance;
determining whether a type of the utterance corresponds to a command; and
in accordance with a determination that the type of the utterance corresponds to a command, causing to initiate an action corresponding to the command for editing the displayed text.

14. The electronic device of claim 13 , wherein the one or more programs further include instructions for:
storing the utterance corresponding to the at least one command and storing information associated with the utterance corresponding to the at least one command.

15. The electronic device of claim 1 , wherein identifying, based on the voice input, the first character, the phrase identifying the second character, and the word is based on at least one of contextual data associated with a user or one or more recognized credential models.

16. The electronic device of claim 15 , wherein the contextual data associated with the user comprises a user speech profile.

17. The electronic device of claim 15 , wherein the one or more recognized credential models represent one or more recognized credential formats.

18. The electronic device of claim 1 , wherein identifying, based on the voice input, the first character, the phrase identifying the second character, and the word is based on gaze detection.

19. The electronic device of claim 1 , wherein the voice input corresponds to at least one of a first user credential representing a user name or a second user credential representing a password.

20. The electronic device of claim 1 , wherein the one or more programs further include instructions for:
storing one or more utterances of the voice input, the one or more utterances corresponding to the first characters, the phrase identifying the second character, and the word recognized based on the identification.

21. The electronic device of claim 1 , wherein identifying the utterance of the voice input comprises:
extracting one or more acoustic features from the voice input; and
identifying, based on the one or more acoustic features, a beginning and an end of the utterance of the voice input.

22. The electronic device of claim 21 , wherein identifying, based on the one or more acoustic features, the beginning and the end of the utterance of t

Assignees

• Apple Inc

Inventors

• Akbacak Murat
• Hansen Bryan
• Evermann Gunnar

Classifications

• G10L15/26 Primary

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G06F40/279

  Recognition of textual entities · CPC title

• G06F40/166

  Editing, e.g. inserting or deleting · CPC title

• G06F21/00

  Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity · CPC title