System and method of performing automatic speech recognition using local private data

Patent metadata

Field	Value
Publication number	US-9666188-B2
Application number	US-201314066079-A
Country	US
Kind code	B2
Filing date	Oct 29, 2013
Priority date	Oct 29, 2013
Publication date	May 30, 2017
Grant date	May 30, 2017

Abstract

A method of providing hybrid speech recognition between a local embedded speech recognition system and a remote speech recognition system relates to receiving speech from a user at a device communicating with a remote speech recognition system. The system recognizes a first part of speech by performing a first recognition of the first part of the speech with the embedded speech recognition system that accesses private user data, wherein the private user data is not available to the remote speech recognition system. The system recognizes the second part of the speech by performing a second recognition of the second part of the speech with the remote speech recognition system. The final recognition result is a combination of these two recognition processes. The private data can be such local information as a user location, a playlist, frequently dialed numbers or texted people, user contact list information, and so forth.

First claim

I claim:

1. A method comprising:
receiving, on a device, text as part of a message, a placeholder within the text and audio, wherein the device comprises an embedded speech recognition system that accesses private user data on the device and wherein the private user data is not available to a remote speech recognition system in communication with the device;
receiving a component comprising one of a garbage model, phonemic language model, a language model according to a standard list, and a language model built on the private user data;
identifying a location of the device;
determining a privacy level of the private user data according to the location of the device;
recognizing the audio using the component, the embedded speech recognition system and by accessing the private user data according to the privacy level to yield a recognition result;
replacing the placeholder with the recognition result in the text to yield an updated message; and
presenting the updated message on the device.

2. The method of claim 1 , wherein individual names from a user contact list are from the private user data.

3. The method of claim 1 , wherein the private user data comprises one of data in a user contact list, frequently dialed phone numbers, frequently used texted names, data associated with a user location, data associated with a playlist, user history, and multiple hypothesis associated with private information.

4. A computer-readable storage device storing instructions which, when executed by a processor, cause the processor to perform operations comprising:
receiving, on a device, text as part of a message, a placeholder within the text and audio, wherein the device comprises an embedded speech recognition system that accesses private user data on the device and wherein the private user data is not available to a remote speech recognition system in communication with the device;
receiving a component comprising one of a garbage model, phonemic language model, a language model according to a standard list, and a language model built on the private user data;
identifying a location of the device;
determining a privacy level of the private user data according to the location of the device;
recognizing the audio using the component, the embedded speech recognition system and by accessing the private user data according to the privacy level to yield a recognition result;
replacing the placeholder with the recognition result in the text to yield an updated message; and
presenting the updated message on the device.

5. The computer-readable storage device of claim 4 , wherein individual names from a user contact list are from the private user data.

6. The computer-readable storage device of claim 4 , wherein the private user data comprises one of data in a user contact list, frequently dialed phone numbers, frequently used texted names, data associated with a user location, data associated with a playlist, user history, and multiple hypothesis associated with private information.

7. A system comprising:
a processor; and
computer-readable storage medium storing instructions which, when executed by the processor, cause the processor to perform operations comprising:
receiving, on a device, text as part of a message, a placeholder within the text and audio, wherein the device comprises an embedded speech recognition system that accesses private user data on the device and wherein the private user data is not available to a remote speech recognition system in communication with the device;
receiving a component comprising one of a garbage model, phonemic language model, a language model according to a standard list, and a language model built on the private user data;
identifying a location of the device;
determining a privacy level of the private user data according to the location of the device;
recognizing the audio using the component, the embedded speech recognition system and by accessing the private user data according to the privacy level to yield a recognition result;
replacing the placeholder with the recognition result in the text to yield an updated message; and
presenting the updated message on the device.

8. The system of claim 7 , wherein the private user data comprises one of data in a user contact list, frequently dialed phone numbers, frequently used texted names, data associated with a user location, user history, data associated with a playlist, and multiple hypothesis associated with private information.

Assignees

• Nuance Communications Inc

Inventors

• Thomson David
• Johnston Michael J
• Rangarajan Sridhar Vivek Kumar

Classifications

• G10L15/30 Primary

  Distributed recognition, e.g. in client-server systems, for mobile phones or network applications · CPC title

• G10L2015/228

  of application context · CPC title

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title