Speech parsing with intelligent assistant

Patent metadata

Field	Value
Publication number	US-2018293221-A1
Application number	US-201816005470-A
Country	US
Kind code	A1
Filing date	Jun 11, 2018
Priority date	Feb 14, 2017
Publication date	Oct 11, 2018
Grant date	—

Abstract

A method to execute computer-actionable directives conveyed in human speech comprises: receiving audio data recording speech from one or more speakers; converting the audio data into a linguistic representation of the recorded speech; detecting a target corresponding to the linguistic representation; committing to the data structure language data associated with the detected target and based on the linguistic representation; parsing the data structure to identify one or more of the computer-actionable directives; and submitting the one or more of the computer-actionable directives to the computer for processing.

First claim

1 . A method to store speaker-resolved language data in a data structure in a computer system, the method comprising:
receiving audio data recording speech from one or more speakers; converting the audio data into a linguistic representation of the recorded speech; detecting a speaker corresponding to the linguistic representation; and committing to the data structure language data associated with the detected speaker and based on the linguistic representation.

2 . The method of claim 1 wherein the speaker is detected via a sensor-fusion machine-learning system previously trained to process the linguistic representation and another form of input concurrently.

3 . The method of claim 1 wherein the speaker is detected based on directional microphony.

4 . The method of claim 1 wherein the speaker is detected based on a voiceprint.

5 . The method of claim 1 wherein detecting the speaker includes storing the voiceprint of the speaker during a calibration phase and matching the stored voiceprint to a post-calibration voiceprint acquired from the audio data.

6 . The method of claim 1 wherein the speaker is detected based on face recognition.

7 . The method of claim 1 wherein the speaker is detected based on posture analysis.

8 . The method of claim 1 wherein the speaker is detected based on semantic analysis of the linguistic representation of the recorded speech.

9 . The method of claim 1 wherein converting the audio data includes filtering candidate linguistic representations of the recorded speech based on a corpus associated with the detected speaker.

10 . The method of claim 1 wherein the audio data is converted to a natural language linguistic representation via a previously-trained natural language machine.

11 . A method to store semantically resolved language data in a data structure in a computer system, the method comprising:
receiving audio data recording speech from one or more speakers; converting the audio data into a linguistic representation of the recorded speech; detecting a topic corresponding to the linguistic representation; and committing to the data structure language data associated with the detected topic and based on the linguistic representation.

12 . The method of claim 11 wherein converting the audio data includes filtering based on semantic comparison of the linguistic representation against the detected topic.

13 . The method of claim 11 wherein the topic is detected in a trained machine-learning module by semantic analysis of the linguistic representation.

14 . The method of claim 11 further comprising detecting a speech target corresponding to the linguistic representation.

15 . The method of claim 14 wherein the speech target is detected based on posture analysis.

16 . The method of claim 14 wherein the speech target is detected based on facial recognition.

17 . The method of claim 14 wherein the speech target includes the computer system.

18 . The method of claim 14 further comprising backfilling previously unresolved linguistic elements of the data structure based on the detected speech target.

19 . The method of claim 11 further comprising backfilling previously unresolved linguistic elements of the data structure based on the detected topic.

20 . A method to execute computer-actionable directives conveyed in human speech, the method comprising:
receiving audio data recording speech from one or more speakers; converting the audio data into a linguistic representation of the recorded speech; detecting a target corresponding to the linguistic representation; committing to the data structure language data associated with the detected target and based on the linguistic representation; parsing the data structure to identify one or more of the computer-actionable directives; and submitting the one or more of the computer-actionable directives to the computer for processing.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Finkelstein Erich-Soren
• Fung Han Yee Mimi
• Uzelac Aleksandar
• Solomon Oz
• Herold Keith Coleman
• Pradeep Vivek
• Liu Zongyi
• Koishida Kazuhito
• Albadawi Haithem
• Bathiche Steven Nabil
• Nuesmeyer Christopher Lance
• Holtmann Michelle Lynn
• Quirk Christopher Brian
• Sala Pablo Luis

Classifications

• G10L17/10

  Multimodal systems, i.e. based on the integration of multiple recognition engines or fusion of expert systems · CPC title

• G10L15/26 Primary

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• G06F40/205 Primary

  Parsing · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G06N20/00

  Machine learning · CPC title