Contextual language generation by leveraging language understanding

Patent metadata

Field	Value
Publication number	US-2018024994-A1
Application number	US-201715720174-A
Country	US
Kind code	A1
Filing date	Sep 29, 2017
Priority date	Jun 15, 2015
Publication date	Jan 25, 2018
Grant date	—

Abstract

Technology is provided for improving digital assistant performance by generating and presenting suggestions to users for completing a task or a session. To generate the suggestions, a machine learned language prediction model is trained with features extracted from multiple sources, such as log data and session context. When input is received from a user, the trained machine learned language prediction model is used to determine the most likely suggestion to present to the user to lead to successful task completion. In generating the suggestion, intermediate suggestion data, such as a domain, intent, and/or slot, is generated for the suggestion. From the generated intermediate suggestion data for the suggestion, a surface form of the suggestion is generated that can be presented to the user. The resulting suggestion and related context may further be used to continue training the machine learned language prediction model.

First claim

1 . A system comprising:
a machine-language-based classifier, wherein the machine-language-based classifier is configured to perform the following actions:
receive a first user input requesting a digital assistant to perform a requested task;
identify a first context for the user;
analyze the first user input to determine first intermediate task data corresponding to the requested first task;
provide the first context and the first intermediate task data as inputs to a machine learned language prediction model, wherein the machine learned language prediction model is based on log data, the log data comprising historical data representing previous interactions between one or more users and one or more digital assistant applications;
receive as output from the machine learned language prediction model, first intermediate suggestion data for generating a first suggestion for the user, wherein the first suggestion is for a second task to be requested based on the inputs to the machine learned language prediction model; and
an output module, wherein the output module is configured to present the first suggestion to the user.

2 . The system of claim 1 , wherein the first intermediate suggestion data includes at least one data type selected from the group consisting of a domain, an intent, and a slot for generating the first suggestion to the user.

3 . The system of claim 1 , further comprising a language generation suggestion module configured to generate a surface form of the first suggestion based on the first intermediate suggestion data.

4 . The system of claim 1 , further comprising a log data module configured to receive the first intermediate suggestion data, the first suggestion, and the first context to the log data.

5 . The system of claim 1 , further comprising:
a machine learned language prediction module, wherein the machine learned language prediction module is configured to perform the following actions:
receive updated log data; and
training the machine learned language prediction model with the updated log data to generate an updated machine learned language prediction model.

6 . The system of claim 5 , wherein the machine-language-based classifier is further configured to perform the following actions:
receive a second user input, wherein the second user input is the same as the first user input; receive a second context for the user; analyze the second user input to determine second intermediate task data corresponding to the requested task; provide the second context and the second intermediate task data as inputs to the updated machine learned language prediction model; receive as output from the updated machine learned language prediction model, second intermediate suggestion data for generating a second suggestion for the user, wherein the second suggestion is different from the first suggestion; and wherein the output module is further configured to present the second suggestion to the user.

7 . The system of claim 1 , wherein the machine-language-based classifier is further configured to perform the following actions:
receive a second user input, wherein the second user input is the same as the first user input; receive a second context for the user, wherein the second context is the different from the first context; analyze the second user input to determine second intermediate task data corresponding to the requested task; provide the second context and the second intermediate task data as inputs to the machine learned language prediction model; receive as output from the machine learned language prediction model, second intermediate suggestion data for generating a second suggestion for the user, wherein the second suggestion is different from the first suggestion; and wherein the output module is further configured to presenting the second suggestion to the user.

8 . The system of claim 2 , wherein the machine learned language prediction model includes a predictive model for domains, a predictive model for intents, and a predictive model of slots.

9 . A computer-implemented method comprising:
receiving a first user input requesting a digital assistant to perform a requested task; identifying a first context for the user; analyzing the first user input to determine first intermediate task data corresponding to the requested first task; providing the first context and the first intermediate task data as inputs to a machine learned language prediction model, wherein the machine learned language prediction model is trained from log data, the log data comprising historical data representing previous interactions between one or more users and one or more digital assistant applications; receiving as output from the machine learned language prediction model, first intermediate suggestion data for generating a first suggestion for the user, wherein the first suggestion is for a second task to be requested based on the inputs to the machine learned language prediction model; and presenting the first suggestion to the user.

10 . The method of claim 9 , wherein the first intermediate suggestion data includes at least one data type selected from the group consisting of: a domain, an intent, and a slot for generating the first suggestion to the user.

11 . The method of claim 9 , further comprising generating a surface form of the first suggestion based on the intermediate suggestion data.

12 . The method of claim 9 , further comprising:
receiving updated log data; training the machine learned language prediction model while offline with the updated log data to generate an updated machine learned language prediction model.

13 . The method of claim 9 , further comprising:
receiving updated log data; training the machine learned language prediction model at runtime with the updated log data to generate an updated machine learned language prediction model.

14 . The method of claim 13 , further comprising:
receiving a second user input, wherein the second user input is the same as the first user input; receiving a second context for the user; analyzing the second user input to determine second intermediate task data corresponding to the requested task; providing the second context and the second intermediate task data as inputs to the updated machine learned language prediction model; receiving as output from the updated machine learned language prediction model, second intermediate suggestion data for generating a second suggestion for the user, wherein the second suggestion is different from the first suggestion; and presenting the second suggestion to the user.

15 . The method of claim 9 , further comprising:
receiving a second user input, wherein the second user input is the same as the first user input; receiving a second context for the user, wherein the second context is the different from the first context; analyzing the second user input to determine second intermediate task data corresponding to the requested task; providing the second context and the second intermediate task data as inputs to the machine learned language prediction model; receiving as output from the machine learned language prediction model, second intermediate suggestion data for generating a second suggestion for the user, wherein the second suggestion is different from the first suggestion; and presenting the second suggestion to the user.

16 . The method of claim 9 , wherein the machine learned language prediction model includes a predictive model for domains, a predictive model for intents, and a predictive model of slots.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Sarikaya Ruhi

Classifications

• G06F16/3322 Primary

  using system suggestions (G06F16/3325 takes precedence) · CPC title

• G06F40/40 Primary

  Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30) · CPC title

• G06F40/253

  Grammatical analysis; Style critique · CPC title

• G06F17/274

  Physics · mapped topic

• G06F17/28 Primary

  Physics · mapped topic