Machine reading method for dialog state tracking

Patent metadata

Field	Value
Publication number	US-10540967-B2
Application number	US-201615350269-A
Country	US
Kind code	B2
Filing date	Nov 14, 2016
Priority date	Nov 14, 2016
Publication date	Jan 21, 2020
Grant date	Jan 21, 2020

Abstract

A method for dialog state tracking uses a neural network model, such as an MemN2N model, which has been trained to receive a representation of a question and a representation of a subpart of a dialog and to output an answer to the question. For at least one iteration, a subpart of a dialog is received. A representation of the subpart of the dialog is generated. The representation of the subpart of the input dialog and representation of a question are input to the trained neural network model. An answer is output by the neural network model, based on the representation of the question and the representation of the subpart of the input dialog. A dialog state for the dialog is updated, based on the answer to the question. The dialog state includes a set of variables. The updating includes predicting a value for at least one of the variables.

First claim

What is claimed is:

1. A method for dialog state tracking during a dialog between a user and an agent, the method comprising:
a) providing a recurrent neural network model which has been trained to receive a representation of one of a set of questions and a representation of an input subpart of a dialog, and to output an answer to the question based on the representation of the subpart of the dialog, the training of the neural network including:
i) providing training dialogs, each training dialog being associated with at least one of the set of questions and a respective ground truth answer to the associated question, each of the questions being related to a respective one of a plurality of slots of a dialog state tracker,
ii) for each of the set of questions, generating a respective question representation,
iii) inputting a representation of one of the training dialogs into the neural network model,
iv) inputting the question representation of one of the questions associated with the respective training dialog into the neural network model,
v) receiving a predicted answer from the model, and
vi) updating parameters of the model to reduce an error between the predicted answer and the ground truth answer;

b) for at least one iteration of a dialog between a user and an agent:
i) receiving an input subpart of the dialog between the user and the agent;
ii) generating a representation of the subpart of the dialog;
iii) inputting the representation of the subpart of the input dialog to the trained neural network model;
iv) inputting one of the question representations of one of the set of questions to the trained neural network model; and
v) receiving an answer output by the neural network model based on the input question representation and the input representation of the subpart of the input dialog; and

c) for at least one of the at least one iteration of the dialog between the user and the agent:
i) with the dialog state tracker, updating a dialog state for the dialog based on the output answer to the question, the dialog state including a set of variables, the updating including predicting a value for at least one of the variables,
ii) generating a dialog act of the agent, based on the updated dialog state, and
iii) outputting the dialog act to the user in a human recognizable form;

wherein the representations of the questions and the representations of the dialog subparts are each multidimensional vectors, elements of each vector representing a respective word or multi-word expression in a predefined vocabulary, the predefined vocabulary having been generated by ranking words and multi-word expressions in the training dialogs and optionally also in the associated questions, and selecting top-ranking ones for the vocabulary;
wherein at least one of the generating a representation of the subpart of the dialog, inputting the representation of the subpart of the dialog to the trained neural network model, receiving an answer to the question output by the model, and updating a dialog state is performed with a processor.

2. The method of claim 1 , wherein the training the neural network model further comprises generating a modified set of training dialogs from the set of training dialogs and training the neural network model with at least one of:
questions where the answer is one of yes and no;
indefinite knowledge questions where the answer is unknown; and
questions for which the answer is a number or a list of values.

3. The method of claim 1 , wherein for at least some of the training dialogs, the training dialog includes a plurality of utterances, the plurality of utterances including an agent utterance and a user utterance and wherein the respective answer to the represented question is linked to the entire dialog and is not specifically linked to a specific one of the plurality of utterances.

4. The method of claim 1 , wherein the multidimensional vectors representing the question and the input dialog subpart each have a same number of dimensions.

5. The method of claim 1 , wherein the neural network model includes a question embedding matrix which embeds the question into an embedding space and at least one dialog embedding matrix which embeds the representation of the subpart of the dialog into the same embedding space.

6. The method of claim 5 , wherein the neural network model includes memories which store embeddings of a set of dialog representations, the set of dialog representations including the representation of the subpart of the dialog.

7. The method of claim 1 , wherein the neural network model comprises a plurality of hops, each subsequent hop receiving as input the output of a prior hop, the output including a question embedding and a response vector, the response vector being a weighted sum of an output set of memory vectors generated by embedding the dialog representations, wherein the output memory vectors are each weighted by a respective probability vector for the embedded question computed with respect to a respective one of an input set of memory vectors generated by embedding the dialog representations.

8. The method of claim 1 , wherein the neural network model comprises a plurality of neural network models, each of the neural network models corresponding to a respective one of the variables in the dialog state.

9. The method of claim 1 , wherein the neural network model is a memory-enhanced neural network.

10. The method of claim 1 , wherein the dialog includes user utterances and agent utterances.

11. The method of claim 1 , wherein the representation of the subpart of the input dialog comprises a representation of at least one of:
a user utterance in a natural language; and
an agent utterance in the natural language.

12. The method of claim 1 , further comprising executing a task based on the updated dialog state of at least one of the iterations.

13. The method of claim 1 , further comprising generating an agent dialog act based on the updated dialog state.

14. A computer program product comprising non-transitory memory storing instructions which, when executed by a computer, perform the method of claim 1 .

15. A system for dialog state tracking comprising:
memory which stores a neural network model which has been trained to receive a representation of one of a set of questions and a representation of an input subpart of a dialog and to output an answer to the question based on the representation of the subpart of the dialog,
the neural network model including input and output memories which store embeddings of dialog representations embedded with first and second embedding matrices, respectively, and a third embedding matrix which generates an embedding of the question of the same number of dimensions as the embeddings of the dialog representations;
a dialog representation generator which generates a representation of an input subpart of a dialog;
a prediction component which inputs the representation of the subpart of the dialog and a representation of one of the set of questions used in the training to the trained neural network model and receives an answer output by the neural network model based on the representation of the question and the representation of the subpart of the dialog;
an update component which updates a dialog state for the dialog, based on the answer to the question, the dialog state including a set of variables, the updating including predicting a value for at least one of the variables;
an output component which outputs a dialog act in the form of speech, text, or information for generation of the speech or text, based on the updated

Assignees

• Xerox Corp

Inventors

• Perez Julien

Classifications

• G10L15/16

  using artificial neural networks · CPC title

• G10L15/1815

  Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning · CPC title

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G06F40/35

  Discourse or dialogue representation · CPC title