Changed Answer Notification in a Question and Answer System

Patent metadata

Field	Value
Publication number	US-2016034457-A1
Application number	US-201414446113-A
Country	US
Kind code	A1
Filing date	Jul 29, 2014
Priority date	Jul 29, 2014
Publication date	Feb 4, 2016
Grant date	—

Abstract

Mechanisms are provided, in a question and answer (QA) system, for monitoring changes in answers to previously submitted questions. A question is received for which an answer is to be generated. A first answer for the question is generated and the question, first answer, and a notification party are registered in a question registration data structure. A second answer to the question is generated, at a later time than when the first answer was generated. A degree of a change in the answer to the question is determined. An answer change notification is transmitted to the notification party based on the degree of the change in the answer to the question.

First claim

What is claimed is:

1 . A method, in a question and answer (QA) system comprising a processor and a memory, for monitoring changes in answers to previously submitted questions, the method comprising:
(a) receiving, by the QA system, a question for which an answer is to be generated by the QA system based on analysis of a corpus of information; (b) generating, by the QA system, a first answer to the question; (c) registering, by the QA system, the question, the first answer, and an identifier of a notification party, in a question registration data structure; (d) generating, by the QA system at a later time than operation (b), a second answer to the question; (e) determining, by the QA system, a degree of change between the first answer and the second answer; and (f) transmitting, by the QA system, an answer change notification to the notification party based on the degree of the change between the first answer and second answer to the question.

2 . The method of claim 1 , wherein operation (d) comprises at least one of processing the question with a different logic implemented in the QA system than is used when performing operation (b) or processing the question with a different corpus of information, upon which the QA system operates, from a corpus of information used when generating the first answer in operation (b).

3 . The method of claim 1 , wherein operation (d) comprises:
retrieving, from the question registration data structure, an entry corresponding to the question; and automatically re-submitting the question to the QA system based on the retrieved entry, wherein the question registration data structure stores entries for a plurality of different questions previously submitted to the QA system.

4 . The method of claim 3 , wherein each entry in the question registration data structure comprises the question, a last answer generated by the QA system for the question, and one or more notification parties that have requested to receive answer change notifications regarding the question associated with the entry.

5 . The method of claim 4 , wherein operation (f) further comprises:
determining a measure of relevance, of the change in the answer to the question, to each notification party in the one or more notification parties; identifying a subset of the notification parties, from the one or more notification parties identified in the entry corresponding to the question, with which the measure of relevance meets a predetermined criteria; and transmitting the answer change notification to the subset of notification parties but not transmitting the change notification to other notification parties in the one or more notification parties.

6 . The method of claim 5 , wherein determining the measure of relevance, identifying the subset of the notification parties, and transmitting the answer change notification to the subset of notification parties is performed in response to the degree of the change in the answer not meeting a predetermined threshold, and wherein, in response to the degree of the change in the answer meeting the predetermined threshold, the answer change notification is sent to all of the notification parties in the one or more notification parties.

7 . The method of claim 5 , wherein determining the measure of relevance comprises comparing features of the change in the answer to a user profile of the notification party.

8 . The method of claim 1 , further comprising:
(g) determining, by the QA system, a relevance of the change in the answer to the notification party, wherein transmitting the answer change notification is performed only in response to the measure of the degree of difference meeting a predetermined criteria and the relevance meeting a predetermined criteria for the notification party.

9 . The method of claim 1 , wherein operation (d) is initiated in response to a triggering event, and wherein the triggering event is one of a detection of a change in a corpus of information operated on by the QA system, a change in logic implemented by the QA system, or an authorized user manually requesting the second processing being performed.

10 . The method of claim 1 , wherein operation (c) comprises, for each entry in the question registration data structure:
determining a degree of similarity of the question to a previously submitted question corresponding to the entry; determining whether a similarity of the question to the previously submitted question meets a predetermined criteria; and registering the question in the question registration data structure by associating information regarding the question with the entry in response to the similarity of the question to the previously submitted question meeting the predetermined criteria.

11 . A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on a data processing system implementing a Question and Answer (QA) system, causes the QA system to:
(a) receive a question for which an answer is to be generated by the QA system based on analysis of a corpus of information; (b) generate a first answer to the question; (c) register the question, the first answer, and an identifier of a notification party, in a question registration data structure; (d) generate, at a later time than operation (b), a second answer to the question; (e) determine a degree of change between the first answer and the second answer; and (f) transmit an answer change notification to the notification party based on the degree of the change between the first answer and second answer to the question.

12 . The computer program product of claim 11 , wherein operation (d) comprises at least one of processing the question with a different logic implemented in the QA system than is used when performing operation (b) or processing the question with a different corpus of information, upon which the QA system operates, from a corpus of information used when generating the first answer in operation (b).

13 . The computer program product of claim 11 , wherein operation (d) comprises:
retrieving, from the question registration data structure, an entry corresponding to the question; and automatically re-submitting the question to the QA system based on the retrieved entry, wherein the question registration data structure stores entries for a plurality of different questions previously submitted to the QA system.

14 . The computer program product of claim 13 , wherein each entry in the question registration data structure comprises the question, a last answer generated by the QA system for the question, and one or more notification parties that have requested to receive answer change notifications regarding the question associated with the entry.

15 . The computer program product of claim 14 , wherein operation (f) further comprises:
determining a measure of relevance, of the change in the answer to the question, to each notification party in the one or more notification parties; identifying a subset of the notification parties, from the one or more notification parties identified in the entry corresponding to the question, with which the measure of relevance meets a predetermined criteria; and transmitting the answer change notification to the subset of notification parties but not transmitting the change notification to other notification parties in the one or more notification parties.

16 . The computer program product of claim 15 , wherein determining the measure of relevance, identifyi

Assignees

• IBM

Inventors

• Bradley Lisa M W
• Carlson Christina R
• Freed Andrew R
• Henderson Roderick C

Classifications

• G06F16/24522 Primary

  Translation of natural language queries to structured queries · CPC title

• G06F16/951

  Indexing; Web crawling techniques · CPC title

• G06F16/24578

  using ranking · CPC title

• G06F17/3043 Primary

  Physics · mapped topic

• G06F17/30864

  Physics · mapped topic