Techniques for managing data in a cache memory of a question answering system

Patent metadata

Field	Value
Publication number	US-11176201-B2
Application number	US-201414508678-A
Country	US
Kind code	B2
Filing date	Oct 7, 2014
Priority date	Oct 7, 2014
Publication date	Nov 16, 2021
Grant date	Nov 16, 2021

Abstract

A technique for caching evidence for answering questions in a cache memory of a data processing system (that is configured to answer questions) includes receiving a first question. The first question is analyzed to identify a first set of characteristics of the first question. A first set of evidence for answering the first question is loaded into the cache memory. A second question is received. The second question is analyzed to identify a second set of characteristics of the second question. A portion of the first set of evidence, whose expected usage in answering the second question is below a determined threshold, is unloaded from the cache memory.

First claim

What is claimed is:

1. A computer program product for managing cache memory of a question answering system, the computer program product comprising:
a computer-readable storage device; and
computer-readable program code embodied on the computer-readable storage device, wherein the computer-readable program code, when executed by a question answering system that includes a processor and a memory coupled to the processor, causes the question answering system to:
receive a first question;
analyze the first question to identify a first set of characteristics of the first question;
load, based on a loading rate (LR) metric that defines an amount of data loaded per unit of time, a first set of evidence into the cache memory of the question answering system for answering the first question, wherein a value of the LR metric is a function of one or more of a question type, an evidence size, and a question key characteristic and how much of the cache memory is required by new evidence that is to be loaded;
receive a second question;
analyze the second question to identify a second set of characteristics of the second question;
compare the first set of characteristics to the second set of characteristics to determine an expected usage for the first set of evidence in answering the second question; and
unload, based on an unloading rate (UR) metric that defines an amount of data unloaded per unit of time, from the cache memory a portion of the first set of evidence based on the expected usage improves the ability of the question answering system in maintaining relevant evidence in the cache memory and thereby improves operation of the question answering system, wherein a value of the UR metric is lowered when current data loaded in the cache memory can be reused in answering a subsequent question and is increased when the current data loaded in the cache memory cannot be reused in answering the subsequent question and wherein the value of the LR metric is different than a value of the UR metric and is a function of one or more of the question type, the evidence size, and the question key characteristic.

2. The computer program product of claim 1 , wherein the unloading a portion of the first set of evidence is performed at a rate that is based on a relevance of the first set of characteristics to the second set of characteristics.

3. The computer program product of claim 2 , wherein the first set of characteristics and the second set of characteristics each include a question type, an evidence size, primary search attributes, and an evidence score that are respectively associated with the first and second questions.

4. The computer program product of claim 1 , wherein the computer-readable program code, when executed by the data processing system, is further configured to cause the question answering system to load additional evidence for a hypothesis related to one of the first and second questions into the cache memory when another question is not received.

5. The computer program product of claim 1 , wherein the cache memory is shared between processors of a node of a computing system that includes multiple nodes.

6. The computer program product of claim 1 , wherein the unloading a portion of the first set of evidence is performed at a rate that is based on a relevance of the first set of characteristics to sub sequent question characteristics.

7. A question answering system, comprising:
a cache memory; and
a processor coupled to the cache memory, wherein the processor is configured to:
receive a first question;
analyze the first question to identify a first set of characteristics of the first question;
load, based on a loading rate (LR) metric that defines an amount of data loaded per unit of time, a first set of evidence into the cache memory for answering the first question, wherein a value of the LR metric is a function of one or more of a question type, an evidence size, and a question key characteristic and how much of the cache memory is required by new evidence that is to be loaded;
receive a second question;
analyze the second question to identify a second set of characteristics of the second question;
compare the first set of characteristics to the second set of characteristics to determine the expected usage for the first set of evidence in answering the second question; and
unload, based on an unloading rate (UR) metric that defines an amount of data unloaded per unit of time, from the cache memory a portion of the first set of evidence based on the expected usage improves the ability of the question answering system in maintaining relevant evidence in the cache memory and thereby improves operation of the question answering system, wherein a value of the UR metric is lowered when current data loaded in the cache memory can be reused in answering a subsequent question and is increased when the current data loaded in the cache memory cannot be reused in answering the subsequent question and wherein the value of the LR metric is different than a value of the UR metric and is a function of one or more of the question type, the evidence size, and the question key characteristic.

8. The question answering system of claim 7 , wherein the unloading a portion of the first set of evidence is performed at a rate that is based on a relevance of the first set of characteristics to the second set of characteristics.

9. The question answering system of claim 8 , wherein the first set of characteristics and the second set of characteristics each include a question type, an evidence size, primary search attributes, and an evidence score that are respectively associated with the first and second questions.

10. The question answering system of claim 7 , wherein the processor is further configured to load additional evidence for a hypothesis related to one of the first and second questions into the cache memory when another question is not received.

11. The question answering system of claim 7 , wherein the cache memory is shared between processors of a node and the data processing system is a computing system that includes multiple nodes.

Assignees

• IBM

Inventors

• Allen Corville O
• Carter Bernadette A
• Ghosh Rahul
• Kozhaya Joseph N

Classifications

• G06F12/121 Primary

  using replacement algorithms · CPC title

• G06F16/172

  Caching, prefetching or hoarding of files · CPC title

• G06F16/3344

  using natural language analysis · CPC title

• G06F16/3329

  Natural language query formulation · CPC title

• G06F16/90324 Primary

  using system suggestions · CPC title