Domain-specific method for distinguishing type-denoting domain terms from entity-denoting domain terms

Patent metadata

Field	Value
Publication number	US-10073831-B1
Application number	US-201715454778-A
Country	US
Kind code	B1
Filing date	Mar 9, 2017
Priority date	Mar 9, 2017
Publication date	Sep 11, 2018
Grant date	Sep 11, 2018

Abstract

Large lists of domain-specific terms are classified as a particular kind of linguistic object, e.g., lexical answer type T versus canonical answer E, based on features from a domain-specific corpus which have been found to distinguish between the linguistic objects. The distinguishing features can be identified in the corpus based on sets of the linguistic objects derived from question-and-answer pairs. A classifier can be trained using the distinguishing features, and the classification carried out using that classifier. The distinguishing features can include one or more syntactic features or one or more lexical features. The linguistic objects (the T and E training sets) can be extracted from the question-and-answer pairs automatically via text analysis if manually curated lists are not available. The classified terms can be included in a domain-specific lexicon which facilitates a deep question answering system to yield an answer to a question.

First claim

What is claimed is:

1. A computer system comprising:
one or more processors which process program instructions;
a memory device connected to said one or more processors; and
program instructions residing in said memory device for distinguishing domain-specific terms from a list specific to a particular domain by extracting linguistic objects from a set of question-and-answer pairs wherein the linguistic objects include lexical answer types and answer entities, grouping the lexical answer types into a first set and grouping the answer entities into a second set, identifying distinguishing features of one or more corpora specific to a particular domain wherein the distinguishing features distinguish the lexical answer types in the first set from the answer entities in the second set, and classifying the domain-specific terms as either lexical answer type or answer entity based on the distinguishing features,
wherein said program instructions further train a natural language classifier using the distinguishing features, and the classifying uses the natural language classifier.

2. The computer system of claim 1 wherein the distinguishing features include one or more syntactic features.

3. The computer system of claim 1 wherein the distinguishing features include one or more lexical features.

4. The computer system of claim 1 wherein the extracting uses text analysis to automatically extract the linguistic objects.

5. The computer system of claim 1 wherein said program instructions further apply a lexicon of classified terms to a deep question answering system to yield an answer to a question.

6. A computer program product comprising:
a computer readable storage medium; and
program instructions residing in said storage medium for distinguishing domain-specific terms from a list specific to a particular domain by extracting linguistic objects from a set of question-and-answer pairs wherein the linguistic objects include lexical answer types and answer entities, grouping the lexical answer types into a first set and grouping the answer entities into a second set, identifying distinguishing features of one or more corpora specific to a particular domain wherein the distinguishing features distinguish the lexical answer types in the first set from the answer entities in the second set, and classifying the domain-specific terms as either lexical answer type or answer entity based on the distinguishing features,
wherein said program instructions further train a natural language classifier using the distinguishing features, and the classifying uses the natural language classifier.

7. The computer program product of claim 6 wherein the distinguishing features include one or more syntactic features.

8. The computer program product of claim 6 wherein the distinguishing features include one or more lexical features.

9. The computer program product of claim 6 wherein the extracting uses text analysis to automatically extract the sets of linguistic objects.

Assignees

• IBM

Inventors

• Beller Charles E
• Chase Jr Paul J
• Darden Richard L
• Drzewucki Michael
• Katz Edward G
• Phipps Christopher
• Ramirez James E

Classifications

• G06F40/284 Primary

  Lexical analysis, e.g. tokenisation or collocates · CPC title

• G06F40/35

  Discourse or dialogue representation · CPC title

• G06F40/211

  Syntactic parsing, e.g. based on context-free grammar [CFG] or unification grammars · CPC title

• G06F40/30

  Semantic analysis · CPC title

• G06F16/35 Primary

  Clustering; Classification · CPC title