Analyzing concepts over time

Patent metadata

Field	Value
Publication number	US-10783202-B2
Application number	US-201916274480-A
Country	US
Kind code	B2
Filing date	Feb 13, 2019
Priority date	Sep 22, 2015
Publication date	Sep 22, 2020
Grant date	Sep 22, 2020

Abstract

A method and apparatus are provided for automatically generating and processing first and second concept vector sets extracted, respectively, from a first set of concept sequences and from a second, temporally separated, concept sequences by performing a natural language processing (NLP) analysis of the first concept vector set and second concept vector set to detect changes in the corpus over time by identifying changes for one or more concepts included in the first and/or second set of concept sequences.

First claim

What is claimed is:

1. A method, in an information handling system comprising a processor and a memory, for analyzing concept vectors to detect changes in a corpus over time, the method comprising:
analyzing relationship strengths between concepts that persist in a first set of concept sequences and a second set of concept sequences to identify vector changes for one or more concepts included in the first and/or second set of concept sequences, wherein analyzing relationship strengths comprises:
using, by the system, a neutral network-based vector embedding method, matrix-based vector embedding method, log-linear classifier-based vector embedding method or word2vec method to generate a first concept vector set V 1 , . . . , Vk derived from a first set of concept sequences over k concepts C 1 , . . . , Ck and to generate a second concept vector set V′ 1 , . . . , V′k+b derived from a second set of concept sequences over k old and b new concepts C 1 , . . . , Ck+b, where the second set of concept sequences is effectively collected after collection of the first set of concept sequences;
computing, by the system, a first cosine distance between each vector pair Vi, Vj from a first concept vector set V 1 , . . . , Vk derived from the first set of concept sequences over k concepts for all i≠j, 1≤i, j≤k;
computing, by the system, a second cosine distance between each vector pair V′i, V′j from a second concept vector set V′ 1 , . . . , V′k+b derived from the second set of concept sequences over k old and b new concepts for all i≠j, 1≤i, j≤k; and
identifying concept pairs from the first set of concept sequences whose interrelationship has changed by reporting each concept pair Vi, Vj whereby a subtraction of the second cosine distance from the first cosine distance exceeds a first specified reporting threshold; and

identifying market trends for answering questions submitted to the information handling system based on the vector changes identified by analyzing relationship strengths between concepts.

2. The method of claim 1 , further comprising generating, by the system, the first concept vector set V 1 , . . . , Vk that is derived from the first set of concept sequences over k concepts that are extracted from the corpus and applied to a vector learning component.

3. The method of claim 1 , further generating, by the system, the second concept vector set V′ 1 , . . . , V′k+b that is derived from the second set of concept sequences over k old and b new concepts that are extracted from the corpus and applied to the vector learning component, where the second set of concept sequences is effectively collected after collection of the first set of concept sequences.

4. The method of claim 1 , wherein analyzing relationship strengths comprises performing natural language processing (NLP) analysis of the first and second concept vector sets to detect an appearance of one or more new concepts in the second set of concept sequences that are not present in the first set of concept sequences.

5. The method of claim 1 , wherein analyzing relationship strengths comprises performing natural language processing (NLP) analysis of the first and second concept vector sets to detect a disappearance of one or more old concepts from the first set of concept sequences that are not present in the second set of concept sequences.

6. The method of claim 1 , wherein analyzing relationship strengths comprises performing natural language processing (NLP) analysis of the first and second concept vector sets to detect an appearance of one or more disruptive concepts in the second set of concept sequences that are related to a specified technology area represented by a sum of a plurality of concept vectors.

7. The method of claim 1 , wherein analyzing relationship strengths comprises performing natural language processing (NLP) analysis of the first and second concept vector sets to detect an appearance of one or more emerging concepts in the second set of concept sequences that are related to a specified topic area.

8. The method of claim 1 , wherein analyzing relationship strengths comprises performing natural language processing (NLP) analysis of the first and second concept vector sets to detect differences in spatial and/or frequency distributions of first and second concept vector sets by identifying changes in values of quantitative geometry and topology features that characterize concept regions associated, respectively, with the first and second concept vector sets.

9. The method of claim 8 , wherein identifying changes comprises computing differences in centroid positions, diameters between extreme points, orientations of the principal axes, number of significant dimensions, aspect ratios between lengths of the principal axes, or number and sizes of clusters computed by standard clustering algorithms.

10. An information handling system comprising:
one or more processors;
a memory coupled to at least one of the processors;
a set of instructions stored in the memory and executed by at least one of the processors to analyze concept vectors to detect changes in a corpus over time, wherein the set of instructions are executable to perform actions of:
analyzing, by the system, relationship strengths between concepts that persist in a first set of concept sequences and a second set of concept sequences to identify vector changes for one or more concepts included in the first and/or second set of concept sequences, wherein analyzing relationship strengths comprises:
using, by the system, a neutral network-based vector embedding method, matrix-based vector embedding method, log-linear classifier-based vector embedding method or word2vec method to generate concept vectors from a first set of concept sequences and a second set of concept sequences that are effectively collected after the first set of concept sequences;
computing, by the system, a first cosine distance between each vector pair Vi, Vj from a first concept vector set V 1 , . . . , Vk derived from the first set of concept sequences over k concepts for all i≠j, 1≤i, j≤k;
computing, by the system, a second cosine distance between each vector pair V′i, V′j from a second concept vector set V′ 1 , . . . , V′k+b derived from the second set of concept sequences over k old and b new concepts for all i≠j, 1≤i, j≤k; and
identifying concept pairs from the first set of concept sequences whose interrelationship has changed by reporting each concept pair Vi, Vj whereby a subtraction of the second cosine distance from the first cosine distance exceeds a first specified reporting threshold; and

identifying market trends for answering questions submitted to the information handling system based on the vector changes identified by analyzing relationship strengths between concepts.

11. The information handling system of claim 10 , wherein the set of instructions are executable to generate the first concept vector set V 1 , . . . , Vk that is derived from the first set of concept sequences over k concepts that are extracted from the corpus and applied to a vector learning component.

12. The information handling system of claim 10 , wherein the set of instructions are executable to generate the second concept vector set V′ 1 , . . . , V′k+b that is derived from the second set of concept sequences over k old and b new concepts that are extracted from the corpus and applied to the vector learning component, where the second set of concept sequences is effectively collected after collection of the first set of concept sequences.

13. The information handling system of claim 10 , wherein the set of instructions are executable to analyze relationship strengths

Assignees

• IBM

Inventors

• Ho Tin Kam
• Lastras-Montano Luis A
• Shmueli Oded

Classifications

• G06F16/9535 Primary

  Search customisation based on user profiles and personalisation · CPC title

• G06F40/20 Primary

  Natural language analysis (semantic analysis of natural language G06F40/30) · CPC title

• G06N3/0499

  Feedforward networks · CPC title

• G06Q30/0203 Primary

  Market surveys; Market polls · CPC title

• G06F16/3347

  using vector based model · CPC title