Contextualization of entity relationships

Patent metadata

Field	Value
Publication number	US-9740749-B2
Application number	US-201414462993-A
Country	US
Kind code	B2
Filing date	Aug 19, 2014
Priority date	Aug 19, 2014
Publication date	Aug 22, 2017
Grant date	Aug 22, 2017

Abstract

Methods and arrangements for identifying related data in different data sets to assist in searching the data sets. A first data asset and a second data asset are accessed. Common entities are identified between the first and second data assets. A score is determined for the relationship between the first and second data assets, based on the identified common entities. One or more relationship contexts are determined for the relationship between the first and second data assets, and the relationship score and one or more relationship contexts are used to join at least a portion of each of the first and second data assets as a basis for subsequent searching. Other variants and embodiments are broadly contemplated herein.

First claim

What is claimed is:

1. A method of identifying related data in different data sets to assist in searching the data sets, said method comprising:
utilizing at least one processor to execute computer code configured to perform the steps of:
accessing a first structured data asset and a second unstructured data asset;
identifying entities common to the first and second data assets, wherein the identifying comprises extracting structured entities from the first structured data asset, tokenizing the second unstructured data asset, and performing a search using the tokenized second unstructured data asset with respect to the extracted structured entities;
determining a non-tangible score for a relationship between the first and second data assets, wherein the non-tangible score is based on the identified common entities and wherein the non-tangible score identifies a similarity between the first structured data asset and the second unstructured data asset;
determining one or more relationship contexts for the relationship between the first and second data assets; and
using the relationship score and one or more relationship contexts to join at least a portion of each of the first and second data assets as a basis for subsequent searching.

2. The method according to claim 1 , wherein said identifying entities comprises searching among columnar values in the first and second data assets.

3. The method according to claim 1 , wherein said determining a score comprises determining a bi-directional relationship score.

4. The method according to claim 1 , wherein said determining a score comprises determining a uni-directional relationship score.

5. The method according to claim 1 , wherein said determining one or more relationship contexts comprises determining a uni-directional relationship context score.

6. The method according to claim 1 , comprising determining a score for each of the one or more relationship contexts.

7. The method according to claim 6 , wherein said using the relationship score and one or more relationship contexts comprises:
applying a threshold to present one or more relationships for searching across both of the first and second assets;
said applying of a threshold comprising:
determining a ratio of a score for at least one of the one or more relationship contexts by dividing the relationship context score by the relationship score; and
comparing the ratio to the threshold.

8. The method according to claim 7 , wherein:
the relationship score is determined with respect to structured entities; and
the relationship context score is determined with respect to extracted entities.

9. The method according to claim 1 , wherein the relationship score comprises a Jaccard similarity or index score.

10. The method according to claim 1 , wherein the relationship score represents a fraction of at least one of the first and second data assets accounted for by the common entities.

11. The method according to claim 1 , wherein the one or more relationship contexts comprise a plurality of relationship contexts.

12. An apparatus identifying related data in different data sets to assist in searching the data sets, said apparatus comprising:
at least one processor; and
a computer readable storage medium having computer readable program code embodied therewith and executable by the at least one processor, the computer readable program code comprising:
computer readable program code configured to access a first structured data asset and a second unstructured data asset;
computer readable program code configured to identify entities common to the first and second data assets, wherein to identify comprises extracting structured entities from the first structured data asset, tokenizing the second unstructured data asset, and performing a search using the tokenized second unstructured data asset with respect to the extracted structured entities;
computer readable program code configured to determine a non-tangible score for a relationship between the first and second data assets, wherein the non-tangible score is based on the identified common entities and wherein the non-tangible score identifies a similarity between the first structured data asset and the second unstructured data asset;
computer readable program code configured to determine one or more relationship contexts for the relationship between the first and second data assets; and
computer readable program code configured to use the relationship score and one or more relationship contexts to join at least a portion of each of the first and second data assets as a basis for subsequent searching.

13. A computer program product for determining relationships between data assets, said computer program product comprising:
computer readable program code configured to access a first structured data asset and a second unstructured data asset;
computer readable program code configured to identify entities common to the first and second data assets, wherein to identify comprises extracting structured entities from the first structured data asset, tokenizing the second unstructured data asset, and performing a search using the tokenized second unstructured data asset with respect to the extracted structured entities;
computer readable program code configured to determine a non-tangible score for a relationship between the first and second data assets, wherein the non-tangible score is based on the identified common entities and wherein the non-tangible score identifies a similarity between the first structured data asset and the second unstructured data asset;
computer readable program code configured to determine one or more relationship contexts for the relationship between the first and second data assets; and
computer readable program code configured to use the relationship score and one or more relationship contexts to join at least a portion of each of the first and second data assets as a basis for subsequent searching.

14. The computer program product according to claim 13 , wherein identifying entities comprises searching among columnar values in the first and second data assets.

15. The computer program product according to claim 13 , wherein the determining of a score comprises determining a bi-directional relationship score.

16. The computer program product according to claim 13 , wherein determining a score comprises determining a uni-directional relationship score.

17. The computer program product according to claim 13 , wherein determining one or more relationship contexts comprises determining a uni-directional relationship context score.

18. The computer program product according to claim 13 , comprising computer readable program code configured to determine a score for each of the one or more relationship contexts.

19. The computer program product according to claim 18 , wherein using the relationship score and one or more relationship contexts comprises:
applying a threshold to present one or more relationships for searching across both of the first and second assets, via:
determining a ratio of a score for at least one of the one or more relationship contexts by dividing the relationship context score by the relationship score; and
comparing the ratio to the threshold.

20. A method comprising:
accessing a first data asset and a second data asset;
identifying a relationship between the first and second data assets, via identifying entities common to the first and second data assets;
said identifying of common entities comprisin

Assignees

• IBM

Inventors

• Deshpande Prasad Manikarao
• Dey Atreyee
• Gupta Rajeev
• Padmanabhan Sriram K

Classifications

• G06F17/3053 Primary

  Physics · mapped topic

• G06F17/30864

  Physics · mapped topic

• G06F17/30315

  Physics · mapped topic

• G06F16/24578 Primary

  using ranking · CPC title

• G06F16/951

  Indexing; Web crawling techniques · CPC title