Combined deterministic and probabilistic matching for data management

Patent metadata

Field	Value
Publication number	US-9600602-B2
Application number	US-201414301790-A
Country	US
Kind code	B2
Filing date	Jun 11, 2014
Priority date	Aug 30, 2013
Publication date	Mar 21, 2017
Grant date	Mar 21, 2017

Abstract

A method for data management. The method includes a computer selecting a first data record and a second data record. The computer determines whether the first data record and the second data record share a deterministic matching category. Responsive to determining the first data record does not share a deterministic matching category with the second data record, the computer determines whether the first data record and the second data record share a probabilistic matching category.

First claim

What is claimed is:

1. A method for data management, the method comprising:
a computer selecting a first data record and a second data record, wherein one or more attributes of the data records used by a deterministic algorithm are independent of one or more attributes of the data records used by a probabilistic algorithm, and wherein the one or more attributes of the data records used by the deterministic algorithm overlap the one or more attributes of the data records used by the probabilistic algorithm;
the computer determining whether the first data record and the second data record share a deterministic matching category, wherein a matching category includes one or more data record types;
responsive to determining the first data record does not share a deterministic matching category with the second data record, the computer determining whether the first data record and the second data record share a probabilistic matching category;
responsive to determining that the first data record and the second data record share a probabilistic matching category, the computer determining whether one or more additional records in the probabilistic matching category match;
the computer setting a comparison score as a number of matching records in the probabilistic matching category;
the computer determining whether the comparison score meets or exceeds a predetermined threshold value;
responsive to determining that the comparison score meets or exceeds the predetermined threshold value, the computer retrieving matched data records; and
subsequent to retrieving matched data records, the computer applying data steward rules to the matched data records, wherein the data steward rules define additional requirements to determine a final match outcome.

2. The method of claim 1 , wherein the computer determining a comparison score for the first data record and the second data record further comprises:
the computer determining at least one of an attribute of the first data record matches at least one of an attribute of the second data record; and
the computer setting the comparison score as a number of matching attributes between the first data record and the second data record.

3. The method of claim 1 , further comprising the step of:
responsive to determining that the first data record and the second data record share a deterministic matching category, the computer retrieving matched data records.

4. The method of claim 1 , wherein the first data record and the second data record are stored in one or more databases within a clouded federated database system.

Assignees

• IBM

Inventors

• Natarajan Subashree
• Shah Ankur B

Classifications

• G06F17/30985 Primary

  Physics · mapped topic

• G06F17/30303

  Physics · mapped topic

• G06F16/215 Primary

  Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors · CPC title

• G06F16/90344 Primary

  by using string matching techniques · CPC title