Method and system for multi-block overlap-detection in a parallel environment without inter-process communication

Patent metadata

Field	Value
Publication number	US-9235592-B2
Application number	US-201313871940-A
Country	US
Kind code	B2
Filing date	Apr 26, 2013
Priority date	Apr 26, 2013
Publication date	Jan 12, 2016
Grant date	Jan 12, 2016

Abstract

Techniques for avoiding duplicate comparisons while comparing customer records to identify linked customer records pertaining to a single customer entity are provided. The techniques include the computer system comparing a first electronic customer record with a second electronic customer record to determine if the first electronic customer record and the second electronic customer record pertain to a single customer entity if the computer system identifies a common blocker key corresponding to a selected blocker from a data field in the first electronic customer record and from a data field in the second electronic customer record and if the computer system does not identify a common blocker key corresponding to an additional lower order blocker from another data field in the first electronic customer record and from a data field in the second electronic customer record.

First claim

What is claimed is:

1. A computer implemented method comprising:
a computer system identifying a target group of electronic customer records, each of the target group of electronic customer records having multiple data fields containing customer data;
the computer system identifying a plurality of blockers, each of the plurality of blockers identifying a target data field within the multiple data fields;
the computer system identifying a selected blocker and an additional blocker from the plurality of blockers, wherein the additional blocker is of a lower order than the selected blocker;
the computer system identifying a first electronic customer record and a second electronic customer record from the target group of electronic customer records;
the computer system analyzing the first electronic customer record to identify first potential blocker keys associated with the selected blocker and the additional blocker;
the computer system analyzing the second electronic customer record to identify second potential blocker keys associated with the selected blocker and the additional blocker;
the computer system comparing the first electronic customer record with the second electronic customer record to determine whether the first electronic customer record and the second electronic customer record pertain to a single customer entity when the computer system identifies a common blocker key corresponding to the selected blocker from the first electronic customer record and from the second electronic customer record and the computer system does not identify a common blocker key corresponding to the additional blocker from the first electronic customer record and from the second electronic customer record; and
the computer system not comparing the first electronic customer record with the second electronic customer record to determine whether the first electronic customer record and the second electronic customer record pertain to a single customer entity when the computer system identifies a common blocker key corresponding to the selected blocker from the first electronic customer record and from the second electronic customer record and the computer system also identifies a common blocker key corresponding to the additional blocker from the first electronic customer record and from the second electronic customer record.

2. The method of claim 1 , wherein the method further comprises the computer system not comparing the first electronic customer record with the second electronic customer record to determine whether the first electronic customer record and the second electronic customer record pertain to a single customer entity when the computer system does not identify a common blocker key corresponding to the selected blocker from the first electronic customer record and from the second electronic customer record.

3. The method of claim 1 , wherein the method further comprises:
the computer system creating a first key value group, the first key value group comprising blocker keys corresponding to the first electronic customer record and corresponding to the selected blocker and the additional blocker;
the computer system creating a second key value group, the second key value group comprising blocker keys corresponding to the second electronic customer record and corresponding to the selected blocker and the additional blocker; and
wherein the method more specifically comprises the computer system comparing the first key value group and the second key value group to determine whether the computer system compares the first electronic customer record with the second electronic customer record.

4. The method of claim 1 , wherein the computer system identifying a selected blocker and an additional blocker which is of a lower order than the selected blocker from the plurality of blockers more specifically comprises:
the computer system placing the plurality of blockers into an ordered list;
and the computer system identifying the selected blocker and an additional blocker which is of a lower order on the list than the selected blocker.

5. The method of claim 1 , wherein the blocker keys comprise data values from an electronic customer record corresponding to a data field identified by a blocker.

6. The method of claim 1 , wherein the selected blocker identifies a target data field comprising a double metaphone of a last name.

7. The method of claim 1 , wherein the computer system compares the first electronic customer record with the second electronic customer record to determine whether the first electronic customer record and the second electronic customer record pertain to a single customer, a single household, or a single business.

8. The method of claim 1 , wherein the computer system identifying a first electronic customer record and a second electronic customer record from the target group of electronic customer records more specifically comprises:
the computer system identifying, from the target group of electronic customer records, a first electronic customer record having a blocker key corresponding to the selected blocker, the blocker key comprising a data value corresponding to the target data field identified in a blocker; and
the computer system identifying, from the target group of electronic customer records, a second electronic customer record having a blocker key corresponding to the selected blocker which matches a first electronic customer record blocker key.

9. The method of claim 1 , wherein the method further comprises:
the computer system identifying a third blocker from the plurality of blockers, which is different from the selected blocker and the additional blocker, and which is of a higher order than the selected blocker and the additional blocker;
the computer system identifying a third electronic customer record and a fourth electronic customer record from the target group of electronic customer records;
the computer system analyzing the third electronic customer record to identify potential blocker keys associated with the third blocker, the selected blocker, and the additional blocker;
the computer system analyzing the fourth electronic customer record to identify potential blocker keys associated with the third blocker, the selected blocker, and the additional blocker; and
the computer system comparing the third electronic customer record with the fourth electronic customer record to determine whether the third electronic customer record and the fourth electronic customer record pertain to a single customer entity when the computer system identifies a common blocker key corresponding to the third blocker from the third electronic customer record and from the fourth electronic customer record, the computer system does not identify a common blocker key corresponding to the selected blocker from the third electronic customer record and from the fourth electronic customer record, and the computer system does not identify a common blocker key corresponding to the additional blocker from the third electronic customer record and from the fourth electronic customer record.

10. The method of claim 1 , wherein the selected blocker identifies a target data field comprising a first letter of a last name.

11. A computer system comprising one or more processors and one or more hardware memory devices operably connected to the one or more processors, the one or more hardware memory devices storing executable and operational code effective to cause the one or more processors to:
identify a target group of electronic customer records, each of the target group of electronic customer records having multiple data fields containing customer data;
identify a plurality of blockers,

Assignees

• Wal Mart Stores Inc

Inventors

• Ray Andrew Benjamin
• Troutman Nathaniel Philip

Classifications

• G06F16/1748 Primary

  De-duplication implemented within the file system, e.g. based on file segments (de-duplication techniques in storage systems for the management of data blocks G06F3/0641) · CPC title

• G06F17/30156 Primary

  Physics · mapped topic