Term consolidation for indices

Patent metadata

Field	Value
Publication number	US-9953023-B2
Application number	US-201414532058-A
Country	US
Kind code	B2
Filing date	Nov 4, 2014
Priority date	Mar 31, 2014
Publication date	Apr 24, 2018
Grant date	Apr 24, 2018

Abstract

A computer-implemented method, carried out by one or more processors, for consolidating an index entry of a dictionary. In an embodiment, the method comprises the steps of receiving, by one or more processors, a set of parameters, wherein the set of parameters indicates at least a length of prefix and a length of hash value; receiving, by one or more processors, a first term for entry into an index; converting, by one or more processors, the first term for entry into the index according to the set of parameters; and responsive to determining the converted first term is not present in the index, storing, by one or more processors, the first converted term into the index.

First claim

What is claimed is:

1. A method for consolidating an index entry of a dictionary, the method comprising:
receiving, by one or more processors, a set of parameters, wherein the set of parameters indicates at least a character length of prefix and a character length of hash value for converting terms for entry into an index;
receiving, by one or more processors, a first term for entry into an index;
responsive to determining the first term exceeds a sum of the character length of prefix, the character length of hash value, and a character length of a threshold value, determining, by one or more processors, to convert the first term for entry into the index;
converting, by one or more processors, the first term for entry into the index according to the set of parameters, wherein a converted first term includes a first portion of characters of the first term representing a prefix, beginning at a first character of the first term and with a character length equal to the character length of prefix, and wherein the converted first term further includes a second portion of characters subsequent to and not including the characters of the first portion of the first term, reduced to a hash value with a character length equal to the character length of hash value; and
responsive to determining the converted first term is not present in the index, storing, by one or more processors, the converted first term in the index, wherein the first term is searchable based on the converted first term in the index.

2. The method of claim 1 , further comprising:
receiving, by one or more processors, a second term to search for in the index;
converting, by one or more processors, the second term according to the set of parameters, wherein a converted second term includes a first portion of characters of the second term representing a prefix, beginning at a first character of the second term and with a character length equal to the character length of prefix, and wherein the converted second term further includes a second portion of characters subsequent to and not including the characters of the first portion of the second term, reduced to a hash value with a character length equal to the character length of hash value; and
determining, by one or more processors, if the converted second term is present in the index.

3. The method of claim 2 , wherein determining if the converted second term is present in the index includes determining, by one or more processors, the converted second term matches the converted first term.

4. The method of claim 1 , further comprising:
receiving, by one or more processors, a second term to search for in the index;
truncating, by one or more processors, the second term at the character length of prefix; and
determining, by one or more processors, if the truncated second term is present in the index.

5. The method of claim 2 , further comprising:
receiving, by one or more processors, a threshold value, wherein the threshold value is a character length for a received term; and
responsive to determining the second term exceeds a sum of the character length of prefix, the character length of hash value, and the character length of threshold value, determine to convert the second term.

Assignees

• IBM

Inventors

• Baessler Michael
• Doerre Jochen
• Hampp-Bahnmueller Thomas A P
• Hoffmann Philipp
• Lorch Markus
• Maletz Juergen
• Pittner Daniel

Classifications

• G06F40/12

  Use of codes for handling textual entities · CPC title

• G06F40/242 Primary

  Dictionaries · CPC title

• G06F16/2228

  Indexing structures · CPC title

• G06F40/157 Primary

  using dictionaries or tables · CPC title

• G06F17/22

  Physics · mapped topic