Term consolidation for indices

Patent metadata

Field	Value
Publication number	US-9940322-B2
Application number	US-201414230568-A
Country	US
Kind code	B2
Filing date	Mar 31, 2014
Priority date	Mar 31, 2014
Publication date	Apr 10, 2018
Grant date	Apr 10, 2018

Abstract

A computer-implemented method, carried out by one or more processors, for consolidating an index entry of a dictionary. In an embodiment, the method comprises the steps of receiving, by one or more processors, a set of parameters, wherein the set of parameters indicates at least a length of prefix and a length of hash value; receiving, by one or more processors, a first term for entry into an index; converting, by one or more processors, the first term for entry into the index according to the set of parameters; and responsive to determining the converted first term is not present in the index, storing, by one or more processors, the first converted term into the index.

First claim

What is claimed is:

1. A computer program product for consolidating an index entry of a dictionary, the computer program product comprising:
one or more computer readable tangible storage media and program instructions stored on at least one of the one or more storage media, the program instructions comprising:
program instructions to receive a set of parameters, wherein the set of parameters indicates at least a character length of prefix and a character length of hash value for converting terms for entry into an index;
program instructions to receive a first term for entry into the index;
program instructions to, responsive to determining the first term exceeds a sum of the character length of prefix, the character length of hash value, and a character length of a threshold value, determine to convert the first term for entry into the index;
program instructions to convert the first term for entry into the index according to the set of parameters, wherein a converted first term includes a first portion of characters of the first term representing a prefix, beginning at a first character of the first term and with a character length equal to the character length of prefix, and wherein the converted first term further includes a second portion of characters subsequent to and not including the characters of the first portion of the first term, reduced to a hash value with a character length equal to the character length of hash value; and
program instructions to, responsive to determining the converted first term is not present in the index, store the converted first term in the index, wherein the first term is searchable based on the converted first term in the index.

2. The computer program product of claim 1 further comprising program instructions, stored on the one or more computer readable storage media, which when executed by a processor, cause the processor to:
receive a second term to search for in the index;
convert the second term according to the set of parameters, wherein a converted second term includes a first portion of characters of the second term representing a prefix, beginning at a first character of the second term and with a character length equal to the character length of prefix, and wherein the converted second term further includes a second portion of characters subsequent to and not including the characters of the first portion of the second term, reduced to a hash value with a character length equal to the character length of hash value; and
determine if the converted second term is present in the index.

3. The computer program product of claim 2 , wherein determining if the converted second term is present in the index further comprises program instructions, stored on the one or more computer readable storage media, which when executed by a processor, cause the processor to:
determine the converted second term matches the converted first term.

4. The computer program product of claim 1 , further comprising program instructions, stored on the one or more computer readable storage media, which when executed by a processor, cause the processor to:
receive a second term to search for in the index;
truncate the second term at the character length of prefix; and
determine if the truncated second term is present in the index.

5. The computer program product of claim 2 , further comprising program instructions, stored on the one or more computer readable storage media, which when executed by a processor, cause the processor to:
responsive to determining the second term received for search in the index exceeds a sum of the character length of prefix, the character length of hash value, and the character length of threshold value, determine to convert the second term.

6. A computer system for consolidating an index entry of a dictionary, the computer system comprising:
one or more computer processors;
one or more computer readable storage media; and
program instructions stored on the computer readable storage media for execution by at least one of the one or more computer processors, the program instructions comprising:
program instructions to receive a set of parameters, wherein the set of parameters indicates at least a character length of prefix and a character length of hash value for converting terms for entry into an index;
program instructions to receive a first term for entry into the index;
program instructions to, responsive to determining the first term exceeds a sum of the character length of prefix, the character length of hash value, and a character length of a threshold value, determine to convert the first term for entry into the index;
program instructions to convert the first term for entry into the index according to the set of parameters, wherein a converted first term includes a first portion of characters of the first term representing a prefix, beginning at a first character of the first term and with a character length equal to the character length of prefix, and wherein the converted first term further includes a second portion of characters subsequent to and not including the characters of the first portion of the first term, reduced to a hash value with a character length equal to the character length of hash value; and
program instructions to, responsive to determining the converted first term is not present in the index, store the converted first term in the index, wherein the first term is searchable based on the converted first term in the index.

7. The computer system of claim 6 further comprising program instructions, stored on the one or more computer readable storage media, which when executed by a processor, cause the processor to:
receive a second term to search for in the index;
convert the second term according to the set of parameters, wherein a converted second term includes a first portion of characters of the second term representing a prefix, beginning at a first character of the second term and with a character length equal to the character length of prefix, and wherein the converted second term further includes a second portion of characters subsequent to and not including the characters of the first portion of the second term, reduced to a hash value with a character length equal to the character length of hash value; and
determine if the converted second term is present in the index.

8. The computer system of claim 6 , wherein determining if the converted second term is present in the index further comprises program instructions, stored on the one or more computer readable storage media, which when executed by a processor, cause the processor to:
determine the converted second term matches the converted first term.

9. The computer system of claim 7 , further comprising program instructions, stored on the one or more computer readable storage media, which when executed by a processor, cause the processor to:
receive a second term to search for in the index;
truncate the second term at the character length of prefix; and
determine if the truncated second term is present in the index.

10. The computer system of claim 7 , further comprising program instructions, stored on the one or more computer readable storage media, which when executed by a processor, cause the processor to:
responsive to determining the second term received for search in the index exceeds a sum of the character length of prefix, the character length of hash value, and the character length of threshold value, determine to convert the second term.

Assignees

• IBM

Inventors

• Baessler Michael
• Doerre Jochen
• Hampp-Bahnmueller Thomas A P
• Hoffmann Philipp
• Lorch Markus
• Maletz Juergen
• Pittner Daniel

Classifications

• G06F40/157 Primary

  using dictionaries or tables · CPC title

• G06F16/2228

  Indexing structures · CPC title

• G06F40/242 Primary

  Dictionaries · CPC title

• G06F40/12

  Use of codes for handling textual entities · CPC title

• G06F17/30321

  Physics · mapped topic