Directed data indexing based on conceptual relevance

Patent metadata

Field	Value
Publication number	US-11726972-B2
Application number	US-201815939902-A
Country	US
Kind code	B2
Filing date	Mar 29, 2018
Priority date	Mar 29, 2018
Publication date	Aug 15, 2023
Grant date	Aug 15, 2023

Abstract

A non-transitory machine-readable storage medium stores instructions that upon execution cause a processor to, in response to initiation of a data indexing for a search concept, retrieve content of a first data source via a data connector, the retrieved content including a reference to a second data source. The instructions further cause the processor to, in response to a determination that the retrieved content of the first data source is relevant to the search concept: index the retrieved content of the first data source; retrieve content of the second data source based on the reference; and determine whether the retrieved content of the second data source is relevant to the search concept.

First claim

What is claimed is:

1. A non-transitory machine-readable storage medium storing instructions that upon execution cause a processor to:
in response to initiation of a data indexing for a search concept, retrieve content of a first data source via a data connector, the retrieved content including a reference to a second data source;
in response to a determination that the retrieved content of the first data source is relevant to the search concept:
generate, via the data connector, a conceptual index data structure based on the retrieved content of the first data source, wherein the instructions that upon execution cause the processor to generate the conceptual index data structure further cause the processor to index the retrieved content of the first data source in the conceptual index data structure based on conceptual relevance of the retrieved content to the search concept;
retrieve content of the second data source based on the reference and the conceptual index data structure;
determine whether the retrieved content of the second data source is relevant to the search concept; and
modify the conceptual index data structure based on the retrieved content of the second data source, in response to whether the retrieved content of the second data source is determined to be relevant to the search concept.

2. The non-transitory machine-readable storage medium of claim 1 , wherein the instructions upon execution further cause the processor to:
in response to a determination that the retrieved content of the first data source is not relevant to the search concept:
discard the retrieved content of the first data source; and
ignore the content of the second data source.

3. The non-transitory machine-readable storage medium of claim 2 , wherein the instructions upon execution further cause the processor to:
subsequent to the determination that the retrieved content of the first data source is not relevant to the search concept, retrieve content of a third data source that is not referenced in the first and second data sources.

4. The non-transitory machine-readable storage medium of claim 1 , wherein the instructions upon execution further cause the processor to:
in response to the determination that the retrieved content of the second data source is relevant to the search concept:
index the retrieved content of the second data source in the conceptual index data structure based on conceptual relevance of the retrieved content of the second data source to the search concept; and
retrieve content of a third data source based on a second reference included in the retrieved content of the second data source.

5. The non-transitory machine-readable storage medium of claim 1 , wherein the instructions upon execution further cause the processor to:
in response to a user query associated with the search concept, generate query results based on the conceptual index data structure; and
present the query results to a user, wherein the query results comprise at least a portion of the retrieved content of the first data source, at least a portion of the retrieved content of the second data source, or both.

6. The non-transitory machine-readable storage medium of claim 1 , wherein the first data source is a first web site, the second data source is a second web site, and the reference is a hyperlink to the second website.

7. The non-transitory machine-readable storage medium of claim 1 , wherein the retrieved content of the first data source comprises image content, and the reference comprises a visual identifier.

8. The non-transitory machine-readable storage medium of claim 1 , wherein the retrieved content of the first data source comprises audio content, and the reference comprises human speech identifying a data source.

9. A computer implemented method comprising:
detecting initiation of a data indexing for a search concept;
in response to the detection of the initiation of the data indexing, retrieving, via a data connector, content of a first data source, the retrieved content including a reference to a second data source;
determining, by a conceptual analysis engine executed by a processor, whether the retrieved content of the first data source is relevant to the search concept;
in response to the determination that the retrieved content of the first data source is relevant to the search concept:
generating, by the data connector, a conceptual index data structure based on the retrieved content of the first data source, wherein generating the conceptual index data structure comprises indexing the retrieved content of the first data source in the conceptual index data structure based on conceptual relevance of the retrieved content to the search concept;
retrieving, via the data connector, content of the second data source based on the reference and the conceptual index data structure;
determining, by the conceptual analysis engine, whether the retrieved content of the second data source is relevant to the search concept; and
modifying, by the data connector, the conceptual index data structure based on the retrieved content of the second data source, in response to the determination of whether the retrieved content of the second data source is relevant to the search concept.

10. The computer implemented method of claim 9 , further comprising:
in response to a determination that the retrieved content of the second data source is not relevant to the search concept:
discarding the retrieved content of the second data source; and
ignoring a second reference included in the retrieved content of the second data source, the second reference identifying a third data source.

11. The computer implemented method of claim 9 , further comprising:
in response to a determination that the retrieved content of the second data source is relevant to the search concept:
indexing the retrieved content of the second data source in the conceptual index data structure based on conceptual relevance of the retrieved content of the second data source to the search concept; and
retrieving, via the data connector, content of a third data source based on a second reference included in the retrieved content of the second data source.

12. The computer implemented method of claim 9 , wherein the determining whether the retrieved content of the first data source is relevant to the search concept occurs after the retrieving the content of the first data source.

13. The computer implemented method of claim 9 , wherein the reference comprises a network address.

14. The method of claim 9 , further comprising:
in response to a user query associated with the search concept, generating query results based on the conceptual index data structure; and
presenting the query results to a user via a user interface, wherein the query results comprise at least a portion of the retrieved content of the first data source, at least a portion of the retrieved content of the second data source, or both.

15. A computing device comprising:
a hardware processor; and
a machine-readable storage medium storing instructions, the instructions executable by the hardware processor to:
in response to initiation of a data indexing for a search concept, retrieve content of a first data source via a data connector, the retrieved content including a reference to a second data source;
in response to a determination that the retrieved content of the first data source is relevant to the search concept:
generate, via the data connector, a conceptual index data structure based on the retrieved content of the first data source, wherein the instructions

Assignees

• Entit Software Llc
• Micro Focus Llc

Inventors

• Humphrey David
• Jeffrey Samuel James
• Greenwood Phillip

Classifications

• G06F16/2228 Primary

  Indexing structures · CPC title

• G06F16/245

  Query processing · CPC title

• G06F16/248

  Presentation of query results · CPC title

• G06F16/9535

  Search customisation based on user profiles and personalisation · CPC title

• G06F16/9566

  URL specific, e.g. using aliases, detecting broken or misspelled links · CPC title