Multi-database document search system architecture

Patent metadata

Field	Value
Publication number	US-11636162-B2
Application number	US-202117455112-A
Country	US
Kind code	B2
Filing date	Nov 16, 2021
Priority date	Aug 2, 2018
Publication date	Apr 25, 2023
Grant date	Apr 25, 2023

Abstract

A document review system is configured to quickly provide search results for large amounts of documents. Ontology templates are used to generate objects and links based on the documents. Users can view documents, and linked objects and object properties can be displayed. An index assisted search can be performed to determine the linked objects and object properties. A supplemental search can be performed on a second database that tracks modifications to the documents or objects. The modifications in the second database can be periodically written to the first database, and the index can be rebuilt. The user experience can be free of slow searches and slow index rebuilds.

First claim

What is claimed is:

1. A search system comprising:
a data intake system configured to generate a plurality of objects and links between objects based at least in part on an ontology;
a first database configured to store the plurality of objects and links;
a search system configured to build an index of the plurality of objects and links;
a second database configured to log changes related to the plurality of objects and links; and
a data interface system configured to receive a user selection of a first object, wherein the first object represents a document;
wherein the search system is configured to search, with reference to the index, for links to the first object;
wherein the data interface system is configured to initiate a supplemental search of the second database for changes in any of the links to the first object, and
wherein the data interface system is configured to transmit data for displaying at least some results of the supplemental search.

2. The system of claim 1 , wherein the changes in the second database are configured to be written to the first database.

3. The system of claim 1 , wherein the supplemental search of the second database for changes in any of the links to the first object includes changes that are not included in the first database at the time of the supplemental search.

4. The system of claim 1 , further comprising one or more data stores including at least 100,000 documents, wherein the data intake system is configured to generate the plurality of objects and the links between objects based at least in part on the at least 100,000 documents, and wherein the first database is separate from the one or more data stores.

5. The system of claim 1 , wherein the search is performed using a scalable search technique.

6. The system of claim 1 , further comprising an auditing system configured to audit the changes, wherein the changes include edits or deletions, and wherein the changes in the second database are appended to the first database.

7. A computer system comprising:
a computer readable storage medium storing instructions; and
one or more processors configured to execute the instructions to cause the processors to:
generate a plurality of objects and links between objects based at least in part on an ontology;
store the plurality of objects and links in a first database;
build an index of the plurality of objects and links;
store changes affecting the plurality of objects and links in a second database;
receive a user selection of a first object, wherein the first object represents a document;
perform a first search, with reference to the index, for links to the first object;
perform a supplemental search of the second database for changes to any of the links to the first object; and
transmit data for displaying search results determined based at least in part on the first search and the supplemental search.

8. The system of claim 7 , wherein the changes in the second database are configured to be written to the first database.

9. The system of claim 8 , wherein the second database is configured to delete the changes affecting the plurality of objects and links that are stored in the second database after the changes affecting the plurality of objects and links are written to the first database.

10. The system of claim 7 , further comprising searching the second database for changes that have not yet been written to the first database when the supplemental search is performed.

11. The system of claim 7 , further comprising one or more data stores including at least 100,000 documents, wherein the one or more processors are configured to execute the instructions to further cause the processors to generate the plurality of objects and the links between objects based at least in part on the at least 100,000 documents, wherein the first database is separate from the data store, and wherein the first database is separate from the one or more data stores.

12. The system of claim 7 , wherein the first search is performed using a scalable search technique.

13. The system of claim 7 , further comprising an auditing system configured to audit the changes, wherein the changes include edits or deletions, and wherein the changes in the second database are appended to the first database.

14. A searching and indexing method comprising:
generating a plurality of objects and links between objects based at least in part on an ontology;
storing the plurality of objects and links in a first database;
building an index of the plurality of objects and links;
storing changes affecting the plurality of objects and links in a second database;
receiving a user selection of a first object, wherein the first object represents a document;
performing a first search, with reference to the index, for links to the first object;
performing a supplemental search of the second database for changes in any of the links to the first object; and
transmitting data for displaying search results determined based at least in part on the first search and the supplemental search.

15. The method of claim 14 , wherein the changes in the second database are configured to be written to the first database.

16. The method of claim 14 , further comprising performing a search of the second database for changes that have not yet been written to the first database when supplemental search is performed.

17. The method of claim 14 , wherein the generating of the plurality of objects and the links between objects is based at least in part on at least 100,000 documents.

18. The method of claim 14 , wherein the first search is performed using a scalable search technique.

19. The method of claim 14 , further comprising receiving the changes affecting the plurality of objects and links, wherein the changes include edits to a document, tag, object, object property, or link.

Assignees

• Palantir Technologies Inc

Inventors

• Schwartz Eric
• Bores Alexander
• Martino Alexander
• Berg Brendan
• Sharzer Charles
• Shapiro Doron
• Hsiao Enoch
• Knudson Eric
• Bell Landon
• Manville Martin
• Platek Michael
• Bruner Nathan
• Giardina Robert
• Beckoff Sarah
• Tang Tri
• Brady William
• Hou Wenshuai

Classifications

• G06F16/93 Primary

  Document management systems · CPC title

• G06F16/248

  Presentation of query results · CPC title

• G06F16/94 Primary

  Hypermedia (Hyperlinking G06F40/134) · CPC title

• G06F16/2358

  Change logging, detection, and notification (replication G06F16/27) · CPC title

• G06F16/2228

  Indexing structures · CPC title