Distributed content indexing architecture with separately stored file previews

Patent metadata

Field	Value
Publication number	US-11036592-B2
Application number	US-201816130874-A
Country	US
Kind code	B2
Filing date	Sep 13, 2018
Priority date	Sep 14, 2017
Publication date	Jun 15, 2021
Grant date	Jun 15, 2021

Abstract

An improved content indexing (CI) system is disclosed herein. For example, the improved CI system may include a distributed architecture of client computing devices, media agents, a single backup and CI database, and a pool of servers. After a file backup occurs, the backup and CI database may include file metadata indices and other information associated with backed up files. Servers in the pool of servers may, in parallel, query the backup and CI database for a list of files assigned to the respective server that have not been content indexed. The servers may then request a media agent to restore the assigned files from secondary storage and provide the restored files to the servers. The servers may then content index the received restored files. Once the content indexing is complete, the servers can send the content index information to the backup and CI database for storage.

First claim

What is claimed is:

1. A networked information management system for separately storing previews, the networked information management system comprising:
a preview database;
a backup and content indexing database different than the preview database; and
a content indexing service having one or more first hardware processors, wherein the content indexing service is configured with first computer-executable instructions that, when executed, cause the content indexing service to:
receive a restored version of a secondary copy, wherein the secondary copy corresponds to a first data file;
parse the restored version of the secondary copy;
extract one or more keywords corresponding the first data file based on the parsing of the restored version of the secondary copy;
generate a preview of the restored version of the secondary copy;
store the generated preview of the restored version of the secondary copy in the preview database; and
store, in the backup and content indexing database, the one or more extracted keywords and a path to a storage location of the generated preview in the preview database.

2. The networked information management system of claim 1 , wherein the preview database comprises a link to a duplicate preview at a location corresponding to the path to the storage location of the generated preview.

3. The networked information management system of claim 1 , wherein the first computer-executable instructions, when executed, further cause the content indexing service to identify the path to the storage location of the generated preview in the preview database subsequent to storing the generated preview in the preview database.

4. The networked information management system of claim 1 , wherein the first computer-executable instructions, when executed, further cause the content indexing service to process an instruction to content index the first data file.

5. The networked information management system of claim 4 , wherein the first computer-executable instructions, when executed, further cause the content indexing service to parse the restored version of the secondary copy in response to reception of the instruction to content index the first data file.

6. The networked information management system of claim 4 , wherein the first computer-executable instructions, when executed, further cause the content indexing service to process an instruction to content index the first data file received from a controller content indexing proxy.

7. The networked information management system of claim 6 , wherein the first computer-executable instructions, when executed, further cause the content indexing service to receive the restored version of the secondary copy as a result of the controller content indexing proxy instructing a first computing device having a media agent to restore the first data file.

8. The networked information management system of claim 1 , wherein the first computer-executable instructions, when executed, further cause the content indexing service to store the one or more extracted keywords in the backup and content indexing database in an entry associated with the first data file.

9. The networked information management system of claim 1 , wherein storage of the one or more extracted keywords in the backup and content indexing database results in an indication, in the backup and content indexing database, that the first data file is content indexed.

10. The networked information management system of claim 1 , wherein the restored version of the secondary copy is in a markup language format.

11. A computer-implemented method for separately storing previews, the networked information management system comprising:
receiving a restored version of a secondary copy, wherein the secondary copy corresponds to a first data file;
parsing the restored version of the secondary copy;
extracting one or more keywords corresponding the first data file based on the parsing of the restored version of the secondary copy;
generating a preview of the restored version of the secondary copy;
storing the generated preview of the restored version of the secondary copy in a preview database; and
storing, in a backup and content indexing database different than the preview database, the one or more extracted keywords and a path to a storage location of the generated preview in the preview database.

12. The computer-implemented method of claim 11 , wherein the preview database comprises a link to a duplicate preview at a location corresponding to the path to the storage location of the generated preview.

13. The computer-implemented method of claim 11 , further comprising identifying the path to the storage location of the generated preview in the preview database subsequent to storing the generated preview in the preview database.

14. The computer-implemented method of claim 11 , further comprising receiving an instruction to content index the first data file.

15. The computer-implemented method of claim 14 , wherein parsing the restored version of the secondary copy further comprises parsing the restored version of the secondary copy in response to reception of the instruction to content index the first data file.

16. The computer-implemented method of claim 14 , wherein receiving an instruction to content index the first data file further comprises:
receiving an instruction to content index the first data file from a first controller content indexing proxy at the direction of a master content indexing proxy; and
receiving an instruction to content index a second data file from a second controller content indexing proxy at the direction of the master content indexing proxy.

17. The computer-implemented method of claim 16 , wherein receiving the restored version of the secondary copy further comprises receiving the restored version of the secondary copy as a result of the first controller content indexing proxy instructing a first computing device having a media agent to restore the first data file.

18. The computer-implemented method of claim 11 , wherein storing the one or more extracted keywords further comprises storing the one or more extracted keywords in the backup and content indexing database in an entry associated with the first data file.

19. The computer-implemented method of claim 11 , wherein storage of the one or more extracted keywords in the backup and content indexing database results in an indication, in the backup and content indexing database, that the first data file is content indexed.

20. The computer-implemented method of claim 11 , wherein the restored version of the secondary copy is in an independent format.

Assignees

• Commvault Systems Inc

Inventors

• Kumar Sanath
• Bhagi Sri Karthik
• Gokhale Parag
• Pawar Rahul S
• Duraisamy Arun Prabu
• PRADHAN Manoj Kumar
• Zakharkin Dmitriy Borisovich
• Sinha Prosenjit
• Pawale Vipul
• Inavolu Jaya Rama Raju
• Mutha Manas Bhikchand
• Singh Pushpendra

Classifications

• G06F16/182 Primary

  Distributed file systems · CPC title

• G06F11/1464 Primary

  for networked environments · CPC title

• G06F2201/84

  Using snapshots, i.e. a logical point-in-time copy of the data · CPC title

• G06F11/2094

  Redundant storage or storage space (G06F11/2056 takes precedence) · CPC title

• G06F16/14

  Details of searching files based on file metadata · CPC title