Redundant and robust distributed deduplication data storage system

Patent metadata

Field	Value
Publication number	US-2017193003-A1
Application number	US-201615299299-A
Country	US
Kind code	A1
Filing date	Oct 20, 2016
Priority date	Dec 30, 2015
Publication date	Jul 6, 2017
Grant date	—

Abstract

Systems and methods are provided herein for automatically configuring newly installed secondary storage computing devices and managing secondary storage computing devices when one or more become unavailable. For example, a storage manager can then detect the computing resources available to the newly installed secondary storage computing device, assign a role to the newly installed secondary storage computing device based on the detected computing resources, configure the newly installed secondary storage computing device with deduplication and storage policies used by the other secondary storage computing devices, re-partition secondary storage devices to allocate memory for the newly installed secondary storage computing device, and instruct other secondary storage computing devices to replicate their managed data such that the newly installed secondary storage computing device has access to the replicated data.

First claim

What is claimed is:

1 . A networked information management system configured to automatically configure installed data storage computers, the networked information management system comprising:
a first data storage computer comprising computer hardware, wherein the first data storage computer is a first control node configured to manage first deduplication information stored in a first deduplication database and direct read and write requests to secondary nodes, and wherein the first data storage computer manages first data in a secondary storage device; a second data storage computer comprising computer hardware, wherein the second data storage computer is installed in the networked information management system after the first data storage computer; and a storage manager comprising computer hardware configured to:
detect that the second data storage computer is installed in the networked information management system,
determine whether the second data storage computer is a second control node or a first secondary node based on computing resources available to the second data storage computer,
partition the secondary storage device such that a first portion of the secondary storage device is assigned to the first data storage computer and a second portion of the secondary storage device is assigned to the second data storage computer, and
instruct the first data storage computer to replicate the first data and transmit the replicated first data to the second data storage computer for storage in the second portion of the secondary storage device.

2 . The networked information management system of claim 1 , wherein the first data storage computer is configured with a deduplication policy and a storage policy, and wherein the storage manager is further configured to configure the second data storage computer with the deduplication policy and the storage policy.

3 . The networked information management system of claim 1 , wherein the second data storage computer is the second control node, and wherein the storage manager is further configured to instruct the first data storage computer to replicate the first deduplication information and transmit the replicated first deduplication information to the second data storage computer for storage in a second deduplication database.

4 . The networked information management system of claim 3 , wherein the second deduplication database comprises a third portion allocated to the first data storage computer and a fourth portion allocated to the second data storage computer, and wherein the replicated first deduplication information is stored in the third portion of the second deduplication database.

5 . The networked information management system of claim 3 , wherein the replicated first deduplication information comprises at least one of a data block signature,
a storage location of a data block, or a count of a number of times the data block is used.

6 . The networked information management system of claim 1 , further comprising a third data storage computer comprising computer hardware, wherein the third data storage computer is a second secondary node, wherein a third portion of the secondary storage device is assigned to the third data storage computer, and wherein the third portion comprises the replicated first data and replicated second data corresponding to the second data storage computer.

7 . The networked information management system of claim 6 , wherein the second data storage computer is the first secondary node, wherein the second data storage computer is unavailable, and wherein the storage manager is further configured to:
receive a read request intended for the second data storage computer; and transmit the read request to the first data storage computer, wherein the first data storage computer routes the read request to the third data storage computer instead of the second data storage computer such that the third data storage computer can retrieve a portion of the replicated second data that corresponds with the read request.

8 . The networked information management system of claim 1 , wherein the second portion of the secondary storage device comprises a third portion allocated to the first data storage computer and a fourth portion allocated to the second data storage computer, and wherein the replicated first data is stored in the third portion.

9 . A computer-implemented method for automatically configuring installed data storage computers, the computer-implemented method comprising:
detecting that a first data storage computer is installed in a networked information management system, wherein the first data storage computer is a first control node configured to manage first deduplication information stored in a first deduplication database and direct read and write requests to secondary nodes, and wherein the first data storage computer manages first data in a secondary storage device; detecting that a second data storage computer is installed in the networked information management system, wherein the second data storage computer is installed in the networked information management system after the first data storage computer; determining whether the second data storage computer is a second control node or a first secondary node based on computing resources available to the second data storage computer; partitioning the secondary storage device such that a first portion of the secondary storage device is assigned to the first data storage computer and a second portion of the secondary storage device is assigned to the second data storage computer; and instructing the first data storage computer to replicate the first data and transmit the replicated first data to the second data storage computer for storage in the second portion of the secondary storage device.

10 . The computer-implemented method of claim 9 , wherein the first data storage computer is configured with a deduplication policy and a storage policy, and wherein the computer-implemented method further comprises configuring the second data storage computer with the deduplication policy and the storage policy.

11 . The computer-implemented method of claim 9 , wherein the second data storage computer is the second control node, and wherein the computer-implemented method further comprises instructing the first data storage computer to replicate the first deduplication information and transmit the replicated first deduplication information to the second data storage computer for storage in a second deduplication database.

12 . The computer-implemented method of claim 11 , wherein the second deduplication database comprises a third portion allocated to the first data storage computer and a fourth portion allocated to the second data storage computer, and wherein the replicated first deduplication information is stored in the third portion of the second deduplication database.

13 . The computer-implemented method of claim 11 , wherein the replicated first deduplication information comprises at least one of a data block signature, a storage location of a data block, or a count of a number of times the data block is used.

14 . The computer-implemented method of claim 9 , wherein a third data storage computer is a second secondary node, wherein a third portion of the secondary storage device is assigned to the third data storage computer, and wherein the third portion comprises the replicated first data and replicated second data corresponding to the second data storage computer.

15 . The computer-implemented method of claim 14 , wherein the second data storage compute

Assignees

• Commvault Systems Inc

Inventors

• Vijayan Manoj Kumar
• Kochunni Jaidev Oppath
• Attarde Deepak Raghunath
• Ankireddypalle Ramachandra Reddy

Classifications

• G06F16/27

  Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor · CPC title

• G06F2201/815

  Virtual · CPC title

• G06F11/2094

  Redundant storage or storage space (G06F11/2056 takes precedence) · CPC title

• G06F2201/82

  Solving problems relating to consistency · CPC title

• H04L67/1097 Primary

  for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS] · CPC title