Autonomous container group management for scale out deduplication system

Patent metadata

Field	Value
Publication number	US-9626253-B1
Application number	US-201414316636-A
Country	US
Kind code	B1
Filing date	Jun 26, 2014
Priority date	Jun 26, 2014
Publication date	Apr 18, 2017
Grant date	Apr 18, 2017

Abstract

A method for data container group management in a deduplication system is provided. The method includes arranging a plurality of data container groups according to a plurality of file systems. A subset of the plurality of data container groups correspond to each of the plurality of file systems, each of the plurality of data container groups having a reference database, a plurality of data containers, and a data container group identifier (ID). The method includes performing a first backup process for a first client-policy pair with deduplication via a first one of the plurality of data container groups and performing a second backup process for a second client-policy pair with deduplication via a second one of the plurality of data container groups.

First claim

What is claimed is:

1. A method for data container group management in a deduplication system, comprising:
arranging a plurality of data container groups according to a plurality of file systems, a subset of the plurality of data container groups corresponding to each of the plurality of file systems, each of the plurality of data container groups having a reference database, a plurality of data containers, and a data container group identifier (ID);
performing a first backup process for a first client-policy pair with deduplication via a first one of the plurality of data container groups;
performing a second backup process for a second client-policy pair with deduplication via a second one of the plurality of data container groups;
moving one of the plurality of data container groups from a first one of the plurality of file systems to a second one of the plurality of file systems; and
updating a data container group location map in accordance with the moving, wherein at least one method operation is performed by a processor.

2. The method of claim 1 , wherein:
the first backup process and the second backup process are performed in parallel;
performing the first backup process includes updating the reference database of the first one of the plurality of data container groups; and
performing the second backup process includes updating the reference database of the second one of the plurality of data container groups.

3. The method of claim 1 , further comprising:
building a data container group location map, based on a compute node indicating a plurality of file systems;
adding to the data container group location map, based on each one of the plurality of file systems indicating a subset of the plurality of data container groups corresponding to the one of the plurality of file systems; and
adding to the data container group location map, based on each one of the plurality of data container groups indicating, via the reference database of the one of the plurality of data container groups, which of a plurality of client-policy pairs correspond to the one of the plurality of data container groups having a corresponding data container group ID, wherein the data container group location map associates data sources of the plurality of client-policy pairs into the plurality of file systems and a plurality of data container group IDs, wherein the first backup process and the second backup process proceed according to the data container group location map.

4. The method of claim 1 , further comprising:
building a data container group location map, based on a central node indicating a plurality of compute nodes;
adding to the data container group location map, based on each of the plurality of compute nodes indicating a plurality of file systems;
adding to the data container group location map, based on each one of the plurality of file systems indicating a subset of the plurality of data container groups corresponding to the one of the plurality of file systems; and
adding to the data container group location map, based on each one of the plurality of data container groups indicating, via the reference database of the one of the plurality of data container groups, which of a plurality of client-policy pairs correspond to the one of the plurality of data container groups having a corresponding data container group ID, wherein the data container group location map associates data sources of client-policy pairs into the plurality of file systems and a plurality of data container group IDs, wherein performing the first backup process and performing the second backup process proceed according to the data container group location map.

5. The method of claim 1 , further comprising:
tracking, via a data container group location map, which non-full one of the plurality of data container groups is used by the first client-policy pair;
performing a third backup process, for the first client-policy pair, with deduplication via the non-full one of the plurality of data container groups.

6. The method of claim 1 , further comprising:
adding a data container group, corresponding to a subdirectory of one of the plurality of file systems;
naming the subdirectory with a data container group ID of the added data container group; and
updating a data container group location map, based on the adding.

7. A tangible, non-transitory, computer-readable media having instructions thereupon which, when executed by a processor, cause the processor to perform actions comprising:
performing a first backup process for a first client-policy pair with deduplication via a first one of a plurality of data container groups, wherein the first one of the plurality of data container groups is in a first subdirectory that is named with a first data container group identifier (ID) and is under a first file system;
performing a second backup process for a second client-policy pair with deduplication via a second one of a plurality of data container groups, wherein the second one of the plurality of data container groups is in a second subdirectory that is named with a second data container group ID and is under a second file system;
moving one of the plurality of data container groups from the first file system to the second file system; and
updating a data container group location map in accordance with the moving.

8. The computer-readable media of claim 7 , wherein:
performing the first backup process includes updating a first reference database associated with the first data container group ID;
performing the second backup process includes updating a second reference database associated with the second data container group ID;
data storing for the first backup process and data storing for the second backup process are performed in parallel; and
updating the first reference database and updating the second reference database are performed in parallel.

9. The computer-readable media of claim 7 , wherein the actions further comprise:
generating a data container group location map, based at least on the first subdirectory, a first reference database of the first one of the plurality of data container groups, the second subdirectory, and a second reference database of the second one of the plurality of data container groups.

10. The computer-readable media of claim 7 , wherein the actions further comprise:
reading data from a one of the plurality of data container groups under one of a plurality of file systems;
establishing the one of the plurality of data container groups under a differing one of the plurality of file systems;
writing the data from the one of the plurality of data container groups under the one of the plurality of file systems into the established one of the plurality of data container groups under the differing one of the plurality of file systems; and
updating a data container group location map based on moving the one of the plurality of data container groups from under the one of the plurality of file systems to under the differing one of the plurality of file systems.

11. The computer-readable media of claim 7 , wherein the actions further comprise:
adding a data container group to a subdirectory named for the data container group; and
adding a record to a data container group location map, based on the adding the data container group.

12. The computer-readable media of claim 7 , wherein the actions further comprise:
removing a data container group from a subdirectory named for the data container group;
deleting the subdirectory named for the data container group; and
removing a record pertaining to the data container group from a data container group

Assignees

• Symantec Corp
• Veritas Technologies Llc

Inventors

• Zhang Xianbo
• She Haibin
• Wang Haigang

Classifications

• G06F11/1458 Primary

  Management of the backup or restore process · CPC title

• G06F11/1453

  using de-duplication of the data · CPC title

• G06F2201/80

  Database-specific techniques · CPC title

• G06F2201/83

  the solution involving signatures · CPC title