Distribution of copies of metadata associated with processing groups among storage nodes of a data storage system

Patent metadata

Field	Value
Publication number	US-12367216-B2
Application number	US-202318505337-A
Country	US
Kind code	B2
Filing date	Nov 9, 2023
Priority date	Nov 9, 2023
Publication date	Jul 22, 2025
Grant date	Jul 22, 2025

Abstract

An apparatus comprises at least one processing device configured to determine a given portion of metadata associated with a given one of a plurality of processing groups, the given processing group being assigned to a given one of a plurality of storage nodes of a data storage system. The at least one processing device is also configured to generate two or more copies of the given portion of the metadata, and to select two or more of the plurality of storage nodes of the data storage system on which to store the two or more copies, the two or more storage nodes being selected based at least in part on the assignment of the given processing group to the given storage node. The at least one processing device is further configured to store the two or more copies of on the selected two or more storage nodes.

First claim

What is claimed is:

1. An apparatus comprising:
at least one processing device comprising a processor coupled to a memory;
the at least one processing device being configured:
to determine a given portion of metadata associated with a given one of a plurality of processing groups, the given processing group being assigned to a given one of a plurality of storage nodes of a data storage system;
to generate two or more copies of the given portion of the metadata associated with the given processing group;
to select two or more of the plurality of storage nodes of the data storage system on which to store the two or more copies of the given portion of the metadata associated with the given processing group, wherein the two or more storage nodes are selected based at least in part on the assignment of the given processing group to the given storage node;
to store the two or more copies of the given portion of the metadata associated with the given processing group on the selected two or more storage nodes; and
to re-assign the given processing group from the given storage node to another one of the plurality of storage nodes of the data storage system, the other storage node being selected based at least in part on which of the plurality of storage nodes of the data storage system are selected to store the two or more copies of the given portion of the metadata associated with the given processing group.

2. The apparatus of claim 1 wherein the given storage node is one of the selected two or more storage nodes.

3. The apparatus of claim 1 wherein the two or more storage nodes are further selected based at least in part on one or more preferred failover locations for the given processing group.

4. The apparatus of claim 1 wherein the two or more storage nodes are further selected based at least in part on storage capacity of the plurality of storage nodes of the data storage system.

5. The apparatus of claim 1 wherein determining the given portion of the metadata associated with the given processing group is based at least in part on a mapping of a metadata storage container identifier with an identifier of the given processing group.

6. The apparatus of claim 1 wherein determining the given portion of the metadata associated with the given processing group is based at least in part on flags distinguishing the metadata from data stored in the data storage system.

7. The apparatus of claim 1 wherein a given one of the two or more copies of the given portion of the metadata associated with the given processing group is stored on a single one of the plurality of storage nodes of the data storage system.

8. The apparatus of claim 1 wherein a given one of the two or more copies of the given portion of the metadata associated with the given processing group is distributed across two or more storage devices of a single one of the plurality of storage nodes of the data storage system.

9. The apparatus of claim 1 wherein the at least one processing device is further configured:
responsive to determining that the given processing group is to be re-assigned from the given storage node to the other storage node, to determine whether any of the two or more copies of the given portion of the metadata associated with the given processing group is stored on the other storage node; and
responsive to determining that none of the two or more copies of the given portion of the metadata associated with the given processing group are stored on the other storage node, to move a given one of the two or more copies of the given portion of the metadata associated with the given processing group to the other storage node.

10. The apparatus of claim 9 wherein the given copy of the given portion of the metadata associated with the given processing group is moved to the other storage node prior to movement of the given processing group from the given storage node to the other storage node.

11. The apparatus of claim 1 wherein re-assigning the given processing group is responsive to detecting failure of the given storage node, and wherein re-assigning the given processing group comprises deploying the given processing group on the other storage node.

12. The apparatus of claim 11 wherein the other storage node is one of the selected two or more storage nodes of the data storage system on which the two or more copies of the given portion of the metadata associated with the given processing group are stored.

13. The apparatus of claim 1 wherein the data storage system utilizes a disaggregated architecture comprising a processing layer and a storage layer each distributed across two or more of the plurality of storage nodes of the data storage system.

14. A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device:
to determine a given portion of metadata associated with a given one of a plurality of processing groups, the given processing group being assigned to a given one of a plurality of storage nodes of a data storage system;
to generate two or more copies of the given portion of the metadata associated with the given processing group;
to select two or more of the plurality of storage nodes of the data storage system on which to store the two or more copies of the given portion of the metadata associated with the given processing group, wherein the two or more storage nodes are selected based at least in part on the assignment of the given processing group to the given storage node;
to store the two or more copies of the given portion of the metadata associated with the given processing group on the selected two or more storage nodes; and
to re-assign the given processing group from the given storage node to another one of the plurality of storage nodes of the data storage system, the other storage node being selected based at least in part on which of the plurality of storage nodes of the data storage system are selected to store the two or more copies of the given portion of the metadata associated with the given processing group.

15. The computer program product of claim 14 wherein the given storage node is one of the selected two or more storage nodes.

16. The computer program product of claim 14 wherein the two or more storage nodes are further selected based at least in part on one or more preferred failover locations for the given processing group.

17. A method comprising:
determining a given portion of metadata associated with a given one of a plurality of processing groups, the given processing group being assigned to a given one of a plurality of storage nodes of a data storage system;
generating two or more copies of the given portion of the metadata associated with the given processing group;
selecting two or more of the plurality of storage nodes of the data storage system on which to store the two or more copies of the given portion of the metadata associated with the given processing group, wherein the two or more storage nodes are selected based at least in part on the assignment of the given processing group to the given storage node;
storing the two or more copies of the given portion of the metadata associated with the given processing group on the selected two or more storage nodes; and
re-assigning the given processing group from the given storage node to another one of the plurality of storage nodes of the data storage system, the other storage node being

Assignees

• Dell Products Lp

Inventors

• Shatsky Yosef
• Tal Doron

Classifications

• G06F16/24573

  using data annotations, e.g. user-defined metadata · CPC title

• G06F16/278 Primary

  Data partitioning, e.g. horizontal or vertical partitioning · CPC title