Cluster-wide application consistency with volume group snapshot

Patent metadata

Field	Value
Publication number	US-12216545-B2
Application number	US-202217685628-A
Country	US
Kind code	B2
Filing date	Mar 3, 2022
Priority date	Mar 3, 2022
Publication date	Feb 4, 2025
Grant date	Feb 4, 2025

Abstract

Embodiments of a method for providing cluster-wide, application consistent operations in a distributed network by creating a single volume snapshot object on a server for all of volumes of a distributed application. A snapshot controller creates volume snapshot content for each volume, and an external snapshot process, upon creation of the volume snapshot content, creates a snapshot of each volume on a backend storage device, wherein all snapshots for each volume are created at the same time to ensure consistency across all volumes being snapshotted at a certain moment.

First claim

What is claimed is:

1. A computer-implemented method of providing cluster-wide, application consistent operations in a distributed network, comprising:
creating a single volume group snapshot object on a server for all of volumes of a plurality of distributed applications, wherein the applications are arranged by an application template into a nested sequence of applications and that suspends and restarts resources utilized by respective applications in a defined order;
defining a prehook and posthook annotation for each application, wherein the prehook and posthook annotation comprises a pair-ordered sequence dictating suspending and restarting the resources utilized by the respective application to ensure maintaining resource consistency during application operation and preventing a need of application quiescing during the suspending and restarting;
creating, by a snapshot controller, volume snapshot content for each volume;
creating, by an external snapshot process and upon creation of the volume snapshot content, a snapshot of each volume on a backend storage device, wherein all snapshots are created at the same time to ensure consistency across all volumes being snapshotted at a certain moment;
defining, for the snapshot process, an application template comprising a plurality of data fields including an application type field, an application label field specifying a label for all pods belonging to an application, and an actions field mapping actions performed on specific resource types and comprising pre-hook, post-hook, kind, and selectors subfields, wherein the selectors subfield specifies resources selected during a serialization phase of system operation for the volumes being snapshotted; and
processing the application template through a package manager component to execute the volume snapshotting and perform suspension and restart according to the prehook and posthook annotations, wherein an order of quiescing ensures application consistency of the cluster network across all the nodes in the cluster.

2. The method of claim 1 further comprising:
defining, for the application template, label selectors used by all resources of the application to select resources to be suspended during execution of the application and restarted after execution of the application;
marking the selected resources with the prehook and posthook annotations to signal a suspension time and restart time for each respective selected resource.

3. The method of claim 2 wherein the prehook and posthook annotations provide entry points for execution of appropriate program scripts to suspend and restart the respective resource during execution of the application.

4. The method of claim 3 wherein the respective resources are provided in a plurality of layers comprising an application-level top layer, a middle layer, and a node-level bottom layer.

5. The method of claim 4 wherein the top layer resources are suspended before and restarted after the middle and bottom layer resources, and the middle layer resources are suspended before and restarted after the bottom layer resources.

6. The method of claim 1 wherein the application comprises a multi-sharded database application.

7. The method of claim 6 wherein the network comprises a Kubernetes cluster having a controller, an application program interface (API) server, and a data migration process.

8. The method of claim 7 wherein the prehook comprises quiescing the selected pods during application execution, and the posthook comprises unquiescing the selected pods after application execution.

9. The method of claim 7 wherein the application data comprises persistent volume data implemented as a Kubernetes PersistentVolume (PV) in the cluster.

Assignees

• Dell Products Lp

Inventors

• Hoang Phuong N
• Grandhi Sukarna
• Watson Thomas

Classifications

• G06F9/5033

  considering data affinity · CPC title

• G06F2201/84

  Using snapshots, i.e. a logical point-in-time copy of the data · CPC title

• G06F9/485

  Task life-cycle, e.g. stopping, restarting, resuming execution (G06F9/4881 takes precedence) · CPC title

• G06F9/461

  Saving or restoring of program or task context · CPC title

• G06F2201/815

  Virtual · CPC title