Data storage method, device and computer program product

Patent metadata

Field	Value
Publication number	US-11620080-B2
Application number	US-202016994903-A
Country	US
Kind code	B2
Filing date	Aug 17, 2020
Priority date	Apr 27, 2020
Publication date	Apr 4, 2023
Grant date	Apr 4, 2023

Abstract

A technique involves determining, in redundant array of independent disks (RAID) stripes, source slices for restriping, and allocating, from a reserved capacity for file system check (FSCK), destination slices for restriping. The technique further involves performing restriping for the RAID stripes by copying data in the source slices into the destination slices. Accordingly, using the reserved capacity for FSCK as the destination slices for restriping may mitigate the influence on an available capacity of a mapper during restriping, thereby improving the performance of a storage system.

First claim

The invention claimed is:

1. A data storage method, comprising:
determining, in redundant array of independent disks (RAID) stripes, source slices for restriping;
allocating, by borrowing from a reserved capacity located in a plurality of disks, wherein the reserved capacity is reserved for use by a file system check that detects and repairs data failures in a file system at least in part by scanning the plurality of disks for storage addresses of files, destination slices for restriping; performing restriping for the RAID stripes by copying data in the source slices into the destination slices;
during execution of the restriping, marking the destination slices as used; and
initiating the file system check by
terminating the execution of the restriping,
in response to termination of the execution of the restriping, releasing the destination slices that were borrowed from the reserved capacity and marked as used, and
using the reserved capacity to perform the file system check for the storage system.

2. The method of claim 1 , wherein the determining the source slices for restriping comprises:
determining whether to split a RAID resilient set (RRS) based on a determination that a new disk is added into a storage pool; and
receiving a selection of the source slices for restriping across the RRS based on a determination that the RRS is to be split.

3. The method of claim 2 , wherein the determining the source slices for restriping further comprises:
merging the new disk into the RRS to generate a new RRS based on a determination that the RRS does not need to be split; and
receiving a selection of the source slices for restriping within the new RRS.

4. The method of claim 1 , further comprising during execution of the restriping,
keeping an available capacity of a mapper of a storage system unchanged.

5. The method of claim 4 , further comprising:
allocating, from a total capacity of the storage system, a capacity of a predetermined proportion as the reserved capacity for use by the file system consistency check, wherein the reserved capacity is unavailable to the mapper.

6. The method of claim 1 , further comprising:
wherein the initiating of the file system check for the storage system is performed in response to data failure during the execution of the restriping.

7. The method of claim 1 , further comprising:
determining whether the file system check for the storage system is completed;
re-initiating the execution of the restriping based on a determination that the file system check for the storage system is completed; and
updating information of the RAID stripes after the restriping is completed.

8. The method of claim 1 , wherein the reserved capacity is unavailable to a mapper that maintains a mapping between physical addresses and logical addresses, and wherein the logical addresses are exposed by the mapper to a namespace that creates a volume and exposes the volume to an external host.

9. An electronic device, comprising:
a processing unit; and
a memory coupled to the processing unit and storing instructions, wherein the instructions, when executed by the processing unit, perform the following actions:
determining, in redundant array of independent disks (RAID) stripes, source slices for restriping;
allocating, by borrowing from a reserved capacity located in a plurality of disks, wherein the reserved capacity is reserved for use by a file system check that detects and repairs data failures in a file system at least in part by scanning the plurality of disks for storage addresses of files, destination slices for restriping;

performing restriping for the RAID stripes by copying data in the source slices into the destination slices;
during execution of the restriping, marking the destination slices as used; and
initiating the file system check by
terminating the execution of the restriping,
in response to termination of the execution of the restriping, releasing the destination slices that were borrowed from the reserved capacity and marked as used, and
using the reserved capacity to perform the file system check for the storage system.

10. The device of claim 9 , wherein the determining the source slices for restriping comprises:
determining whether to split a RAID resilient set (RRS) based on a determination that a new disk is added into a storage pool; and
receiving a selection of the source slices for restriping across the RRS based on a determination that the RRS is to be split.

11. The device of claim 10 , wherein the determining the source slices for restriping further comprises:
merging the new disk into the RRS to generate a new RRS based on a determination that the RRS does not need to be split; and
receiving a selection of the source slices for restriping within the new RRS.

12. The device of claim 9 , further comprising during execution of the restriping,
keeping an available capacity of a mapper of a storage system unchanged.

13. The device of claim 12 , wherein the actions further comprise:
allocating, from a total capacity of the storage system, a capacity of a predetermined proportion as the reserved capacity that is reserved for use by the file system consistency check, wherein the reserved capacity is unavailable to the mapper.

14. The device of claim 9 , wherein the actions further comprise:
initiating the file system check for the storage system in response to data failure during the execution of the restriping.

15. The device of claim 9 , wherein the actions further comprise:
determining whether the file system check for the storage system is completed;
re-initiating the execution of the restriping based on a determination that the file system check for the storage system is completed; and
updating information of the RAID stripes after the restriping is completed.

16. A computer program product having a non-transitory computer readable medium which stores a set of instructions to perform data storage; the set of instructions, when carried out by computerized circuitry, causing the computerized circuitry to perform a method of:
determining, in redundant array of independent disks (RAID) stripes, source slices for restriping;
allocating, by borrowing from a reserved capacity located in a plurality of disks, wherein the reserved capacity is reserved for use by a file system check that detects and repairs data failures in a file system at least in part by scanning the plurality of disks for storage addresses of files, destination slices for restriping;
performing restriping for the RAID stripes by copying data in the source slices into the destination slices;
during execution of the restriping, marking the destination slices as used; and
initiating the file system check by
terminating the execution of the restriping,
in response to termination of the execution of the restriping, releasing the destination slices that were borrowed from the reserved capacity and marked as used, and
using the reserved capacity to perform the file system check for the storage system.

Assignees

• Emc Ip Holding Co Llc

Inventors

• Gao Jian
• Liu Yousheng
• Xu Xinlei

Classifications

• G06F3/0631

  by allocating resources to storage systems · CPC title

• G06F3/0689

  Disk arrays, e.g. RAID, JBOD · CPC title

• G06F3/0616

  in relation to life time, e.g. increasing Mean Time Between Failures [MTBF] · CPC title

• G06F3/0619 Primary

  in relation to data integrity, e.g. data losses, bit errors · CPC title

• G06F3/065

  Replication mechanisms · CPC title