Method, electronic device, and computer program product for managing file system

Patent metadata

Field	Value
Publication number	US-11663165-B2
Application number	US-202017077010-A
Country	US
Kind code	B2
Filing date	Oct 22, 2020
Priority date	Sep 29, 2020
Publication date	May 30, 2023
Grant date	May 30, 2023

Abstract

A method, an electronic device, and a computer program product for managing a file system are provided. For example, the method comprises causing multiple data blocks to be written to a storage space of the file system, the size of each of the multiple data blocks being not lower than a threshold size, and creating at least one space fragment in the storage space, the size of each of the at least one space fragment not exceeding the threshold size. Therefore, this solution can quickly and efficiently age a file system.

First claim

What is claimed is:

1. A method for managing a file system comprising:
causing multiple data blocks to be written to a storage space of the file system, a size of each of the multiple data blocks being greater than or equal to a threshold size; and
causing creation of space fragments in the storage space, the size of each of the space fragments not exceeding the threshold size, the space fragments comprising discontinuous spaces in the storage space;
wherein the space fragments are created based on:
repeatedly compressing a plurality of given written data blocks to a target size not exceeding the threshold size so that data cannot be further written to the created plurality of space fragments thereby aging the file system for performing a test of the aged file system through a plurality of test cases, wherein each of the repeated compressing is performed at a different compression rate;
wherein the created plurality of space fragments do not comprise compressed data blocks; and
wherein repeatedly compressing given written data blocks comprises:
compressing a first data block of the multiple data blocks at a first compression rate to obtain a first compressed data block;
writing the first compressed data block to a first subspace in the storage space;
removing the first compressed data block from the first subspace;
compressing the first compressed data block at a second compression rate to obtain a second compressed data block, the first compression rate being less than the second compression rate; and
writing the second compressed data block to the first subspace to create a first space fragment.

2. The method according to claim 1 , further comprising:
writing a second data block of the multiple data blocks to a second subspace in the storage space;
compressing a third data block of the multiple data blocks at a third compression rate to obtain a third compressed data block; and
writing the third compressed data block to a third subspace in the storage space, the size of the second data block being greater than that of the third data block, and the second subspace and the third subspace being not adjacent.

3. The method according to claim 2 , further comprising:
removing the second data block from the second subspace;
compressing the third compressed data block at a fourth compression rate to obtain a fourth compressed data block, the fourth compression rate being less than the third compression rate; and
writing the fourth compressed data block to the second subspace.

4. The method according to claim 3 , further comprising:
causing the third compressed data block to be removed from the third subspace.

5. The method according to claim 1 , further comprising:
determining the performance of the file system after the space fragments are created, the performance including at least one of: a response time of the file system; an average bandwidth for the file system to read/write data; the number of read and write operations performed by the file system per second; and a failure rate of the file system.

6. An electronic device for managing a file system comprising:
at least one processing unit; and
at least one memory which is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit, wherein the instructions, when executed by the at least one processing unit, cause the electronic device to perform actions comprising:
causing multiple data blocks to be written to a storage space of the file system, a size of each of the multiple data blocks being greater than or equal to a threshold size; and
causing creation of space fragments in the storage space, the size of each of the space fragments not exceeding the threshold size, the space fragments comprising discontinuous spaces in the storage space;
wherein the space fragments are created based on:
repeatedly compressing a plurality of given written data blocks to a target size not exceeding the threshold size so that data cannot be further written to the created plurality of space fragments thereby aging the file system for performing a test of the aged file system through a plurality of test cases, wherein each of the repeated compressing is performed at a different compression rate;
wherein the created plurality of space fragments do not comprise compressed data blocks; and
wherein repeatedly compressing given written data blocks comprises:
compressing a first data block of the multiple data blocks at a first compression rate to obtain a first compressed data block;
writing the first compressed data block to a first subspace in the storage space;
removing the first compressed data block from the first subspace;
compressing the first compressed data block at a second compression rate to obtain a second compressed data block, the first compression rate being less than the second compression rate; and
writing the second compressed data block to the first subspace to create a first space fragment.

7. The electronic device according to claim 6 , wherein the size of each of the multiple data blocks is a preset size.

8. The electronic device according to claim 6 , further comprising:
writing a second data block of the multiple data blocks to a second subspace in the storage space;
compressing a third data block of the multiple data blocks at a third compression rate to obtain a third compressed data block; and
writing the third compressed data block to a third subspace in the storage space, the size of the second data block being greater than that of the third data block, and the second subspace and the third subspace being not adjacent.

9. The electronic device according to claim 8 , further comprising:
removing the second data block from the second subspace;
compressing the third compressed data block at a fourth compression rate to obtain a fourth compressed data block, the fourth compression rate being less than the third compression rate; and
writing the fourth compressed data block to the second subspace.

10. The electronic device according to claim 9 , further comprising:
causing the third compressed data block to be removed from the third subspace.

11. The electronic device according to claim 6 , further comprising:
determining the performance of the file system after the space fragments are created, the performance including at least one of: a response time of the file system; an average bandwidth for the file system to read/write data; the number of read and write operations performed by the file system per second; and a failure rate of the file system.

12. A computer program product tangibly stored in a non-transitory computer-readable medium and including machine-executable instructions for managing a file system, wherein the machine-executable instructions, when executed, cause a machine to perform steps of:
causing multiple data blocks to be written to a storage space of the file system, a size of each of the multiple data blocks being greater than or equal to a threshold size; and
causing creation of space fragments in the storage space, the size of each of the space fragments not exceeding the threshold size, the space fragments comprising discontinuous spaces in the storage space;
wherein the space fragments are created based on:
repeatedly compressing a plurality of given written data blocks to a target size not exceeding the threshold size so that data cannot be further written to the created plurality of space fragments thereby aging the file system for performing a test of the aged file system through a plurality of test cases, wherein each of the repeated compressing is performed at a different com

Assignees

• Emc Ip Holding Co Llc

Inventors

• Zhao Chaojun
• Huang Jia
• Zeng Hongyuan
• Wang Hao
• Luo Mingyi

Classifications

• G06F3/0604

  Improving or facilitating administration, e.g. storage management · CPC title

• G06F16/1744 Primary

  using compression, e.g. sparse files · CPC title

• G06F3/064

  Management of blocks · CPC title

• G06F3/0673

  Single storage device · CPC title

• G06F16/1752

  based on file chunks · CPC title