Automatic file system capacity management using file system utilization prediction

Patent metadata

Field	Value
Publication number	US-12147390-B2
Application number	US-202217945608-A
Country	US
Kind code	B2
Filing date	Sep 15, 2022
Priority date	Sep 8, 2022
Publication date	Nov 19, 2024
Grant date	Nov 19, 2024

Abstract

Automatic file system capacity management techniques are provided using file system utilization prediction. One method comprises obtaining input data representing a utilization of a storage capacity of a file system of a given storage system; predicting a future utilization of the storage capacity of the file system based on a portion of the obtained input data; and automatically adjusting the storage capacity of the file system based at least in part on a result of a comparison of the predicted utilization of the storage capacity to a current utilization of the storage capacity. The comparison of the predicted utilization to a current utilization of the storage capacity may comprise comparing the current utilization of the storage capacity to the predicted utilization of the storage capacity for at least first and second time periods following a current time period to determine a trend of the utilization of the storage capacity.

First claim

What is claimed is:

1. A method, comprising:
obtaining input data representing a utilization of a storage capacity of a file system of a given storage system;
predicting a future utilization of the storage capacity of the file system of the given storage system for one or more time periods based at least in part on at least a portion of the obtained input data;
automatically adjusting the storage capacity of the file system of the given storage system based at least in part on a result of a comparison of the predicted future utilization of the storage capacity to a current utilization of the storage capacity, wherein a size of the storage capacity of the file system is extended by a first extension amount in response to the predicted future utilization of the storage capacity for a second time period exceeding a predicted future utilization of the storage capacity for a first time period and the predicted future utilization of the storage capacity for the first time period exceeding the current utilization of the storage capacity; and
storing one or more objects in the file system of the given storage system, during at least one of the one or more time periods, using the adjusted storage capacity;
wherein the method is performed by at least one processing device comprising a processor coupled to a memory.

2. The method of claim 1 , wherein the prediction is performed using a trained long short-term memory network.

3. The method of claim 2 , wherein a Bayesian optimization is performed to tune one or more hyperparameters of a long short-term memory network to obtain the trained long short-term memory network.

4. The method of claim 1 , wherein the one or more time periods correspond to a multiple step time window.

5. The method of claim 1 , wherein the first and second time periods follow a current time period, and wherein the comparison determines a trend of the utilization of the storage capacity of the file system.

6. The method of claim 5 , wherein a size of the storage capacity of the file system is reduced by a first reduction amount in response to (i) the current utilization of the storage capacity for the current time period exceeding the predicted future utilization of the storage capacity for the first time period and (ii) the predicted future utilization of the storage capacity for the first time period exceeding the predicted future utilization of the storage capacity for the second time period.

7. The method of claim 6 , wherein the size of the storage capacity of the file system is reduced by a second reduction amount in response to (i) the predicted future utilization of the storage capacity for the second time period exceeding the predicted future utilization of the storage capacity for the first time period and (ii) the current utilization of the storage capacity for the current time period exceeding the predicted future utilization of the storage capacity for the second time period, wherein the second reduction amount is less than the first reduction amount.

8. The method of claim 1 , wherein the extension of the storage capacity of the file system by the first extension amount is not performed in response to (a) a difference between (i) a current allocated storage capacity for the current time period and (ii) a predicted future utilization of the storage capacity for the first time period being less than a first gap threshold; and (b) the difference between (i) the current allocated storage capacity for the current time period and (ii) the predicted future utilization of the storage capacity for the first time period being above a second gap threshold.

9. The method of claim 1 , wherein the size of the storage capacity of the file system is extended by a second extension amount in response to (i) the predicted future utilization of the storage capacity for the first time period exceeding the current utilization of the storage capacity for the current time period and (ii) the predicted future utilization of the storage capacity for the first time period exceeding the predicted future utilization of the storage capacity for the second time period, wherein the second extension amount is less than the first extension amount.

10. An apparatus comprising:
at least one processing device comprising a processor coupled to a memory;
the at least one processing device being configured to implement the following steps:
obtaining input data representing a utilization of a storage capacity of a file system of a given storage system;
predicting a future utilization of the storage capacity of the file system of the given storage system for one or more time periods based at least in part on at least a portion of the obtained input data;
automatically adjusting the storage capacity of the file system of the given storage system based at least in part on a result of a comparison of the predicted future utilization of the storage capacity to a current utilization of the storage capacity, wherein a size of the storage capacity of the file system is extended by a first extension amount in response to the predicted future utilization of the storage capacity for a second time period exceeding a predicted future utilization of the storage capacity for a first time period and the predicted future utilization of the storage capacity for the first time period exceeding the current utilization of the storage capacity; and
storing one or more objects in the file system of the given storage system, during at least one of the one or more time periods, using the adjusted storage capacity.

11. The apparatus of claim 10 , wherein the prediction is performed using a trained long short-term memory network and wherein a Bayesian optimization is performed to tune one or more hyperparameters of a long short-term memory network to obtain the trained long short-term memory network.

12. The apparatus of claim 10 , wherein the first and second time periods follow a current time period, and wherein the comparison determines a trend of the utilization of the storage capacity of the file system.

13. The apparatus of claim 12 , wherein the size of the storage capacity of the file system is extended by a second extension amount in response to (i) the predicted future utilization of the storage capacity for the first time period exceeding the current utilization of the storage capacity for the current time period and (ii) the predicted future utilization of the storage capacity for the first time period exceeding the predicted future utilization of the storage capacity for the second time period, wherein the second extension amount is less than the first extension amount.

14. The apparatus of claim 12 , wherein a size of the storage capacity of the file system is reduced by a first reduction amount in response to (i) the current utilization of the storage capacity for the current time period exceeding the predicted future utilization of the storage capacity for the first time period and (ii) the predicted future utilization of the storage capacity for the first time period exceeding the predicted future utilization of the storage capacity for the second time period, and wherein the size of the storage capacity of the file system is reduced by a second reduction amount in response to (i) the predicted future utilization of the storage capacity for the second time period exceeding the predicted future utilization of the storage capacity for the first time period and (ii) the current utilization of the storage capacity for the current time period exceeding the predicted future utilization of the storage capacity for the second time period, wherein the second reduction amount is

Assignees

• Dell Products Lp

Inventors

• Zhang Yang
• Liang Shuangshuang
• Zhao Allen
• Wang Jingyi

Classifications

• G06F16/13

  File access structures, e.g. distributed indices (arrangements of input from, or output to, record carriers G06F3/06) · CPC title

• G06F16/183

  Provision of network file services by network file servers, e.g. by using NFS, CIFS (network file access protocols H04L67/1097) · CPC title

• G06N3/08 Primary

  Learning methods · CPC title

• G06F16/1727 Primary

  Details of free space management performed by the file system (saving storage space on storage systems G06F3/0608; management of blocks in storage devices G06F3/064) · CPC title