Orchestration of unmap requests received from write cache instances of a distributed storage system

Patent metadata

Field	Value
Publication number	US-12373342-B2
Application number	US-202318471680-A
Country	US
Kind code	B2
Filing date	Sep 21, 2023
Priority date	Sep 21, 2023
Publication date	Jul 29, 2025
Grant date	Jul 29, 2025

Abstract

An apparatus comprises at least one processing device configured to receive unmap requests for freeing up data previously written to one or more storage regions of at least one storage device of a distributed storage system, the unmap requests being received from two or more write cache instances of two or more storage nodes of the distributed storage system. The processing device is also configured to identify at least a subset of the unmap requests which are directed to a given storage region of the at least one storage device. The processing device is further configured to provide the subset of the unmap requests to at least one storage controller associated with the at least one storage device of the distributed storage system responsive to determining that at least one designated unmap condition has been met.

First claim

What is claimed is:

1. An apparatus comprising:
at least one processing device comprising a processor coupled to a memory;
the at least one processing device being configured:
to receive a plurality of unmap requests for freeing up data previously written to one or more storage regions of at least one storage device of a distributed storage system, the plurality of unmap requests being received from two or more write cache instances of two or more storage nodes of the distributed storage system;
to identify at least a subset of the plurality of unmap requests which are directed to a given one of the one or more storage regions of the at least one storage device;
to determine, for the given storage region, whether at least one designated unmap condition has been met; and
to provide the subset of the plurality of unmap requests to at least one storage controller associated with the at least one storage device of the distributed storage system responsive to determining that the at least one designated unmap condition has been met.

2. The apparatus of claim 1 wherein the distributed storage system comprises a scale-out storage system.

3. The apparatus of claim 1 wherein the at least one storage device comprises one of a plurality of storage devices of the two or more storage nodes of the distributed storage system providing backend storage capacity for the two or more write cache instances.

4. The apparatus of claim 1 wherein the at least one storage device comprises a solid state drive of one of the two or more storage nodes of the distributed storage system.

5. The apparatus of claim 1 wherein the plurality of unmap requests is part of two or more un-synchronized write-cache write streams received from the two or more write cache instances of the two or more storage nodes of the distributed storage system.

6. The apparatus of claim 1 wherein the given storage region comprises a reclaim unit, and wherein the subset of the plurality of unmap requests which are directed to the given storage region are identified based at least in part on reclaim unit handle identifiers associated with the subset of the plurality of unmap requests.

7. The apparatus of claim 1 wherein data is written to the given storage region sequentially.

8. The apparatus of claim 7 wherein each of the plurality of unmap requests comprises metadata specifying a timestamp at which a portion of data was previously written to a corresponding one of the one or more storage regions of the at least one storage device.

9. The apparatus of claim 8 wherein identifying the subset of the plurality of unmap requests which are directed to the given storage region is based at least in part on the timestamps of the plurality of unmap requests.

10. The apparatus of claim 1 wherein the at least one designated unmap condition comprises determining that the subset of the plurality of unmap requests frees up at least a designated threshold amount of a total capacity of the given storage region.

11. The apparatus of claim 1 wherein the at least one designated unmap condition comprises detecting that at least a designated threshold amount of time has passed since a most recent one of the plurality of unmap requests directed to the given storage region.

12. The apparatus of claim 1 wherein the given storage region is associated with a given reclaim unit handle identifier, wherein the at least one designated unmap condition comprises determining that at least a threshold number of unmap requests have been received which are directed to another one of the one or more storage regions also associated with the given reclaim unit handle identifier, and wherein data is written to the given storage region and the other one of the one or more storage regions sequentially.

13. The apparatus of claim 1 wherein the given storage region is associated with a given reclaim unit handle identifier, wherein the at least one designated unmap condition comprises determining that at least another subset of the plurality of unmap requests frees up at least a designated threshold amount of a total capacity of another one of the one or more storage regions, and wherein data is written to the given storage region and the other one of the one or more storage regions sequentially.

14. The apparatus of claim 1 wherein determining whether the at least one designated unmap condition has been met is performed responsive to identifying that an amount of unused capacity of the given storage region is less than a designated capacity threshold.

15. A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device:
to receive a plurality of unmap requests for freeing up data previously written to one or more storage regions of at least one storage device of a distributed storage system, the plurality of unmap requests being received from two or more write cache instances of two or more storage nodes of the distributed storage system;
to identify at least a subset of the plurality of unmap requests which are directed to a given one of the one or more storage regions of the at least one storage device;
to determine, for the given storage region, whether at least one designated unmap condition has been met; and
to provide the subset of the plurality of unmap requests to at least one storage controller associated with the at least one storage device of the distributed storage system responsive to determining that the at least one designated unmap condition has been met.

16. The computer program product of claim 15 wherein data is written to the given storage region sequentially, wherein each of the plurality of unmap requests comprises metadata specifying a timestamp at which a portion of data was previously written to a corresponding one of the one or more storage regions of the at least one storage device, and wherein identifying the subset of the plurality of unmap requests which are directed to the given storage region is based at least in part on the timestamps of the plurality of unmap requests.

17. The computer program product of claim 15 wherein the at least one designated unmap condition comprises determining that the subset of the plurality of unmap requests frees up at least a designated threshold amount of a total capacity of the given storage region.

18. A method comprising:
receiving a plurality of unmap requests for freeing up data previously written to one or more storage regions of at least one storage device of a distributed storage system, the plurality of unmap requests being received from two or more write cache instances of two or more storage nodes of the distributed storage system;
identifying at least a subset of the plurality of unmap requests which are directed to a given one of the one or more storage regions of the at least one storage device;
determining, for the given storage region, whether at least one designated unmap condition has been met; and
providing the subset of the plurality of unmap requests to at least one storage controller associated with the at least one storage device of the distributed storage system responsive to determining that the at least one designated unmap condition has been met;
wherein the method is performed by at least one processing device comprising a processor coupled to a memory.

19. The method of claim 18 wherein data is written to the given storag

Assignees

• Dell Products Lp

Inventors

• Tal Doron
• Shatsky Yosef
• Aiouaz Ali
• Alkalay Amitai

Classifications

• G06F12/0253 Primary

  Garbage collection, i.e. reclamation of unreferenced memory · CPC title