Efficient data storage by grouping similar data within a zone

Patent metadata

Field	Value
Publication number	US-12475041-B2
Application number	US-202217877737-A
Country	US
Kind code	B2
Filing date	Jul 29, 2022
Priority date	Oct 15, 2019
Publication date	Nov 18, 2025
Grant date	Nov 18, 2025

Abstract

A method of storing data is provided. The method includes receiving a plurality of data blocks provided to a hyperscaler system. The method also includes determining a corresponding property for each data block of the plurality of data blocks. The method further includes identifying a set of data blocks from the plurality of data blocks. Each data block of the set of data blocks is associated with a first property. The method further includes storing the set of data blocks in a first zone of a zoned storage system, based on the first property.

First claim

What is claimed is:

1 . A method, comprising:
receiving a plurality of data blocks to be stored in a storage system comprising a plurality of managed flash storage devices that offload management responsilities to a storage system controller; determining an estimation of corresponding longevities for the plurality of data blocks based on previous longevities of data blocks received from a sender of the plurality of data blocks; identifying a set of data blocks from the plurality of data blocks having matching longevity terms that are associated with the plurality of data blocks based on the estimation of the corresponding longevities; and storing the set of data blocks together into a first group of blocks of one or more of the plurality of managed flash storage devices.

2 . The method of claim 1 , further comprising:
in response to receiving the plurality of data blocks, storing the plurality of data blocks in a buffer of the storage system.

3 . The method of claim 2 , wherein storing the set of data blocks in the first group of blocks comprises:
moving the set of data blocks from the buffer of the storage system to the first group of blocks.

4 . The method of claim 1 , wherein the estimations of the corresponding longevities are determined using a machine learning model.

5 . The method of claim 1 , wherein the estimation of the corresponding longevities for the plurality of data blocks are determined based on metadata associated with the plurality of data blocks.

6 . The method of claim 1 , wherein the estimation of the corresponding longevities for the plurality of data blocks are determined based on reading a portion of data from the plurality of data blocks.

7 . The method of claim 1 , further comprising:
performing a garbage collection operation on the set of data blocks, wherein the first group of blocks is deleted during the garbage collection operation.

8 . The method of claim 7 , wherein:
the garbage collection is delayed until a threshold amount of data blocks in the first group of blocks are invalid; the delay is based on the corresponding estimated longevities of the first set of data blocks; and the delay allows a larger number of data blocks to become invalid.

9 . The method of claim 1 , further comprising:
identifying a second set of data blocks from the plurality of data blocks, wherein the second set of data blocks have matching longevity terms that are different than the longevity terms of the set of data blocks; and storing the second set of data blocks in a second group of blocks of the storage system.

10 . The method of claim 1 , wherein the sender of the plurality of blocks to be stored in the storage system is a hyperscaler system.

11 . A storage system comprising:
a plurality of managed flash storage devices; and a storage system controller operatively coupled to the plurality of managed flash storage devices, wherein the plurality of managed flash storage devices offload management responsibilities to the storage system controller and the storage system controller comprises a processing device configured to:
receive a plurality of data blocks to be stored in a storage system;
determine an estimation of corresponding longevities for the plurality of data blocks based on previous longevities of data blocks received from a sender of the plurality of data blocks;
identify a set of data blocks from the plurality of data blocks having matching longevity terms that are associated with the plurality of data blocks based on the estimation of the corresponding longevity; and
store the set of data blocks together into a first group of blocks of one or more of the plurality of managed flash storage devices.

12 . The storage system of claim 11 , wherein the processing device is further configured to:
in response to receiving the plurality of data blocks, store the plurality of data blocks in a buffer of the storage system.

13 . The storage system of claim 12 , wherein to store the set of data blocks in the first group of blocks, the processing device is further configured to:
move the set of data blocks from the buffer of the storage system to the first group of blocks.

14 . The storage system of claim 11 , wherein the estimations of the corresponding longevities are determined using a machine learning model.

15 . The storage system of claim 11 , wherein the estimation of the corresponding longevities for the plurality of data blocks are determined based on metadata associated with the plurality of data blocks.

16 . The storage system of claim 11 , wherein the estimation of the corresponding longevities for the plurality of data blocks are determined based on reading a portion of data from the plurality of data blocks.

17 . The storage system of claim 16 , wherein to read the portion of the data from the plurality of data blocks, the processing device is further to:
read one or more top bits of data from one or more of the plurality of data blocks.

18 . The storage system of claim 11 , wherein the processing device is further to:
perform a garbage collection operation on the set of data blocks, wherein the first group of blocks is deleted during the garbage collection operation.

19 . The storage system of claim 11 , wherein the processing device is further to:
identify a second set of data blocks from the plurality of data blocks, wherein the second set of data blocks have matching longevity terms that are different than the longevity terms of the set of data blocks; and store the second set of data blocks in a second group of blocks of the storage system.

20 . A non-transitory computer readable storage medium storing instructions, which when executed, cause a processing device of a storage system controller to:
receive a plurality of data blocks to be stored in a storage system comprising a plurality of managed flash storage devices that offload management responsibilities to the storage system controller; determining an estimation of corresponding longevities for the plurality of data blocks based on previous longevities of data blocks received from a sender of the plurality of data blocks; identifying a set of data blocks from the plurality of data blocks having matching longevity terms that are associated with the plurality of data blocks based on the estimation of the corresponding longevities; and storing the set of data blocks together into a first of one or more of the plurality of managed flash storage devices.

Assignees

• Pure Storage Inc

Inventors

• Mao Yuhong
• Karr Ronald

Classifications

• G06F3/0604

  Improving or facilitating administration, e.g. storage management · CPC title

• G06F3/0679

  Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP] · CPC title

• G06F3/0655

  Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices · CPC title

• G06F2212/7205

  Cleaning, compaction, garbage collection, erase control · CPC title

• G06F3/064

  Management of blocks · CPC title