Method, device, and program product for managing index of storage system

Patent metadata

Field	Value
Publication number	US-11966598-B2
Application number	US-202117246315-A
Country	US
Kind code	B2
Filing date	Apr 30, 2021
Priority date	Jan 27, 2021
Publication date	Apr 23, 2024
Grant date	Apr 23, 2024

Abstract

Indices of storage systems are managed. An example method includes: receiving a flush cycle for flushing expired events in a storage system including multiple events in a data stream, determining, based on the flush cycle, a time slice for managing the index of the storage system, creating a slice index node for the time slice in response to determining that the occurrence time of a first event that enters the storage system in the data stream is within the time slice, wherein the slice index node includes an index node of the first event, and adding the slice index node to the index. A corresponding device and a corresponding computer program product are provided. Thus, the index of a large number of events entering the storage system is managed according to the occurrence time of the events, and the storage system can be searched and updated accurately and effectively.

First claim

What is claimed is:

1. A method, comprising:
receiving, by a system comprising a processor, a flush cycle for a flushing of expired events in a storage system, wherein the storage system comprises multiple events in a data stream, and wherein the flush cycle comprises a first amount of time that elapses between iterations of performing the flushing of the expired events in the storage system;
determining, based on the first amount of time, a time slice that comprises a second amount of time, wherein a slice index node is configured to store indications of events that occur during the second amount of time within an index of the storage system;
creating the slice index node for the time slice in response to determining that a first occurrence time of a first event of the events that enters the storage system in the data stream corresponds to the second amount of time, wherein the slice index node comprises a first index node of the first event in the storage system;
adding the slice index node to the index of the storage system; and
storing the indications of the events that occur during a time period that corresponds to the second amount of time within the slice index node.

2. The method according to claim 1 , wherein creating the slice index node comprises:
dividing the time slice into multiple time windows according to a defined length of a time window;
creating a window index node for the time window in response to determining that the occurrence time of the first event is within one of the multiple time windows, wherein the window index node comprises the first index node of the first event in the storage system; and
adding the window index node to the slice index node.

3. The method according to claim 1 , further comprising: adding, in response to determining that a second occurrence time of a second event that enters the storage system in the data stream is within the time slice, a second index node of the second event in the storage system to the slice index node.

4. The method according to claim 3 , wherein adding the second index node of the second event in the storage system to the slice index node comprises:
creating the second index node of the second event in the storage system using a computing resource among multiple computing resources in the storage system; and
adding the second index node to the slice index node.

5. The method according to claim 1 , further comprising: determining, in response to determining that a current time exceeds the time slice and based on the current time and the flush cycle, another time slice usable to manage the index of the storage system, wherein the other time slice is adjacent to the time slice.

6. The method according to claim 5 , further comprising:
creating another slice index node for the other time slice in response to determining that a third occurrence time of a third event that enters the storage system in the data stream is within the other time slice, wherein the other slice index node comprises a third index of the third event in the storage system; and
adding the other slice index node to the index.

7. The method according to claim 5 , further comprising: marking a state of the slice index node as a read-only state.

8. The method according to claim 1 , further comprising:
searching, in response to receiving a searching request to search for events satisfying a specified time condition in the storage system, the index for a resulting slice index node corresponding to the specified time condition; and
acquiring the events satisfying the specified time condition based on the resulting slice index node.

9. The method according to claim 1 , further comprising:
receiving a validity period for events in the storage system;
removing, in response to determining that the time slice of the slice index node does not satisfy the validity period, events associated with the slice index node from the storage system; and
removing the slice index node from the index.

10. A device, comprising:
at least one processor; and
a memory coupled to the at least one processor, the memory having instructions stored therein, wherein the instructions, when executed by the at least one processor, cause the device to execute operations, comprising:
receiving a flush cycle for flushing expired events in the storage system, wherein a storage system comprises multiple events in a data stream;
determining, based on the flush cycle, a time slice that comprises an amount of time, wherein a slice index node is configured to store indications of events that occur during a time period indicated by the time slice within an index of the storage system;
creating the slice index node for the time slice in response to determining that a first occurrence time of a first event of the events that enters the storage system in the data stream is within the time slice, wherein the slice index node comprises a first index node of the first event in the storage system;
adding the slice index node to the index of the storage system;
storing the indications of the events that occur during the time period indicated by the time slice within the slice index node.

11. The device according to claim 10 , wherein creating the slice index node comprises:
dividing the time slice into multiple time windows according to a predetermined length of time window;
creating a window index node for a time window in response to determining that the first occurrence time of the first event is within one of the multiple time windows, wherein the window index node comprises the first index node of the first event in the storage system; and
adding the window index node to the slice index node.

12. The device according to claim 10 , wherein the operations further comprise: adding, in response to determining that a second occurrence time of a second event that enters the storage system in the data stream is within the time slice, a second index node of the second event in the storage system to the slice index node.

13. The device according to claim 12 , wherein adding the second index node of the second event in the storage system to the slice index node comprises:
creating the second index node of the second event in the storage system using a computing resource among multiple computing resources in the storage system; and
adding the second index node to the slice index node.

14. The device according to claim 10 , wherein the operations further comprise: determining, in response to determining that a current time exceeds the time slice and based on the current time and the flush cycle, another time slice for managing the index of the storage system, wherein the other time slice is adjacent to the time slice.

15. The device according to claim 14 , wherein the operations further comprise:
creating another slice index node for the other time slice in response to determining that a third occurrence time of a third event that enters the storage system in the data stream is within the other time slice, wherein the other slice index node comprises an associated index of the third event in the storage system; and
adding the other slice index node to the index.

16. The device according to claim 14 , wherein the operations further comprise: marking the slice index node with a read-only state.

17. The device according to claim 10 , wherein the operations further comprise:
searching, in response to receiving a searching request for searching for events satisfying a specified time condition in the storage system, the index for an associated slice index node correspo

Assignees

• Emc Ip Holding Co Llc

Inventors

• Zhu Julius Jian
• Lei Lu
• Su Pengfei
• Liu Jingjing

Classifications

• G06F3/0629 Primary

  Configuration or reconfiguration of storage systems · CPC title

• G06F3/0604

  Improving or facilitating administration, e.g. storage management · CPC title

• G06F3/0644

  Management of space entities, e.g. partitions, extents, pools · CPC title

• G06F3/0673 Primary

  Single storage device · CPC title

• G06F16/2272 Primary

  Management thereof · CPC title