Scaling of an ordered event stream

Patent metadata

Field	Value
Publication number	US-11340834-B2
Application number	US-202016881556-A
Country	US
Kind code	B2
Filing date	May 22, 2020
Priority date	May 22, 2020
Publication date	May 24, 2022
Grant date	May 24, 2022

Abstract

Improved scaling of an ordered event stream (OES) is disclosed. In contrast to conventional scaling of an OES that, in immediate response to loading exceeding a given processor performance level, merely divides a segment into segments having similar key space size, and then determines an alternate OES topology. The alternate OES topology can be selected from among ranked alternate OES topologies. The alternate OES topology can be implemented where the expected performance will meet a threshold level of improvement over an existing OES topology. Moreover, the alternate OES topology of the disclosed subject matter can comprise two or more two new segments that can have dissimilar key space sizes. Additionally, the two or more two new segments of the alternate OES topology can provide the same, or similar, loading relative to performance levels of corresponding processing instances, even where the performance levels of corresponding processing instances are also dissimilar.

First claim

What is claimed is:

1. A system, comprising:
a processor; and
a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising:
receiving an indication corresponding to a threshold amount of resource demand occurring in an existing portion of an ordered event stream of an ordered event stream storage system, wherein the ordered event stream has an initial topology, and wherein the initial topology has a characteristic selected from a group of characteristics comprising a count of segments and an allocation of key space among the segments of the ordered event stream;
determining an alternate ordered event stream topology;
determining an expected loading of computing resources based on the alternate ordered event stream topology; and
in response to determining that the alternate ordered event stream topology satisfies a rule related to allowing implementation of the altered ordered event stream topology based on the expected loading, enabling implementation of the altered ordered event stream topology.

2. The system of claim 1 , wherein the alternate ordered event stream topology is selected from alternate ordered event stream topologies based on a rank of the ordered event stream topology among the alternate ordered event stream topologies.

3. The system of claim 2 , wherein the rank is based on the expected loading for the alternate ordered event stream topology.

4. The system of claim 1 , wherein the altered ordered event stream topology comprises at least two new ordered event stream segments.

5. The system of claim 4 , wherein the altered ordered event stream topology comprises at least three new ordered event stream segments.

6. The system of claim 4 , wherein a first new ordered event stream segment of the at least two new ordered event stream segments assumes a first portion of a key space of the existing portion of the ordered event stream and a second new ordered event stream segment of the at least two new ordered event stream segments assumes a second portion of the key space of the existing portion of the ordered event stream, and wherein the first portion of the key space of the existing portion of the ordered event stream is adjacent to, but does not overlap, the second portion of the key space of the existing portion of the ordered event stream.

7. The system of claim 6 , wherein the first portion is of a different key space size than the second portion.

8. The system of claim 6 , wherein a first expected loading from the first new ordered event stream segment is the same expected loading as a second expected loading from the second new ordered event stream segment, wherein the first new ordered event stream segment is supported by a first processing instance, wherein the second new ordered event stream segment is supported by a second processing instance, and wherein the wherein the first processing instance and the second processing instance have a same level of performance.

9. The system of claim 6 , wherein a first expected loading from the first new ordered event stream segment is the same expected loading as a second expected loading from the second new ordered event stream segment, wherein the first new ordered event stream segment is supported by a first processing instance, wherein the second new ordered event stream segment is supported by a second processing instance, and wherein the wherein the first processing instance and the second processing instance have a different level of performance.

10. The system of claim 1 , wherein the determining that the alternate ordered event stream topology satisfies the rule related to allowing implementation of the altered ordered event stream topology based on the expected loading comprises determining that the expected loading would traverse a threshold level of performance.

11. The system of claim 1 , wherein the implementation of the altered ordered event stream topology results in scaling the existing portion of the ordered event stream in response to opening at least two new ordered event stream segments based on the altered ordered event stream topology.

12. The system of claim 1 , wherein the determining the alternate ordered event stream topology occurs in response to the receiving the indication corresponding to the threshold amount of resource demand occurring in the existing portion of the ordered event stream.

13. The system of claim 1 , wherein the determining the alternate ordered event stream topology occurs prior to the receiving the indication corresponding to the threshold amount of resource demand occurring in the existing portion of the ordered event stream.

14. A method, comprising:
performing, by a system comprising a processor, a first iteration of operations comprising:
in response to receiving, by the system, an indication that an existing segment of an ordered event stream of an ordered event stream storage system has traversed a threshold loading of a processing instance supporting the existing segment of the ordered event stream, determining a ranking of alternate ordered event stream topologies that comprise an alternate ordered event stream topology, wherein the alternate ordered event stream topology is a different topology than an initial ordered event stream topology, and wherein a characteristic of the initial ordered event stream topology is selected from a group of characteristics comprising a count of segments and an allocation of key space among the segments of the ordered event stream;
in response to determining, by the system, that the alternate ordered event stream topology satisfies a rule related to allowing implementation of the altered ordered event stream topology based on an expected loading for the alternate ordered event stream topology, selecting the alternate ordered event stream topology based on the ranking; and
causing, by the system, implementation of the altered ordered event stream topology.

15. The method of claim 14 , wherein the determining the ranking of alternate ordered event stream topologies comprises determining the ranking for a first alternate ordered event stream topology comprising at least two new segments.

16. The method of claim 14 , wherein a first expected loading from a first new ordered event stream segment of the alternate ordered event stream topology is the same expected loading as a second expected loading from a second new ordered event stream segment of the alternate ordered event stream topology, wherein the first new ordered event stream segment supports a first portion of a key space of the existing segment, wherein the second new ordered event stream segment supports a second portion of the key space of the existing segment, and wherein the first portion and the second portion are of different key space size and abut, but do not overlap, in the key space.

17. The method of claim 14 , wherein the determining the alternate ordered event stream topology occurs prior to the receiving the indication that the existing segment has traversed the threshold loading.

18. A non-transitory machine-readable medium, comprising executable instructions that, when executed by a processor, facilitate performance of operations, comprising:
receiving an indication that an existing segment of an ordered event stream of an ordered event stream storage system has traversed a threshold loading of a processing instance supporting the existing segment of the ordered event stream;
receiving a ranking of alternate ordered event stream topologies that comprise an alternate ord

Assignees

• Emc Ip Holding Co Llc

Inventors

• Danilov Mikhail
• Altaye Yohannes

Classifications

• G06F2209/508

  Monitor · CPC title

• G06F3/0635

  by changing the path, e.g. traffic rerouting, path reconfiguration · CPC title

• G06F3/0659 Primary

  Command handling arrangements, e.g. command buffers, queues, command scheduling · CPC title

• G06F9/5005

  to service a request · CPC title

• G06F3/061

  Improving I/O performance · CPC title