Throttling using message partitioning and buffering

Patent metadata

Field	Value
Publication number	US-11157338-B2
Application number	US-201916669410-A
Country	US
Kind code	B2
Filing date	Oct 30, 2019
Priority date	Oct 30, 2019
Publication date	Oct 26, 2021
Grant date	Oct 26, 2021

Abstract

Provided are techniques for throttling using message partitioning and buffering. A plurality of messages are stored in an input topics buffer, where the input topics buffer is stored in a plurality of partitions, and where each of the partitions of the plurality of partitions is associated with a tenant subgroup of a plurality of tenant subgroups of a tenant. A message of the plurality of messages from the tenant subgroup of the tenant is selected. A throttle count for the tenant subgroup is retrieved. A maximum message threshold for the tenant is retrieved. In response to determining that the throttle count is less than the maximum message threshold, the message is moved from the input topics buffer to a work topics buffer. In response to determining that the throttle count is equal to or greater than the maximum message threshold, throttling the tenant subgroup.

First claim

What is claimed is:

1. A computer-implemented method, comprising operations for:
storing a plurality of messages in an input topics buffer, wherein the input topics buffer is stored in a plurality of partitions, and wherein each of the partitions of the plurality of partitions is associated with a tenant subgroup of a plurality of tenant subgroups of a tenant of a plurality of tenants;
selecting a message of the plurality of messages from the input topics buffer for a first tenant subgroup of the tenant;
retrieving a tenant subgroup identifier of the first tenant subgroup from a message key of the message;
mapping the tenant subgroup identifier to a tenant identifier of the tenant;
retrieving, using the tenant subgroup identifier, a throttle count for the first tenant subgroup from a cluster-wide cache that stores a plurality of different throttle counts, wherein each of the different throttle counts is associated with different tenant subgroup of the plurality of tenant subgroups, and wherein a second tenant subgroup has another throttle count;
retrieving, using the tenant identifier, a maximum message threshold for the tenant, wherein the maximum message threshold is used for each tenant subgroup of the plurality of tenant subgroups;
in response to determining that the throttle count for the first tenant subgroup is less than the maximum message threshold, moving the message from the input topics buffer to a work topics buffer; and
in response to determining that the throttle count for the first tenant subgroup is equal to or greater than the maximum message threshold, throttling the tenant subgroup.

2. The computer-implemented method of claim 1 , wherein messages in a first partition of the plurality of partitions are processed in an order received before messages in a next partition of the plurality of partitions are processed in the order received.

3. The computer-implemented method of claim 1 , wherein the operations further comprise:
incrementing the throttle count.

4. The computer-implemented method of claim 1 , wherein a micro-service retrieves the message from the work topics buffer, processes the message, and decrements the throttle count.

5. The computer-implemented method of claim 1 , wherein a Software as a Service (SaaS) is configured to perform the operations of the method.

6. A computer program product, the computer program product comprising a computer readable storage medium having program code embodied therewith, the program code executable by at least one processor to perform operations for:
storing a plurality of messages in an input topics buffer, wherein the input topics buffer is stored in a plurality of partitions, and wherein each of the partitions of the plurality of partitions is associated with a tenant subgroup of a plurality of tenant subgroups of a tenant of a plurality of tenants;
selecting a message of the plurality of messages from the input topics buffer for a first tenant subgroup of the tenant;
retrieving a tenant subgroup identifier of the first tenant subgroup from a message key of the message;
mapping the tenant subgroup identifier to a tenant identifier of the tenant;
retrieving, using the tenant subgroup identifier, a throttle count for the first tenant subgroup from a cluster-wide cache that stores a plurality of different throttle counts, wherein each of the different throttle counts is associated with different tenant subgroup of the plurality of tenant subgroups, and wherein a second tenant subgroup has another throttle count;
retrieving, using the tenant identifier, a maximum message threshold for the tenant, wherein the maximum message threshold is used for each tenant subgroup of the plurality of tenant subgroups;
in response to determining that the throttle count for the first tenant subgroup is less than the maximum message threshold, moving the message from the input topics buffer to a work topics buffer; and
in response to determining that the throttle count for the first tenant subgroup is equal to or greater than the maximum message threshold, throttling the tenant subgroup.

7. The computer program product of claim 6 , wherein messages in a first partition of the plurality of partitions are processed in an order received before messages in a next partition of the plurality of partitions are processed in the order received.

8. The computer program product of claim 6 , wherein the operations further comprise:
incrementing the throttle count.

9. The computer program product of claim 6 , wherein a micro-service retrieves the message from the work topics buffer, processes the message, and decrements the throttle count.

10. The computer program product of claim 6 , wherein a Software as a Service (SaaS) is configured to perform the operations of the computer program product.

11. A computer system, comprising:
one or more processors, one or more computer-readable memories and one or more computer-readable, tangible storage devices; and
program instructions, stored on at least one of the one or more computer-readable, tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to perform operations comprising:
storing a plurality of messages in an input topics buffer, wherein the input topics buffer is stored in a plurality of partitions, and wherein each of the partitions of the plurality of partitions is associated with a tenant subgroup of a plurality of tenant subgroups of a tenant of a plurality of tenants;
selecting a message of the plurality of messages from the input topics buffer for a first tenant subgroup of the tenant;
retrieving a tenant subgroup identifier of the first tenant subgroup from a message key of the message;
mapping the tenant subgroup identifier to a tenant identifier of the tenant;
retrieving, using the tenant subgroup identifier, a throttle count for the first tenant subgroup from a cluster-wide cache that stores a plurality of different throttle counts, wherein each of the different throttle counts is associated with different tenant subgroup of the plurality of tenant subgroups, and wherein a second tenant subgroup has another throttle count;
retrieving, using the tenant identifier, a maximum message threshold for the tenant, wherein the maximum message threshold is used for each tenant subgroup of the plurality of tenant subgroups;
in response to determining that the throttle count for the first tenant subgroup is less than the maximum message threshold, moving the message from the input topics buffer to a work topics buffer; and
in response to determining that the throttle count for the first tenant subgroup is equal to or greater than the maximum message threshold, throttling the tenant subgroup.

12. The computer system of claim 11 , wherein messages in a first partition of the plurality of partitions are processed in an order received before messages in a next partition of the plurality of partitions are processed in the order received.

13. The computer system of claim 11 , wherein the operations further comprise:
incrementing the throttle count.

14. The computer system of claim 11 , wherein a micro-service retrieves the message from the work topics buffer, processes the message, and decrements the throttle count.

15. The computer system of claim 11 , wherein a Software as a Service (SaaS) is configured to perform the operations of the computer system.

Assignees

• IBM

Inventors

• Rodean Liviu
• Wilgenbusch Tyler
• Giles Charles Patton
• Tkac Vincent

Classifications

• H04L67/55

  Push-based network services · CPC title

• G06F9/5061

  Partitioning or combining of resources · CPC title

• G06F9/544

  Buffers; Shared memory; Pipes · CPC title

• H04L67/306

  User profiles · CPC title

• H04L67/1097

  for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS] · CPC title