System and method for managing concurrent events

Patent metadata

Field	Value
Publication number	US-11093305-B2
Application number	US-201916580579-A
Country	US
Kind code	B2
Filing date	Sep 24, 2019
Priority date	Feb 10, 2012
Publication date	Aug 17, 2021
Grant date	Aug 17, 2021

Abstract

A system and method that includes receiving an API request to a type of API resource; retrieving an API concurrency value for the API request; determining a comparison status associated with a comparison of the API concurrency value to a concurrency threshold; if the comparison status is within the concurrency threshold, transmitting the API request to an API processing resource; if the comparison status indicates the concurrency threshold is not satisfied, impeding processing of the API request; accounting for an increase in the API concurrency value if the API request is transmitted to an API processing resource; and accounting for a decrease in the API concurrency value at a time associated with the API processing resource completing processing of the API request.

First claim

What is claimed is:

1. A method comprising:
receiving an application programming interface (API) request associated with a first account;
determining a first API concurrency value that indicates a number of API requests associated with the first account that are being concurrently processed by an API processing resource, the API processing resource concurrently processing at least one API request associated with a second account;
determining that the first API concurrency value meets a first API concurrency threshold associated with the first account, the first API concurrency threshold indicating a maximum number of API requests associated with the first account that are permitted to be concurrently processed by the API processing resource, wherein the first API concurrency value is different than a second API concurrency value associated with the second account, the second API concurrency threshold indicating a maximum number of API requests associated with the second account that are permitted to be concurrently processed by the API processing resource; and
in response to determining that the first API concurrency value meets the first API concurrency threshold, delaying processing of the API request.

2. The method of claim 1 , further comprising:
after delaying processing of the API request, providing the API request to the API processing resource to be processed.

3. The method of claim 2 , further comprising:
determining a second API concurrency value that indicates an updated number of API requests associated with the first account that are being concurrently processed by the API processing resource;
determining that the second API concurrency value is less than the first API concurrency threshold associated with the first account, wherein providing the API request to the API processing resource to be processed is performed in response to determining that the second API concurrency value is less than the first API concurrency threshold associated with the first account.

4. The method of claim 1 , further comprising:
receiving a second API request associated with the second account;
determining a second API concurrency value that indicates a number of API requests associated with the second account that are being concurrently processed by the API processing resource;
determining that the second API concurrency value is less than the second API concurrency threshold associated with the second account; and
in response to determining that the second API concurrency value transgresses is less than the second API concurrency threshold, providing the second API request to the API processing resource to be processed.

5. The method of claim 1 , further comprising:
receiving a second API request associated with the second account;
determining a second API concurrency value that indicates a number of API requests associated with the second account that are being concurrently processed by the API processing resource;
determining that the second API concurrency value transgresses meets the second API concurrency threshold associated with the second account; and
in response to determining that the second API concurrency value transgresses meets the first API concurrency threshold, delaying processing of the second API request.

6. The method of claim 1 , wherein the API request is a request for communication data for the first account.

7. The method of claim 6 , wherein the communication data includes telephony call records associated with the first account.

8. A system comprising:
one or more computer processors; and
one or more computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause the system to perform operations comprising:
receiving an application programming interface (API) request associated with a first account;
determining a first API concurrency value that indicates a number of API requests associated with the first account that are being concurrently processed by an API processing resource, the API processing resource concurrently processing at least one API request associated with a second account;
determining that the first API concurrency value transgresses meets a first API concurrency threshold associated with the first account, the first API concurrency threshold indicating a maximum number of API requests associated with the first account that are permitted to be concurrently processed by the API processing resource, wherein the first API concurrency value is different than a second API concurrency value associated with the second account, the second API concurrency threshold indicating a maximum number of API requests associated with the second account that are permitted to be concurrently processed by the API processing resource; and
in response to determining that the first API concurrency value meets the first API concurrency threshold, delaying processing of the API request.

9. The system of claim 8 , the operations further comprising:
after delaying processing of the API request, providing the API request to the API processing resource to be processed.

10. The system of claim 9 , the operations further comprising:
determining a second API concurrency value that indicates an updated number of API requests associated with the first account that are being concurrently processed by the API processing resource;
determining that the second API concurrency value is less than the first API concurrency threshold associated with the first account, wherein providing the API request to the API processing resource to be processed is performed in response to determining that the second API concurrency value is less than the first API concurrency threshold associated with the first account.

11. The system of claim 8 , the operations further comprising:
receiving a second API request associated with the second account;
determining a second API concurrency value that indicates a number of API requests associated with the second account that are being concurrently processed by the API processing resource;
determining that the second API concurrency value is less than the second API concurrency threshold associated with the second account; and
in response to determining that the second API concurrency value is less than the second API concurrency threshold, providing the second API request to the API processing resource to be processed.

12. The system of claim 8 , the operations further comprising:
receiving a second API request associated with the second account;
determining a second API concurrency value that indicates a number of API requests associated with the second account that are being concurrently processed by the API processing resource;
determining that the second API concurrency value transgresses meets the second API concurrency threshold associated with the second account; and
in response to determining that the second API concurrency value transgresses meets the first API concurrency threshold, delaying processing of the second API request.

13. The system of claim 8 , wherein the API request is a request for communication data for the first account.

14. The system of claim 13 , wherein the communication data includes telephony call records associated with the first account.

15. A non-transitory computer-readable medium storing instructions that, when executed by one or more computer processors of one or more computing devices, cause the one or more computing devices to perform operations comprising:
receiving an application programming interface (API) request associated with a first account;
determining

Assignees

• Twilio Inc

Inventors

• Cooke Evan
• Stratton Frank
• Conroy Kyle

Classifications

• G06F9/5027 Primary

  the resource being a machine, e.g. CPUs, Servers, Terminals · CPC title

• Y02D10/00

  Energy efficient computing, e.g. low power processors, power management or thermal management · CPC title

• G06F2209/504

  Resource capping · CPC title

• G06F9/542 Primary

  Event management; Broadcasting; Multicasting; Notifications · CPC title