System and method for managing concurrent events

Patent metadata

Field	Value
Publication number	US-9495227-B2
Application number	US-201313764594-A
Country	US
Kind code	B2
Filing date	Feb 11, 2013
Priority date	Feb 10, 2012
Publication date	Nov 15, 2016
Grant date	Nov 15, 2016

Abstract

A system and method that includes receiving an API request to a type of API resource; retrieving an API concurrency value for the API request; determining a comparison status associated with a comparison of the API concurrency value to a concurrency threshold; if the comparison status is within the concurrency threshold, transmitting the API request to an API processing resource; if the comparison status indicates the concurrency threshold is not satisfied, impeding processing of the API request; accounting for an increase in the API concurrency value if the API request is transmitted to an API processing resource; and accounting for a decrease in the API concurrency value at a time associated with the API processing resource completing processing of the API request.

First claim

What is claimed is:

1. A method comprising: at a multi-tenant telephony application programming interface (API) platform system:
receiving a REST application programming interface (API) request to a type of API resource data, the API request specifying an account of a plurality of accounts of the telephony API platform system, the type of API resource data including at least one of telephony call data and telephony messaging data;
retrieving an API concurrency value for the type of API resource data;
determining a comparison status associated with a comparison of the API concurrency value to a concurrency limit associated with the concurrency value;
in a first condition based at least in part on if the comparison status satisfies the concurrency limit, transmitting the API request to an API processing resource;
in a second condition based at least in part on if the comparison status indicates the concurrency limit is not satisfied, impeding processing of the API request;
accounting for an increase in the API concurrency value if the API request is transmitted to an API processing resource; and
accounting for a decrease in the API concurrency value at a time associated with the API processing resource completing processing of the API request,
wherein in a case where the type of API resource data is telephony call data, the retrieved API concurrency value is a telephony call data API concurrency value,
wherein in a case where the type of API resource data is telephony messaging data, the retrieved API concurrency value is a telephony messaging data API concurrency value,
wherein the telephony call data includes telephony call records, and the telephony messaging data includes telephony message records,
wherein the API concurrency value is a current number of API requests being concurrently processed by an API processing resource, and
wherein the concurrency limit is a maximum number of API requests that are permitted to be concurrently processed by an API processing resource.

2. The method of claim 1 , wherein the received API request is a request from an account; and wherein the retrieved API concurrency value is a value maintained for API concurrency usage of the account.

3. The method of claim 1 , wherein the retrieved API concurrency value is a value maintained for API concurrency usage for API requests to the API resource data type.

4. The method of claim 1 , wherein the received API request is a request from an account; and wherein the retrieved API concurrency value is a value associated with a measure of usage of at least one API resource data type by the account.

5. The method of claim 1 , wherein retrieving an API concurrency value is further retrieved based on state of available resources to process the API request.

6. The method of claim 1 , wherein the received API request is a request from an account; and wherein the concurrency limit is uniquely computed for the account.

7. The method of claim 6 , wherein the concurrency limit is dynamically calculated.

8. The method of claim 1 , wherein impeding processing of the API request comprises transmitting an error message in an API response.

9. The method of claim 1 , wherein the concurrency limit is dynamically adjusted based on capacity of API processing resources.

10. The method of claim 1 , further comprising if after a timeout period a response to a processed API request is not transmitted, accounting for a decrease in API concurrency.

11. The method of claim 1 , wherein accounting for an increase in the API concurrency value comprises updating the API concurrency value for the specified account in a rate value database, and wherein accounting for a decrease in the API concurrency value comprises updating the API concurrency value for the specified account in the rate value database.

12. The method of claim 1 , wherein the API concurrency value is retrieved based on the specified account and the type of API resource data, and wherein the concurrency limit is retrieved based on the specified account and the type of API resource data.

13. The method of claim 12 ,
wherein a database system of the telephony API platform system stores:
the telephony call data API concurrency value of the account,
a telephony call data API concurrency limit for the account,
the telephony messaging data API concurrency value for the account, and
a telephony messaging data API concurrency limit for the account,

wherein in a case where the type of API resource data is telephony call data, determining a comparison status comprises: determining a comparison status associated with a comparison of the telephony call data API concurrency value to the telephony call data API concurrency limit, and
wherein in a case where the type of API resource data is telephony messaging data, determining a comparison status comprises: determining a comparison status associated with a comparison of the telephony messaging data API concurrency value to the telephony messaging data API concurrency limit.

14. The method of claim 13 , wherein the telephony call data API concurrency limit is different from the telephony messaging data API concurrency limit.

15. The method of claim 13 ,
wherein the telephony call data API concurrency value of the account is a value maintained for API concurrency usage of the account for call data API requests, and
wherein the telephony messaging data API concurrency value of the account is a value maintained for API concurrency usage of the account for messaging data API requests.

16. The method of claim 15 ,
wherein the telephony call data API concurrency limit for the account is dynamically calculated for the account, and
wherein the telephony messaging data API concurrency limit for the account is dynamically calculated for the account.

17. The method of claim 16 ,
wherein the telephony call data API concurrency limit for the account is dynamically calculated for the account based on capacity of API processing resources of the platform system, and
wherein the telephony messaging data API concurrency limit for the account is dynamically calculated for the account based on capacity of API processing resources of the platform system.

18. A method comprising: at a multi-tenant telephony application programming interface (API) platform system:
receiving a REST application programming interface (API) request to a type of API resource data, the API request specifying an account of a plurality of accounts of the telephony API platform system, the type of API resource data including telephony call data;
retrieving an API concurrency value for the type of API resource data;
determining a comparison status associated with a comparison of the API concurrency value to a concurrency limit associated with the concurrency value;
in a first condition based at least in part on if the comparison status satisfies the concurrency limit, transmitting the API request to an API processing resource;
in a second condition based at least in part on if the comparison status indicates the concurrency limit is not satisfied, impeding processing of the API request;
accounting for an increase in the API concurrency value if the API request is transmitted to an API processing resource; and
accounting for a decrease in the API concurrency value at a time associated with the API processing resource completing processing of the API request,
wherein the retrieved API concurrency value is a telephony call data API concurrency value,
wherein the telephony call data includes telephony call records,
wherein

Assignees

• Twilio Inc

Inventors

• Cooke Evan
• Stratton Frank
• Conroy Kyle

Classifications

• G06F2209/504

  Resource capping · CPC title

• G06F9/5027 Primary

  the resource being a machine, e.g. CPUs, Servers, Terminals · CPC title

• G06F9/542 Primary

  Event management; Broadcasting; Multicasting; Notifications · CPC title

• Y02B60/142

  Cross-Sectional Technologies · mapped topic

• Y02D10/00

  Energy efficient computing, e.g. low power processors, power management or thermal management · CPC title