Highly concurrent and responsive application programming interface (API) in eventual consistency environment

Patent metadata

Field	Value
Publication number	US-11915064-B2
Application number	US-202217651454-A
Country	US
Kind code	B2
Filing date	Feb 17, 2022
Priority date	Jan 19, 2022
Publication date	Feb 27, 2024
Grant date	Feb 27, 2024

Abstract

The disclosure relates to processing application programming interface (API) requests. Embodiments include receiving, at an API wrapper, from a first caller, a first call to an API and sending the first call to the API. Embodiments include receiving, by the API wrapper, from one or more second callers, a second one or more calls to the API prior to receiving a response from the API to the first call. Embodiments include receiving, by the API wrapper, the response from the API to the first call and responding to the first call from the first caller with the response from the API to the first call. Embodiments include responding, by the API wrapper, to the second one or more calls from the one or more second callers with the response from the API to the first call without sending the second one or more calls to the API.

First claim

We claim:

1. A method of processing application programming interface (API) requests, comprising:
receiving, at an API wrapper, from a first caller, a first call to a function provided by an API;
sending, by the API wrapper, the first call to the API;
receiving, by the API wrapper, from one or more second callers, a second one or more calls to the function provided by the API prior to receiving, by the API wrapper, a response from the API to the first call;
receiving, by the API wrapper, the response from the API to the first call;
storing, by the API wrapper, the response from the API to the first call in a cache;
responding, by the API wrapper, to the first call from the first caller with the response from the API to the first call; and
responding, by the API wrapper, to the second one or more calls from the one or more second callers with the response from the API to the first call in the cache, without sending, by the API wrapper, the second one or more calls to the API;
receiving, by the API wrapper, from a third caller, a third call to the function provided by the API; and
responding, by the API wrapper, based on a time period elapsing, to the third call from the third caller with the response from the API to the first call from the cache.

2. The method of claim 1 , further comprising adding, by the API wrapper, the second one or more calls to a queue while waiting for the response from the API to the first call.

3. A method of processing application programming interface (API) requests, comprising:
receiving, at an API wrapper, from a first caller, a first call to a function provided by an API;
sending, by the API wrapper, the first call to the API;
storing, by the API wrapper, a response from the API to the first call in a cache;
receiving, by the API wrapper, from a second caller, a second call to the function provided by the API;
sending, by the API wrapper, the second call to the API;
determining, by the API wrapper, that a time period has elapsed without receiving a corresponding response from the API to the second call; and
responding, by the API wrapper, based on the time period elapsing, to the second call from the second caller with the response from the API to the first call from the cache.

4. The method of claim 3 , further comprising:
receiving, by the API wrapper, from a third caller, a third call to the function provided by the API prior to receiving, by the API wrapper, the corresponding response from the API to the third call;
determining, by the API wrapper, that the time period has elapsed since receiving the third call without receiving the corresponding response from the API to the third call; and
responding, by the API wrapper, based on the time period elapsing since receiving the third call, to the third call from the third caller with the response from the API to the first call from the cache.

5. The method of claim 3 , further comprising:
receiving, by the API wrapper, the corresponding response from the API to the second call after responding the second call from the second caller with the response from the API to the first call from the cache; and
updating, by the API wrapper, the cache based on the corresponding response from the API to the second call.

6. The method of claim 1 , wherein the first call and the second one or more calls comprise a common set of input parameters to the function.

7. The method of claim 6 , further comprising:
receiving, by the API wrapper, from an additional caller, an additional call to the function provided by the API prior to receiving, by the API wrapper, the response from the API to the first call, wherein the additional call comprises input values to the function that are different than the common set of input values to the function; and
sending, by the API wrapper, the additional call to the API without waiting to receive the response from the API to the first call.

8. The method of claim 1 , further comprising:
receiving, by the API wrapper, from an additional caller, an additional call to a different function provided by the API prior to receiving, by the API wrapper, the response from the API to the first call; and
sending, by the API wrapper, the additional call to the API without waiting to receive the response from the API to the first call.

9. A system for processing application programming interface (API) requests, the system comprising:
at least one memory; and
at least one processor coupled to the at least one memory, the at least one processor and the at least one memory configured to:
receive, at an API wrapper, from a first caller, a first call to a function provided by an API;
send, by the API wrapper, the first call to the API;
receive, by the API wrapper, from one or more second callers, a second one or more calls to the function provided by the API prior to receiving, by the API wrapper, a response from the API to the first call;
receive, by the API wrapper, the response from the API to the first call;
store, by the API wrapper, the response from the API to the first call in a cache;
respond, by the API wrapper, to the first call from the first caller with the response from the API to the first call; and
respond, by the API wrapper, to the second one or more calls from the one or more second callers with the response from the API to the first call in the cache without sending, by the API wrapper, the second one or more calls to the API;
receive, by the API wrapper, from a third caller, a third call to the function provided by the API; and
respond, by the API wrapper, based on a time period elapsing, to the third call from the third caller with the response from the API to the first call from the cache.

10. The system of claim 9 , wherein the at least one processor and the at least one memory are further configured to add, by the API wrapper, the second one or more calls to a queue while waiting for the response from the API to the first call.

11. A system for processing application programming interface (API) requests, the system comprising:
at least one memory; and
at least one processor coupled to the at least one memory, the at least one processor and the at least one memory configured to:
receive, at an API wrapper, from a first caller, a first call to a function provided by an API;
send, by the API wrapper, the first call to the API;
store, by the API wrapper, a response from the API to the first call in a cache;
receive, by the API wrapper, from a second caller, a second call to the function provided by the API;
send, by the API wrapper, the second call to the API;
determine, by the API wrapper, that a time period has elapsed without receiving a corresponding response from the API to the second call; and
respond, by the API wrapper, based on the time period elapsing, to the second call from the second caller with the response from the API to the first call from the cache.

12. The system of claim 11 , wherein the at least one processor and the at least one memory are further configured to:
receive, by the API wrapper, from a third caller, a third call to the function provided by the API prior to receiving, by the API wrapper, the corresponding response from the API to the third call;
determine, by the API wrapper, that the time period has elapsed since receiving the third call without receiving the corresponding response from the API to the third call; and
respond, by the API wrapper, based on the time period elapsing since receiving the third call, to the third call from the fourth caller with the response from the API to the first call from the cache.

13. The system of claim 11 , wherein the

Assignees

• VMware LLC
• Vmware Inc

Inventors

• Wu Yu
• Feng Jin
• Liu Sifan
• Zhang Zhiliang
• Chen Kai-Chia

Classifications

• G06F9/541 Primary

  via adapters, e.g. between incompatible applications · CPC title

• G06F9/505

  considering the load · CPC title

• G06F9/5072

  Grid computing · CPC title

• G06F9/547

  Remote procedure calls [RPC]; Web services · CPC title