Methods and apparatus for efficient load balancing among microservices and/or processing entities

Patent metadata

Field	Value
Publication number	US-11070595-B1
Application number	US-202017023521-A
Country	US
Kind code	B1
Filing date	Sep 17, 2020
Priority date	Aug 4, 2020
Publication date	Jul 20, 2021
Grant date	Jul 20, 2021

Abstract

The present invention is directed to communications methods and apparatus for efficiently distributing traffic to processing entities. An exemplary method includes the steps of: receiving, at a first Session Initiation Protocol (SIP) load balancer (SLB), a first SIP INVITE message; selecting, at the first SLB, which Session Border Controller (SBC) in a first cluster of SBCs to send the first SIP invite message based on a message allocation weight determined based on message loss information corresponding to different SBCs in the first cluster of SBCs, the selecting including allocating a portion of incoming received SIP INVITE messages to an individual SBC based on a message loss rate corresponding to the individual SBC and the message allocation rate, said selecting including selecting a first SBC from the first cluster of SBCs to send said first SIP INVITE message, and sending the first SIP INVITE message to the first SBC.

First claim

What is claimed is:

1. A communications method, the method comprising:
receiving, at a first Session Initiation Protocol (SIP) load balancer (SLB), a first SIP INVITE message;
selecting, at the first SLB, which Session Border Controller (SBC) in a first cluster of SBCs to send the first SIP INVITE message based on a message allocation weight determined based on message loss information corresponding to different SBCs in the first cluster of SBCs, said selecting including allocating a portion of incoming received SIP INVITE messages to an individual SBC based on a message loss rate corresponding to the individual SBC and said message allocation weight, said selecting including selecting a first SBC from the first cluster of SBCs to send said first SIP INVITE message;
sending the first SIP INVITE message to the first SBC; and
receiving a first SIP response message from the first SBC in response to the first SIP INVITE message.

2. The communications method of claim 1 , further comprising:
updating the message allocation weight at the first SLB based on the first SIP response message to generate a first updated message allocation weight.

3. The communications method of claim 2 , further comprising:
receiving, at the first SIP load balancer (SLB), a second SIP INVITE message;
selecting, at the first SLB, which one of the SBCs in the first cluster of SBCs to send the second SIP INVITE message based on the first updated message allocation weight, a second SBC in said cluster of SBCs being selected to process the second SIP INVITE message.

4. The communications method of claim 3 , further comprising:
receiving, at the first SLB, a second SIP response message including a second message loss rate value indicating a message loss rate at the second SBC; and
updating the first updated message allocation weight at the first SLB based on the second SIP response message to generate a second updated message allocation weight.

5. The method of claim 2 , further comprising:
maintaining a first global message loss rate (GLR) value at the first SLB, said maintaining the first global message loss rate value including updating the first GLR value based on the message loss rate value indicating a message loss rate at the first SBC.

6. The communications method of claim 1 , wherein the first SIP response message is a service unavailable response message that includes a first message loss rate value indicating a message loss rate at the first SBC, the method further comprising:
making, at the first SLB, a decision whether or not to send the first SIP INVITE message to another SBC in the first cluster of SBCs based on a first global message loss rate (GLR) value maintained at the first SLB and the first message loss rate value included in the first SIP response message.

7. The communications method of claim 6 ,
wherein said first message loss rate value included in the first SIP response message is greater than the first GLR value; and wherein said decision is a decision to send the first SIP INVITE message to another SBC in the first cluster of SBCs, the method further comprising:
sending, from the first SLB, the first SIP INVITE message and the first message loss rate value to a second SBC in said first cluster of SBCs.

8. The method of claim 7 , further comprising:
receiving a second SIP response message from the second SBC in response to the first SIP invite message, said second SIP response message being a service unavailable message; and
maintaining a first global message loss rate (GLR) value at the first SLB, said maintaining the first global message loss rate value including updating the first GLR value based on the first message loss rate corresponding to the first SBC indicated in said first SIP response message.

9. The communications method of claim 8 , further comprising:
receiving, at the first SIP load balancer (SLB), a second SIP INVITE message;
sending the second SIP INVITE message to the second SBC in the first cluster of SBCs;
receiving from the second SBC a response to the second SIP INVITE message, said response to the second SIP INVITE message including an additional message loss rate value indicating a message loss rate at the second SBC; and
wherein maintaining the first global message loss rate (GLR) value at the first SLB includes updating the first GLR value based on the additional message loss rate value indicating a message loss rate at the second SBC.

10. The communications method of claim 8 , wherein the second SIP response message is a service unavailable response message that includes a second message loss rate value indicating a message loss rate at the second SBC, the method further comprising:
making, at the first SLB, a second decision whether or not to send the first SIP INVITE message to an additional SBC in the first cluster of SBCs based on the first global message loss rate (GLR) value maintained at the first SLB, the first message loss rate value and the second message loss rate value.

11. The method of claim 10 , further comprising:
when the decision at the first SLB is not to send the first SIP INVITE message to an additional SBC, sending a response from the SLB in response to the first SIP INVITE message indicating service is unavailable.

12. A communications system comprising:
a first Session Initiation Protocol (SIP) load balancer (SLB) including:
a first processor configured to:
operate the first SLB to receive a first SIP INVITE message;
select, at the first SLB, which Session Border Controller (SBC) in a first cluster of SBCs to send the first SIP INVITE message based on a message allocation weight determined based on message loss information corresponding to different SBCs in the first cluster of SBCs, said selecting including allocating a portion of incoming received SIP INVITE messages to an individual SBC based on a message loss rate corresponding to the individual SBC and said message allocation weight, said selecting including selecting a first SBC from the first cluster of SBCs to send said first SIP INVITE message;
operate the first SLB to send the first SIP INVITE message to the first SBC; and
operate the first SLB to receive a first SIP response message from the first SBC in response to the first SIP INVITE message.

13. The communications system of claim 12 , wherein said first processor is further configured to:
update the message allocation weight at the first SLB based on the first SIP response message to generate a first updated message allocation weight.

14. The communications system of claim 13 , wherein said first processor is further configured to:
operate the first SLB to receive, at the first SIP load balancer (SLB), a second SIP INVITE message; and
select, at the first SLB, which one of the SBCs in the first cluster of SBCs to send the second SIP INVITE message based on the first updated message allocation weight, a second SBC in said cluster of SBCs being selected to process the second SIP INVITE message.

15. The communications system of claim 14 , wherein the first processor is further configured to:
operate the first SLB to receive a second SIP response message including a second message loss rate (LR) value indicating a message loss rate at the second SBC; and
update the first updated message allocation weight at the first SLB based on the second SIP response message to generate a second updated message allocation weight.

16. The communications system of claim 13 , wherein said first processor is further configured to:
maintain a first global message loss rate (GLR) value at the first SLB, maintain

Assignees

• Ribbon Comm Operating Co Inc

Inventors

• Asveren Tolga
• Bollapolli Nagesh Kumar
• Kuriakose Aby

Classifications

• H04L65/1036

  at the edge · CPC title

• H04L65/1016

  IP multimedia subsystem [IMS] · CPC title

• H04W28/08

  Load balancing or load distribution (transferring a connection for handling the traffic H04W36/22; wireless traffic scheduling H04W72/12) · CPC title

• H04L65/1069 Primary

  Session establishment or de-establishment · CPC title

• H04L65/1066

  Session management · CPC title