Persistent connection rebalancing

Patent metadata

Field	Value
Publication number	US-10243854-B2
Application number	US-201514963516-A
Country	US
Kind code	B2
Filing date	Dec 9, 2015
Priority date	Dec 9, 2015
Publication date	Mar 26, 2019
Grant date	Mar 26, 2019

Abstract

Disclosed is a computer-implemented method of rebalancing persistent client connections to a cluster of servers. The method comprises identifying an increase in a total client connection capacity of the cluster of servers with a network connection balancing component; and for each server in a selection of servers in the cluster of servers calculating a current client connection capacity utilization of the server from the number of persistent connections to the server and the current capacity of the server; comparing the current client connection capacity utilization with the target client connection capacity utilization; and terminating a selection of its persistent client connections by a server based on its current client connection capacity utilization exceeding the target client connection capacity utilization. Also disclosed are a computer program product and a computer system for utilizing the computer-implemented method.

First claim

The invention claimed is:

1. A computer program product comprising a computer readable storage medium having computer readable program instructions embodied therewith for, when executed on a computer system implementing a cluster of servers, wherein each server of within the clusters of servers comprises one or more processors, the computer readable program instructions being executable by the one or more processors to cause the one or more processors to:
rebalance persistent client connections to the cluster of servers, said rebalancing comprising:
identifying an increase in a total client connection capacity of the cluster of servers, wherein the increase in the total client connection capacity of the cluster of servers is due to one or more new servers being added to the cluster of servers;
determining a target client connection capacity utilization from the increased total client connection capacity of the cluster of servers and the number of persistent connections to the cluster of servers; and

for each server in a selection of servers in the cluster of servers:
determining a current client connection capacity utilization of the server from the number of persistent connections to the server and a current capacity of the server;
comparing the current client connection capacity utilization with the target client connection capacity utilization; and
terminating a selection of its persistent client connections based on its current client connection capacity utilization exceeding the target client connection capacity utilization.

2. A computer program product according to claim 1 , in which the computer readable program instructions cause the processor arrangement to:
determine a current client connection capacity utilization of the server from the number of persistent connections to the server and the current capacity of the server and comparing the current client connection capacity utilization with the target client connection capacity utilization with a network connection balancing component;
communicate a persistent connection termination message to each server in the cluster of servers having the current client connection capacity utilization exceeding the target client connection capacity utilization; and
terminate the selection of its persistent client connections by the server based on its current client connection capacity utilization exceeding the target client connection capacity utilization in accordance with the received persistent connection termination message.

3. A computer program product according to claim 1 , in which the computer readable program instructions cause the processor arrangement to communicate the determined target client connection capacity utilization based on the increased total client connection capacity to the selection of servers in the cluster of servers with a network connection balancing component; and
determining, with a server receiving the communicated determined target client connection capacity utilization, its current client connection capacity utilization from its number of persistent connections and its current capacity and compare its current client connection capacity utilization with the target client connection capacity utilization.

4. A computer program product according to claim 1 , in which the computer readable program instructions cause the processor arrangement to identify an increase in the total client connection capacity of the cluster of servers by receiving a capacity modification notification from the server indicating an increased current client connection capacity of that server.

5. A computer program product according to claim 1 , in which the computer readable program instructions cause the processor arrangement to determine the target client connection capacity utilization based on the number of persistent client connections to the cluster of servers and the increased total client connection capacity of the cluster of servers by dividing the number of persistent client connections to the cluster of servers by a number of servers in the cluster of servers.

6. A computer program product according to claim 1 , in which the computer readable program instructions cause the processor arrangement to determine the target client connection capacity utilization by dividing the number of persistent client connections to the cluster of servers by a sum of the individual client connection capacities of the respective servers in the cluster of servers.

7. A computer program product according to claim 1 , in which the computer readable program instructions cause the processor arrangement to terminate a selection of persistent client connections to the server based on the current client connection capacity utilization exceeding the target client connection based on at least one of: a period of inactivity of the persistent client connections; a lifetime of the persistent client connections; a usage count of the persistent client connections; a latency metric of the persistent client connections; and a logical error metric of respective communications over the persistent client connections.

8. A computer program product according to claim 1 , in which the computer readable program instructions cause the processor arrangement to terminate a selection of persistent client connections to the server based on the current client connection capacity utilization exceeding the target client connection capacity utilization when a difference between the current client connection capacity utilization and the target client connection capacity utilization exceeds a defined threshold.

9. A computer system comprising:
one or more processors;
one or more memory devices couple to the one or more processors;
a cluster of servers listening to a shared IP endpoint and a network balancing component for balancing client connections to a server in the cluster of servers, wherein each server of within the clusters of servers comprises one or more processors;
the network balancing component being adapted to rebalance persistent client connections to the cluster of servers, said rebalancing comprising:
identifying an increase in a total client connection capacity of the cluster of servers wherein the increase in the total client connection capacity of the cluster of servers is due to one or more new servers being added to the cluster of servers; and
determining a target client connection capacity utilization from the increased total client connection capacity of the cluster of servers and the number of persistent connections to the cluster of servers;
the computer system further being adapted to, for each server in a selection of servers in the cluster of servers:
determine its current client connection capacity utilization from its number of persistent connections and its current capacity; and
compare its current client connection capacity utilization with the target client connection capacity utilization; and
each server being adapted to terminate a selection of its persistent client connections based on its current client connection capacity utilization exceeding the target client connection capacity utilization.

10. A computer system according to claim 9 , the network balancing component being further adapted to:
determine the current client connection capacity utilization for a server from its number of persistent connections and its current capacity;
compare its current client connection capacity utilization with the target client connection capacity utilization; and
communicate a persistent connection termination message to each server in the cluster of servers having the current client connection capacity utilization exceeding the target client connection capacity

Assignees

• IBM

Inventors

• Jones Robert C
• Kassimis Constantinos
• Mitchell Ian J
• Wakelin Philip I

Classifications

• H04L67/02

  based on web technology, e.g. hypertext transfer protocol [HTTP] · CPC title

• H04L47/828 Primary

  Allocation of resources per group of connections, e.g. per group of users · CPC title

• H04L67/1029

  using data related to the state of servers by a load balancer · CPC title

• H04L47/125 Primary

  by balancing the load, e.g. traffic engineering · CPC title

• H04L43/0882

  Utilisation of link capacity · CPC title