Predictive load mitigation and control in a content delivery network (CDN)

Patent metadata

Field	Value
Publication number	US-11463512-B2
Application number	US-202017075939-A
Country	US
Kind code	B2
Filing date	Oct 21, 2020
Priority date	Oct 9, 2017
Publication date	Oct 4, 2022
Grant date	Oct 4, 2022

Abstract

A computer-implemented method, in a content delivery (CD) network that delivers content on behalf of multiple content providers. The method includes, at a server in the CDN, wherein the server is currently processing at least one other request in at least one other session: receiving a connection request from a client, the connection request being associated with a corresponding content request; determining whether handling the content request will cause the server to become overloaded; and, based on the determining in (B) and on information about the content request, conditionally (i) accepting the content request, and (ii) terminating or throttling at least one session on the server.

First claim

We claim:

1. A computer-implemented method, in a content delivery (CD) network, wherein said CD network (CDN) delivers content on behalf of multiple content providers, the method comprising,
at a server in said CDN,
wherein said server is currently processing at least one other request in at least one other session:
(A) receiving a content request;
(B) determining whether handling said content request will cause said server to become overloaded based on a predicted effect of the sever processing the content quest; and
(C) based on said determining in (B) and on information about said is content request, terminating or throttling at least one session on said server.

2. The method of claim 1 further comprising:
(A)(2) accepting said connection request prior to said determining in (B).

3. The method of claim 1 wherein (C) further includes conditionally accepting said content request.

4. The method of claim 1 wherein the determining in (B) is based on at least one measure of then-current load or capacity of the server.

5. The method of claim 4 wherein the at least one measure of load or capacity of the server comprises a measure of one or more of:
processor load; open ports; open connections; bandwidth; and disk usage.

6. The method of claim 1 wherein said content request is accepted even if it is determined, in (B), that handing said content request will cause said server to become overloaded.

7. The method of claim 6 , wherein the content request is for content associated with a particular provider and wherein said content request is accepted based on a service arrangement with said particular provider.

8. The method of claim 7 wherein the service arrangement comprises a quality of service guarantee.

9. The method of claim 6 wherein said content request is accepted based on a size of the requested content.

10. The method of claim 1 wherein said accepting in (C) is based on whether a predicted overload is subject to override.

11. The method of claim 10 wherein whether said predicted overload is subject to override is based on said information about said content request.

12. The method of claim 1 wherein said information about said content request used in (C) comprises a network address associated with said content request.

13. The method of claim 12 wherein accepting said content request in (C) is based on prior activity associated with said network address.

14. The method of claim 1 wherein accepting said content request in (C) is based on capacity on one or more other servers in the CDN.

15. The method of claim 1 wherein throttling said at least one session on said server comprises reducing one or more resources allocated to said at least one session.

16. The method of claim 15 wherein said reducing one or more resources allocated to said at least one session comprises:
reducing an amount of said one or more resources allocated per time period.

17. The method of claim 15 comprising terminating said at least one session when said one or more resources are reduced below a certain level.

18. An article of manufacture comprising a computer-readable medium having program instructions stored thereon, the program instructions, operable on a computer system in a content delivery network (CDN), said device implementing at least one content delivery (CD) service, wherein execution of the program instructions by one or more processors of said computer system causes the one or more processors to carry out the acts of:
at a server in said CDN, wherein said server is currently processing at least one other request in at least one other session:
(A) receiving a content request;
(B) determining whether handling said content request will cause said server to become overloaded; and
(C) based on said determining in (B) and on information about said content request, terminating or throttling at least one session on said server.

19. A device in a content delivery network (CDN), wherein said CDN delivers content on behalf of at least one content provider, said device implementing a content delivery (CD) service, the device:
wherein said device is currently processing at least one other request in at least one other session:
(A) receiving a content request;
(B) determining whether handling said content request will cause said server to become overloaded; and
(C) based on said determining in (B) and on information about said content request, terminating or throttling at least one session on said device.

Assignees

• Level 3 Communications Llc

Inventors

• Power William R
• Newton Christopher
• Lipstone Laurence
• Crowder William

Classifications

• H04L67/1012

  based on compliance of requirements or conditions with available server resources · CPC title

• H04L67/1031

  Controlling of the operation of servers by a load balancer, e.g. adding or removing servers that serve requests · CPC title

• H04L67/61

  taking into account QoS or priority requirements · CPC title

• H04L67/1008 Primary

  based on parameters of servers, e.g. available memory or workload (monitoring of computer activity G06F11/30) · CPC title

• H04L67/14

  Session management (for real-time applications in data packet communications networks H04L65/1066) · CPC title