Method for automatic management of capacity and placement for global services

Patent metadata

Field	Value
Publication number	US-12058056-B1
Application number	US-202117338089-A
Country	US
Kind code	B1
Filing date	Jun 3, 2021
Priority date	Apr 16, 2014
Publication date	Aug 6, 2024
Grant date	Aug 6, 2024

Abstract

Systems and methods for providing web service instances to support traffic demands for a particular web service in a large-scale distributed system are disclosed. An example method includes determining a peak historical service load for the web service. The service load capacity for each existing web service instance may then be determined. The example method may then calculate the remaining service load after subtracting the sum of the service load capacity of the existing web service instances from the peak historical service load for the web service. The number of web service instances necessary in the large-scale distributed system may be determined based on the remaining service load. The locations of the web service instances may be determined and changes may be applied to the large-scale system based on the number of web service instances necessary in the large-scale distributed system.

First claim

The invention claimed is:

1. A method for managing capacity of web service instances running on a computing system, comprising:
determining, a number of web service instances required to support a web service, based on traffic load data associated with the web service and a service load capacity for one or more existing web service instances of the web service;
allocating a given number of web service instances to the web service based on a number of web service requests for the web service and the number of web service instances determined to be required to support the web service; and
assigning, the given number of web service instances allocated, to one or more datacenter cells based on around trip latency between a first set of computers originating the number of web service requests and the one or more datacenter cells for processing the given number of web service instances and on locations of other one or more datacenter cells at which other web service instances required to support the web service are run.

2. The method of claim 1 , wherein the assigning comprises analyzing historical service load data associated with the web service to determine physical origins of web service traffic associated with the web service.

3. The method of claim 2 , wherein the assigning comprises determining a total service load for the web service.

4. The method of claim 1 , wherein the round trip latency used for assigning the given number of web services instances allocated to the one or more datacenter cells is dependent on a given web service.

5. A system for managing capacity of web service instances running on a computing system, comprising:
one or more processing devices; and
one more storage devices storing instructions that, when executed by the one or more processing devices cause the one or more processing devices to:
determine a number of web service instances required to support a web service based on traffic load data associated with the web service and a service load capacity for one or more existing web service instances of the web service;
allocate a given number of web service instances to the web service based on a number of web service requests for the web service and the number of web service instances determined to be required to support the web service; and
assign, the given number of web service instances allocated, to one or more datacenter cells based on a round trip latency between a first set of computers originating the number of web service requests and the one or more datacenter cells for processing the given number of web service instances and on locations of other one or more datacenter cells at which other web service instances required to support the web service are run.

6. The system of claim 5 , wherein to cause the one or more processing devices to assign comprises analyzing historical service load for the web service to determine physical origins of web service traffic associated with the web service.

7. The system of claim 6 , wherein the assigning comprises determining a total service load for the web service.

8. The system of claim 5 , wherein the round trip latency used for assigning the given number of web services instances allocated to the one or more datacenter cells is dependent on a given web service.

Assignees

• Google Llc

Inventors

• Skalski Kamil
• Czajka Elzbieta
• Grzadkowski Filip
• Grygiel Krzysztof

Classifications

• H04L67/1001

  for accessing one among a plurality of replicated servers · CPC title

• H04L41/5083

  wherein the managed service relates to web hosting · CPC title

• H04L41/5054

  Automatic deployment of services triggered by the service manager, e.g. service implementation by automatic configuration of network components · CPC title

• G06F9/5083

  Techniques for rebalancing the load in a distributed system · CPC title

• H04L47/125

  by balancing the load, e.g. traffic engineering · CPC title