Load balancing of resources

Patent metadata

Field	Value
Publication number	US-11704166-B2
Application number	US-202117321299-A
Country	US
Kind code	B2
Filing date	May 14, 2021
Priority date	Aug 26, 2013
Publication date	Jul 18, 2023
Grant date	Jul 18, 2023

Abstract

Embodiments presented herein techniques for balancing a multidimensional set of resources of different types within a distributed resources system. Each host computer providing the resources publishes a status on current resource usage by guest clients. Upon identifying a local imbalance, the host computer determines a source workload to migrate to or from the resources container to minimize the variance in resource usage. Additionally, when placing a new resource workload, the host computer selects a resources container that minimizes the variance to further balance resource usage.

First claim

We claim:

1. A method for placing workloads on storage groups of a distributed storage system, wherein the distributed storage system comprises a plurality of physical storage devices divided into a plurality of storage groups, wherein each storage group of the plurality of storage groups comprises a corresponding set of physical storage devices of the plurality of physical storage devices, wherein the corresponding set of physical storage devices of each storage group of the plurality of storage groups comprises a first type of physical storage device and a second type of physical storage device, the method comprising:
determining, for each storage group of the plurality of storage groups, a corresponding variance between a corresponding first amount of storage used of the first type of physical storage device and a corresponding second amount of storage used of the second type of physical storage device of the corresponding set of physical storage devices, wherein data associated with a first workload is stored on a first storage group of the plurality of storage groups;
determining, for each storage group of the plurality of storage groups other than the first storage group, an expected change in the corresponding variance between the corresponding first amount of storage used of the first type of physical storage device and the corresponding second amount of storage used of the second type of physical storage device based on migrating the data associated with the first workload from the first storage group to the corresponding storage group of the plurality of storage groups; and
migrating the data associated with the first workload from the first storage group to a second storage group of the plurality of storage groups based on the determined expected change in the corresponding variance between the corresponding first amount of storage used of the first type of physical storage device and the corresponding second amount of storage used of the second type of physical storage device of the second storage group being a decrease in the corresponding variance of the second storage group and based on the migrating decreasing the corresponding variance of the first storage group.

2. The method of claim 1 , wherein:
the first type of physical storage device comprises solid state disk, and
the second type of physical storage device comprises magnetic disk.

3. The method of claim 1 , wherein:
the first workload comprises a virtual machine, and
the data associated with the first workload comprises a virtual disk.

4. The method of claim 1 , wherein:
for multiple storage groups the expected change in the corresponding variance between the corresponding first amount of storage used of the first type of physical storage device and the corresponding second amount of storage used of the second type of physical storage device of the corresponding storage group comprises a decrease in the corresponding variance, and
the second storage group is selected at random from the multiple storage groups.

5. The method of claim 1 , further comprising selecting the plurality of storage groups other than the first storage group from a set of storage groups based on each of the plurality of storage groups having sufficient resources to satisfy requirements of the first workload.

6. The method of claim 1 , wherein:
for multiple storage groups the expected change in the corresponding variance between the corresponding first amount of storage used of the first type of physical storage device and the corresponding second amount of storage used of the second type of physical storage device of the corresponding storage group comprises a decrease in the corresponding variance, and
the second storage group is selected from the multiple storage groups based on the second storage group having more available resources than other storage groups of the multiple storage groups.

7. The method of claim 1 , further comprising migrating data associated with a second workload from the second storage group to the first storage group based on the migrating decreasing the corresponding variance between the corresponding first amount of storage used of the first type of physical storage device and the corresponding second amount of storage used of the second type of physical storage device of the first storage group and the corresponding variance between the corresponding first amount of storage used of the first type of physical storage device and the corresponding second amount of storage used of the second type of physical storage device of the second storage group.

8. The method of claim 1 , further comprising migrating data associated with a second workload from a third storage group of the plurality of storage groups to the first storage group based on the migrating decreasing the corresponding variance between the corresponding first amount of storage used of the first type of physical storage device and the corresponding second amount of storage used of the second type of physical storage device of the first storage group and the corresponding variance between the corresponding first amount of storage used of the first type of physical storage device and the corresponding second amount of storage used of the second type of physical storage device of the third storage group.

9. A system comprising:
at least one memory; and
at least one processor, the at least one memory and the at least one processor configured to perform operations for placing workloads on storage groups of a distributed storage system, wherein the distributed storage system comprises a plurality of physical storage devices divided into a plurality of storage groups, wherein each storage group of the plurality of storage groups comprises a corresponding set of physical storage devices of the plurality of physical storage devices, wherein the corresponding set of physical storage devices of each storage group of the plurality of storage groups comprises a first type of physical storage device and a second type of physical storage device, the operations comprising:
determining, for each storage group of the plurality of storage groups, a corresponding variance between a corresponding first amount of storage used of the first type of physical storage device and a corresponding second amount of storage used of the second type of physical storage device of the corresponding set of physical storage devices, wherein data associated with a first workload is stored on a first storage group of the plurality of storage groups;
determining, for each storage group of the plurality of storage groups other than the first storage group, an expected change in the corresponding variance between the corresponding first amount of storage used of the first type of physical storage device and the corresponding second amount of storage used of the second type of physical storage device based on migrating the data associated with the first workload from the first storage group to the corresponding storage group of the plurality of storage groups; and
migrating the data associated with the first workload from the first storage group to a second storage group of the plurality of storage groups based on the determined expected change in the corresponding variance between the corresponding first amount of storage used of the first type of physical storage device and the corresponding second amount of storage used of the second type of physical storage device of the second storage group being a decrease in the corresponding variance of the second storage group and based on the migrating decreasing the corresponding variance of the first storage group.

10. The system of claim 9 , wherein:
the first type of physic

Assignees

• Vmware Inc

Inventors

• Karamanolis Christos
• Earl William
• Shah Mansi
• Burnett Nathan

Classifications

• G06F9/5083 Primary

  Techniques for rebalancing the load in a distributed system · CPC title

• G06F9/5016

  the resource being the memory · CPC title