Facilitating equitable distribution of thread resources for job types associated with tenants in a multi-tenant on-demand services environment

Patent metadata

Field	Value
Publication number	US-9529626-B2
Application number	US-201313841417-A
Country	US
Kind code	B2
Filing date	Mar 15, 2013
Priority date	Sep 12, 2012
Publication date	Dec 27, 2016
Grant date	Dec 27, 2016

Abstract

In accordance with embodiments, there are provided mechanisms and methods for facilitating a fair allocation and usage of thread resources for user messages according to one embodiment in an on-demand services environment. In one embodiment and by way of example, a method includes tracking resource usage associated with a plurality of messages performed and completed in response to requests placed by a user via a user interface at a computing device, where the tracking includes recording an amount of resources consumed by each completed message. The method may further include classifying the plurality of messages into job types based on the tracked resource usage associated with the plurality of messages, and enforcing, based on the classification of the messages, a message selection process to ensure equitable distribution of resources to subsequently received messages.

First claim

What is claimed is:

1. A database system-implemented method, comprising:
tracking, by the database system, resource usage associated with a plurality of job types requested by one or more tenants in a multi-tenant environment;
calculating, by the database system, a deficiency factor suffered by a job type associated with a tenant, wherein the deficiency factor is based on an actual usage and an expected usage of resources by the job type, wherein the deficiency factor indicates deficiency in usage of the resources by the job type such that the deficiency corresponds to the actual usage of the resources by the job type being lower than the expected usage assigned to the job type by measuring the usage over multiple predetermined segments of time, wherein the deficiency being temporary deficiency or chronic deficiency based on high latency in queuing time or high usage of the resources by one or more of the plurality of job types; and
enforcing, by the database system, an equitable distribution of the resources for the plurality of job types by adjusting a current distribution representing an inequitable distribution, wherein adjusting includes selectively lowering the high usage of the resources by the one or more job types until the deficiency factor is inconsequential such that the actual usage by the job type has increased to match the expected usage.

2. The method of claim 1 , wherein calculating further comprises:
computing the actual usage by the job type and one or more actual usages representing the high usage by the one or more job types; and
computing the expected usage associated with the job type and one or more expected usages associated with the one or more job types.

3. The method of claim 1 , wherein enforcing comprises triggering fair usage to ensure the equitable distribution of the resources for the plurality of job types.

4. The method of claim 3 , wherein triggering comprises prioritizing one or more work hosts associated with the job type to boost processing of tasks associated with the job type, wherein prioritizing is performed over the multiple predetermined segments of time.

5. The method of claim 1 , further comprising receiving a job request to perform the job type, wherein the job request is placed at a computing device associated with the tenant in the multi-tenant environment, wherein the job request is placed by a user having access to the computing device.

6. The method of claim 1 , wherein the resource usage comprises usage of thread resources, wherein the thread resources are accessed via a plurality of message queues.

7. The method of claim 1 , wherein selectively lowering the high usage comprises: minimizing the deficiency factor by automatically adapting a selection process for selection of the plurality of job types; and real-time tracking of the resource usage based on at least one of a sliding window scale, fairness usage, queuing time, and adaptive intervention via configurable threshold, wherein the sliding window scale to facilitate the multiple predetermined segments of time.

8. A system comprising a computing device having a memory device to store instructions, and a processing device to execute the instructions to facilitate a mechanism to perform operations comprising:
tracking, resource usage associated with a plurality of job types requested by one or more tenants in a multi-tenant environment;
calculating, a deficiency factor suffered by a job type associated with a tenant, wherein the deficiency factor is based on an actual usage and an expected usage of resources by the job type, wherein the deficiency factor indicates deficiency in usage of the resources by the job type such that the deficiency corresponds to the actual usage of the resources by the job type being lower than the expected usage assigned to the job type by measuring the usage over multiple predetermined segments of time, wherein the deficiency being temporary deficiency or chronic deficiency based on high latency in queuing time or high usage of the resources by one or more of the plurality of job types; and
enforcing an equitable distribution of the resources for the plurality of job types by adjusting a current distribution representing an inequitable distribution, wherein adjusting includes selectively lowering the high usage of the resources by the one or more job types until the deficiency factor is inconsequential such that the actual usage by the job type has increased to match the expected usage.

9. The system of claim 8 , wherein the calculating comprises:
computing the actual usage by the job type and one or more actual usages representing the high usage by the one or more job types; and
computing the expected usage associated with the job type and one or more expected usages associated with the one or more job types.

10. The system of claim 8 , wherein enforcing comprise triggering fair usage to ensure the equitable distribution of the resources for the plurality of job types.

11. The system of claim 10 , wherein triggering comprises prioritizing one or more work hosts associated with the job type to boost processing of tasks associated with the job type, wherein prioritizing is performed over the multiple predetermined segments of time.

12. The system of claim 8 , wherein the operations further comprise receiving a job request to perform the job type, wherein the job request is placed at a computing device associated with the tenant in the multi-tenant environment, wherein the job request is placed by a user having access to the computing device.

13. The system of claim 8 , wherein the resource usage comprises usage of thread resources, wherein the thread resources are accessed via a plurality of message queues.

14. The system of claim 8 , wherein selectively lowering the high usage comprises:
minimizing the deficiency factor by automatically adapting a selection process for selection of the plurality of job types; and
real-time tracking of the resource usage based on at least one of a sliding window scale, fairness usage, queuing time, and adaptive intervention via configurable threshold, wherein the sliding window scale to facilitate the multiple predetermined segments of time.

15. A non-transitory machine-readable medium having stored thereon instructions which, when executed by a machine, cause the machine to perform operations comprising:
tracking resource usage associated with a plurality of job types requested by one or more tenants in a multi-tenant environment;
calculating a deficiency factor suffered by a job type associated with a tenant, wherein the deficiency factor is based on an actual usage and an expected usage of resources by the job type, wherein the deficiency factor indicates deficiency in usage of the resources by the job type such that the deficiency corresponds to the actual usage of the resources by the job type being lower than the expected usage assigned to the job type by measuring the usage over multiple predetermined segments of time, wherein the deficiency being temporary deficiency or chronic deficiency based on high latency in queuing time or high usage of the resources by one or more of the plurality of job types; and
enforcing an equitable distribution of the resources for the plurality of job types by adjusting a current distribution representing an inequitable distribution, wherein adjusting includes selectively lowering the high usage of the resources by the one or more job types until the deficiency factor is inconsequential such that the actual usage by the job type has increased to match the expected usage.

16. The non-trans

Assignees

• Salesforce Com Inc
• Salesforce Com Inc

Inventors

• Wang Xiaodan
• Devadhar Vijayanth
• Murugesan Praveen

Classifications

• H04L41/30

  Decision processes by autonomous network management units using voting and bidding · CPC title

• H04L47/50

  Queue scheduling · CPC title

• G06F21/40

  by quorum, i.e. whereby two or more security principals are required · CPC title

• G06F2209/508

  Monitor · CPC title

• G06F9/5027

  the resource being a machine, e.g. CPUs, Servers, Terminals · CPC title