Facilitating workload-aware shuffling and management of message types in message queues in an on-demand services environment

Patent metadata

Field	Value
Publication number	US-2016119244-A1
Application number	US-201414526135-A
Country	US
Kind code	A1
Filing date	Oct 28, 2014
Priority date	Oct 28, 2014
Publication date	Apr 28, 2016
Grant date	—

Abstract

In accordance with embodiments, there are provided mechanisms and methods for facilitating dynamic workload-aware shuffling of message types in message queues in an on-demand services environment in a multi-tenant environment according to one embodiment. In one embodiment and by way of example, a method includes monitoring, in runtime, workload patterns associated with incoming workloads, where each workload is associated with a plurality of message types and the plurality of message types are inspected and processed in a predetermined order. The method may further include collecting, in runtime, information regarding each message type based on a workload pattern of its associated workload, and dynamically shuffling the order based on the information, where shuffling includes ordering a first set of message types having one or more messages ahead of a second set of message types having fewer or no messages.

First claim

What is claimed is:

1 . A database system-implemented method, comprising:
monitoring, in runtime, by and incorporating into the database system, workload patterns associated with incoming workloads, wherein each workload is associated with a plurality of message types and the plurality of message types are at least one of inspected and processed in a pre-determined order; collecting, in runtime, by the database system, information regarding each message type based on a workload pattern of its associated workload; and dynamically shuffling, in runtime, by the database system, the order based on the information, wherein shuffling includes ordering a first set of message types having one or more messages ahead of a second set of message types having fewer or no messages.

2 . The method of claim 1 , further comprising segmenting, based on the information, the plurality of message types into a first group having the first set of message types, and a second group having the second set of message types, wherein segmenting is performed based on traffic levels associated with the plurality of message types based on corresponding workload patterns.

3 . The method of claim 2 , further comprising constructing, based on the segmentation, a list having the first and second groups having the first and second sets of message types, wherein the first set of message types comprises high traffic message types, and the second set of message types comprises low traffic message types.

4 . The method of claim 3 , wherein the first group is placed in front of the list, and the second group placed in rear of the list, wherein a list placement order of the first and second groups in the list corresponds to an order in which messages are dequeued and processed from queues belonging to the first and second sets of message types.

5 . The method of claim 4 , further comprising randomly shuffling the high traffic message types within the first group, wherein the low traffic message types are shuffled within the second group.

6 . The method of claim 1 , further comprising evaluating the information, wherein evaluating includes determining the traffic levels, wherein a traffic level is associated with each message type of the plurality of message types, wherein the traffic level includes at least one of a high traffic level and a low traffic level.

7 . The method of claim 6 , wherein the high traffic level is associated with the high traffic message types, and the low traffic level is associated with the low traffic message types.

8 . The method of claim 6 , further comprising resetting data associated with the traffic levels over predetermined periods of time, wherein resetting includes facilitating the determination of the traffic levels over the predetermined periods of time, and detecting changes in the data associated with the traffic levels, wherein resetting further includes modifying the list based on the changes in the data.

9 . A system comprising:
a processor and a memory to execute instructions at the system; and a mechanism to: monitor, in runtime, workload patterns associated with incoming workloads, wherein each workload is associated with a plurality of message types and the plurality of message types are at least one of inspected and processed in a pre-determined order; collect, in runtime, information regarding each message type based on a workload pattern of its associated workload; and dynamically shuffle, in runtime, the order based on the information, wherein shuffling includes ordering a first set of message types having one or more messages ahead of a second set of message types having fewer or no messages.

10 . The system of claim 9 , wherein the mechanism is further to segment, based on the information, the plurality of message types into a first group having the first set of message types, and a second group having the second set of message types, wherein segmenting is performed based on traffic levels associated with the plurality of message types based on corresponding workload patterns.

11 . The system of claim 10 , wherein the mechanism is further to construct, based on the segmentation, a list having the first and second groups having the first and second sets of message types, wherein the first set of message types comprises high traffic message types, and the second set of message types comprises low traffic message types.

12 . The system of claim 11 , wherein the first group is placed in front of the list, and the second group placed in rear of the list, wherein a list placement order of the first and second groups in the list corresponds to an order in which messages are dequeued and processed from queues belonging to the first and second sets of message types.

13 . The system of claim 12 , wherein the mechanism is further to randomly shuffle the high traffic message types within the first group, wherein the low traffic message types are shuffled within the second group.

14 . The system of claim 9 , wherein the mechanism is further to evaluate the information, wherein evaluating includes determining the traffic levels, wherein a traffic level is associated with each message type of the plurality of message types, wherein the traffic level includes at least one of a high traffic level and a low traffic level.

15 . The system of claim 14 , wherein the high traffic level is associated with the high traffic message types, and the low traffic level is associated with the low traffic message types.

16 . The system of claim 14 , wherein the mechanism is further to reset data associated with the traffic levels over predetermined periods of time, wherein resetting includes facilitating the determination of the traffic levels over the predetermined periods of time, and detecting changes in the data associated with the traffic levels, wherein resetting further includes modifying the list based on the changes in the data.

17 . A machine-readable medium comprising a plurality of instructions which, when executed by a processing device, cause the processing device to perform one or more operations comprising:
monitoring, in runtime, workload patterns associated with incoming workloads, wherein each workload is associated with a plurality of message types and the plurality of message types are at least one of inspected and processed in a pre-determined order; collecting, in runtime, information regarding each message type based on a workload pattern of its associated workload; and dynamically shuffling, in runtime, the order based on the information, wherein shuffling includes ordering a first set of message types having one or more messages ahead of a second set of message types having fewer or no messages.

18 . The machine-readable medium of claim 17 , wherein the one or more operations comprise segmenting, based on the information, the plurality of message types into a first group having the first set of message types, and a second group having the second set of message types, wherein segmenting is performed based on traffic levels associated with the plurality of message types based on corresponding workload patterns.

19 . The machine-readable medium of claim 18 , wherein the one or more operations comprise constructing, based on the segmentation, a list having the first and second groups having the first and second sets of message types, wherein the first set of message types comprises high traffic message types, and the second set of message types comprises low traffic message types.

20 .

Assignees

• Salesforce Com Inc

Inventors

• Wang Xiaodan
• Devadhar Vijayanth

Classifications

• H04L47/50 Primary

  Queue scheduling · CPC title

• H04L43/0876 Primary

  Network utilisation, e.g. volume of load or congestion level · CPC title

• H04L47/80

  Actions related to the user profile or the type of traffic · CPC title

• H04L41/5051

  Service on demand, e.g. definition and deployment of services in real time · CPC title

• H04L43/0817

  by checking functioning · CPC title