Execution offset rate limiter

Patent metadata

Field	Value
Publication number	US-12101239-B2
Application number	US-202318106953-A
Country	US
Kind code	B2
Filing date	Feb 7, 2023
Priority date	May 9, 2022
Publication date	Sep 24, 2024
Grant date	Sep 24, 2024

Abstract

A system includes a device coupled to a processing device. The processing device is to receive a request to execute a plurality of workloads, the request comprising a rate to execute each workload of the plurality of workloads and a parameter value indicating an execution offset. The processing device is further to determine a sequence for executing the plurality of workloads based on receiving the rate and the parameter value, where the sequence is to execute each workload at the respective rate and each workload of the plurality of workloads is executed at a different time based on the parameter value. The processing device is to execute the plurality of workloads in accordance with the sequence upon determining the sequence to execute the plurality of workloads.

First claim

What is claimed is:

1. A system comprising:
a device coupled to a processing device and including a rate limiter, the processing device to:
receive a request to execute a plurality of workloads, the request comprising a plurality of rates to execute the plurality of workloads and at least one parameter value indicating an offset value representing a timing offset between execution of corresponding workloads;
determine, using the rate limiter, a sequence for executing the plurality of workloads based on receiving the plurality of rates and the at least one parameter value, wherein the sequence is to cause each workload of the plurality of workloads to be executed at a respective rate of the plurality of rates and at a different time based on the at least one parameter value; and
execute the plurality of workloads in accordance with the sequence upon determining the sequence to execute the plurality of workloads.

2. The system of claim 1 , wherein the respective rate for each workload of the plurality of workloads is different.

3. The system of claim 1 , wherein the at least one parameter value indicates a number of offsets between executing workloads of the plurality of workloads and an offset index.

4. The system of claim 1 , wherein the at least one parameter value indicates an inter packet burst gap, a number of offsets between executing workloads of the plurality of workloads, and an offset index.

5. The system of claim 1 , wherein the at least one parameter value indicates an inter packet burst gap and a time offset between each workload of the plurality of workloads.

6. The system of claim 1 , wherein the at least one parameter value indicates an inter packet burst gap and a time to execute a first workload of the plurality of workloads.

7. The system of claim 1 , wherein the respective rate of each workload is equal, and wherein the processing device is to:
determine an offset between executing workloads of the plurality of workloads responsive to the respective rate of each workload being equal.

8. The system of claim 1 , wherein to execute the plurality of workloads, the processing device is to:
transmit a packet of a plurality of packets in accordance with the sequence.

9. The system of claim 1 , wherein the processing device is further to:
receive a plurality of requests, wherein each request of the plurality of requests is associated with executing a respective plurality of workloads, and wherein each request comprises a plurality of rates to execute the respective plurality of workloads; and
determine a sequence to execute each request of the plurality of requests responsive to receiving the plurality of requests.

10. A system comprising:
a device coupled to a processing device and including a rate limiter, the processing device to:
receive a request to execute a plurality of workloads, the request comprising a plurality of rates to execute the plurality of workloads and an indication to execute each workload of the plurality of workloads at a different time;
determine, using the rate limiter, an offset value for executing each workload of the plurality of workloads at the different time;
determine, using the rate limiter, a sequence for executing the plurality of workloads based on receiving the rate of each workload of the plurality of workloads and determining the offset value, wherein the sequence is to cause each workload of the plurality of workloads to be executed at a respective rate of the plurality of rates and be transmitted at a different time; and
execute the plurality of workloads in accordance with the sequence upon determining the sequence to execute the plurality of workloads.

11. The system of claim 10 , wherein the respective rate for each workload of the plurality of workloads is different.

12. The system of claim 10 , wherein the offset value indicates a number of offsets between executing workloads of the plurality of workloads and an offset index.

13. The system of claim 10 , wherein the offset value indicates an inter packet burst gap, a number of offsets between executing workloads of the plurality of workloads, and an offset index.

14. The system of claim 10 , wherein the offset value indicates an inter packet burst gap and a time offset between each workload of the plurality of workloads.

15. The system of claim 10 , wherein the offset value indicates an inter packet burst gap and a time to execute a first workload of the plurality of workloads.

16. A system comprising:
a first set of devices, wherein each device of the first set of devices is configured to execute a plurality of workloads;
a second device configured to receive data associated with an execution of the plurality of workloads; and
a switch coupled with the first set of devices and the second device, wherein the switch is configured to route data associated with the execution of the plurality of workloads at the first set of devices to the second device, and wherein each device of the first set of devices is configured to:
receive a request to execute a plurality of workloads, the request comprising a plurality of rates to execute plurality of workloads and a parameter value indicating an offset value representing a timing offset between execution of corresponding workloads; and
execute each workload of the plurality of workloads according to a respective rate of the plurality of rates and a respective timing offset, wherein the switch is configured to receive data associated with a workload from a respective device of the first set of devices at a respective time.

17. The system of claim 16 , wherein the first set of devices are further configured to: transmit one or more packets responsive to executing a plurality of workloads.

18. The system of claim 17 , wherein the switch is further configured to:
receive the one or more packets from the first set of devices; and
route the one or more packets from the first set of devices to the second device.

19. The system of claim 16 , wherein the rate for each workload of the plurality of workloads is different.

20. The system of claim 16 , wherein the parameter value indicates a number of offsets between executing workloads of the plurality of workloads and an offset index.

Assignees

• Mellanox Technologies Ltd

Inventors

• Manevich Natan
• Levi Dotan David
• Moyal Roee

Classifications

• H04L47/263

  Rate modification at the source after receiving feedback · CPC title

• H04L47/225 Primary

  Determination of shaping rate, e.g. using a moving window · CPC title

• H04L47/25

  with rate being modified by the source upon detecting a change of network conditions · CPC title

• H04J3/0667

  Bidirectional timestamps, e.g. NTP or PTP for compensation of clock drift and for compensation of propagation delays (arrangements for monitoring round trip delays in packet switching networks H04L43/0864) · CPC title

• H04J3/0652

  Synchronisation among time division multiple access [TDMA] nodes, e.g. time triggered protocol [TTP] (bus network with centralized control in which slots are of a TDMA packet structure H04L12/4035) · CPC title