Technology to measure latency in hardware with fine-grained transactional filtration

Patent metadata

Field	Value
Publication number	US-12367063-B2
Application number	US-202117553359-A
Country	US
Kind code	B2
Filing date	Dec 16, 2021
Priority date	Dec 16, 2021
Publication date	Jul 22, 2025
Grant date	Jul 22, 2025

Abstract

Methods, systems and apparatuses may provide for technology that includes configuration registers to maintain state information, a filter coupled to the configuration registers, the filter to extract transactions of interest from a plurality of incoming transactions based on the state information, wherein the transactions of interest are extracted on a transaction-by-transaction basis, a first hardware path coupled to the filter, the first hardware path to generate a count of the transactions of interest on a cycle-by-cycle basis, a second hardware path coupled to the filter, the second hardware path to measure a total latency of the transactions of interest on the cycle-by-cycle basis, and an output interface coupled to the first hardware path and the second hardware path, the output interface to determine an average latency of the transactions of interest based on the count of the transactions of interest and the total latency of the transactions of interest.

First claim

We claim:

1. A computing system comprising:
a network controller; and
a graphics processor coupled to the network controller, the graphics processor including:
a set of configuration registers to maintain state information,
a filter coupled to the set of configuration registers, the filter to extract transactions of interest from a plurality of incoming transactions based on the state information, wherein the transactions of interest are extracted on a transaction-by-transaction basis,
a first hardware path coupled to the filter, the first hardware path to generate a count of the transactions of interest on a cycle-by-cycle basis,
a second hardware path coupled to the filter, the second hardware path to measure a total latency of the transactions of interest on the cycle-by-cycle basis, and
an output interface coupled to the first hardware path and the second hardware path, the output interface to determine an average latency of the transactions of interest based on the count of the transactions of interest and the total latency of the transactions of interest.

2. The computing system of claim 1 , wherein the second hardware path includes:
a first latency counter,
a first latency register coupled to an output of the first latency counter,
a second latency counter coupled to an output of the first latency register, and
a second latency register coupled to an output of the second latency counter.

3. The computing system of claim 2 , wherein the output of the first latency register is to indicate a number of outstanding transactions.

4. The computing system of claim 1 , wherein the first hardware path includes:
a first transaction register,
a transaction counter coupled to an output of the first transaction register, and
a second transaction register coupled to an output of the transaction counter.

5. The computing system of claim 1 , wherein the filter is to generate a start count signal and a stop count signal, send the start count signal to the first hardware path, and send the start count signal and the stop count signal to the second hardware path.

6. The computing system of claim 5 , wherein the start count signal is generated based on the state information and sideband data associated with the transactions of interest, and wherein the filter is to set one or more in-flight tracking bits associated with the transactions of interest.

7. The computing system of claim 6 , wherein stop count signal is generated based on the one or more in-flight tracking bits.

8. The computing system of claim 1 , wherein the state information is to specify one or more transaction categories.

9. An apparatus comprising:
a set of configuration registers to maintain state information;
a filter coupled to the set of configuration registers, the filter to extract transactions of interest from a plurality of incoming transactions based on the state information, wherein the transactions of interest are extracted on a transaction-by-transaction basis;
a first hardware path coupled to the filter, the first hardware path to generate a count of the transactions of interest on a cycle-by-cycle basis;
a second hardware path coupled to the filter, the second hardware path to measure a total latency of the transactions of interest on the cycle-by-cycle basis; and
an output interface coupled to the first hardware path and the second hardware path, the output interface to determine an average latency of the transactions of interest based on the count of the transactions of interest and the total latency of the transactions of interest.

10. The apparatus of claim 9 , wherein the second hardware path includes:
a first latency counter;
a first latency register coupled to an output of the first latency counter;
a second latency counter coupled to an output of the first latency register; and
a second latency register coupled to an output of the second latency counter.

11. The apparatus of claim 10 , wherein the output of the first latency register is to indicate a number of outstanding transactions.

12. The apparatus of claim 9 , wherein the first hardware path includes:
a first transaction register;
a transaction counter coupled to an output of the first transaction register; and
a second transaction register coupled to an output of the transaction counter.

13. The apparatus of claim 9 , wherein the filter is to generate a start count signal and a stop count signal, send the start count signal to the first hardware path, and send the start count signal and the stop count signal to the second hardware path.

14. The apparatus of claim 13 , wherein the start count signal is generated based on the state information and sideband data associated with the transactions of interest, and wherein the filter is to set one or more in-flight tracking bits associated with the transactions of interest.

15. The apparatus of claim 14 , wherein stop count signal is generated based on the one or more in-flight tracking bits.

16. The apparatus of claim 9 , wherein the state information is to specify one or more transaction categories.

17. A method comprising:
maintaining, by a set of configuration registers, state information;
extracting, by a filter coupled to the set of configuration registers, transactions of interest from a plurality of incoming transactions based on the state information, wherein the transactions of interest are extracted on a transaction-by-transaction basis;
generating, by a first hardware path coupled to the filter, a count of the transactions of interest on a cycle-by-cycle basis;
measuring, by a second hardware path coupled to the filter, a total latency of the transactions of interest on the cycle-by-cycle basis; and
determining, by an output interface coupled to the first hardware path and the second hardware path, an average latency of the transactions of interest based on the count of the transactions of interest and the total latency of the transactions of interest.

18. The method of claim 17 , wherein the second hardware path includes, a first latency counter, a first latency register coupled to an output of the first latency counter, a second latency counter coupled to an output of the first latency register, and a second latency register coupled to an output of the second latency counter.

19. The method of claim 18 , wherein the output of the first latency register indicates a number of outstanding transactions.

20. The method of claim 17 , wherein the first hardware path includes a first transaction register, a transaction counter coupled to an output of the first transaction register, and a second transaction register coupled to an output of the transaction counter.

21. The method of claim 17 , further including:
generating, by the filter, a start count signal and a stop count signal;
sending, by the filter, the start count signal to the first hardware path; and
sending, by the filter, the start count signal and the stop count signal to the second hardware path.

22. The method of claim 21 , wherein the start count signal is generated based on the state information and sideband data associated with the transactions of interest, the method further including setting, by the filter, one or more in-flight tracking bits associated with the transactions of interest.

23. The method of claim 22 , wherein stop count signal is generated based on the one or more in-flight tracking bits.

24. The method of claim 17 , wherei

Assignees

• Intel Corp

Inventors

• Cole Michael
• K Pattabhiraman
• Agarwal Ankita A

Classifications

• G06F2201/87

  Monitoring of transactions · CPC title

• G06F11/3006

  where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems (multiprogramming arrangements G06F9/46; allocation of resources G06F9/50) · CPC title

• G06F2201/88

  Monitoring involving counting · CPC title

• G06F11/3072

  where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting · CPC title

• G06F11/3452

  Performance evaluation by statistical analysis · CPC title