Latency monitoring for network devices

Patent metadata

Field	Value
Publication number	US-10411983-B2
Application number	US-201715598105-A
Country	US
Kind code	B2
Filing date	May 17, 2017
Priority date	May 18, 2016
Publication date	Sep 10, 2019
Grant date	Sep 10, 2019

Abstract

A network device comprises time measurement units configured to measure receipt times and transmit times of packets received/transmitted via network interfaces. One or more memories store configuration information that indicates certain network interface pairs and/or certain packet flows that are enabled for latency measurement. A packet processor includes a latency monitoring trigger unit configured to select, using the configuration information, packets that are forwarded between the certain network interface pairs and/or that belong to the certain packet flows for latency monitoring. One or more latency measurement units determine respective latencies for packets selected by the latency monitoring trigger unit using respective receipt times and respective transmit times for the packets selected by the latency monitoring trigger unit, calculates latency statistics for the certain network interface pairs and/or the certain packet flows using the respective latencies, and stores the latency statistics in the one or more memories.

First claim

What is claimed is:

1. A network device, comprising:
a plurality of network interfaces configured to couple to a plurality of network links, wherein network interfaces among the plurality of network interfaces include, or are associated with, respective time measurement units configured to measure a) receipt times at which packets are received via network links and b) transmit times at which packets are transmitted via network links;
one or more memories to store configuration information, the configuration information indicating certain network interface pairs and/or certain packet flows that are enabled for latency measurement;
a packet processor coupled to the plurality of network interfaces, the packet processor including:
a latency monitoring trigger unit coupled to the one or more memories, the latency monitoring trigger unit configured to select, using the configuration information, packets that are forwarded between the certain network interface pairs and/or that belong to the certain packet flows for latency monitoring; and

one or more latency measurement units coupled to the one or more memories, the one or more latency measurement units configured to:
determine respective latencies for packets selected by the latency monitoring trigger unit using respective receipt times and respective transmit times for the packets selected by the latency monitoring trigger unit, so that, for packets that are not selected by the latency monitoring trigger unit, no latencies are determined by the network device,
calculate latency statistics for the certain network interface pairs and/or the certain packet flows using the respective latencies,
store the latency statistics in the one or more memories,
calculate, as an exponentially weighted moving average (EWMA), an updated average latency using a previously calculated average latency stored in the one or more memories and a determined latency for a packet, and
store the updated average latency in the one or more memories.

2. The network device of claim 1 , wherein:
the one or more memories store per-interface information indicating network interfaces, among the plurality of network interfaces, that are enabled for latency measurement; and
the latency monitoring trigger unit is configured to:
identify packets that are being forwarded between pairs of enabled network interfaces using the per-interface information, and
responsive to identifying packets that are being forwarded between pairs of enabled network interfaces, select packets for latency monitoring that are being forwarded between pairs of enabled network interfaces.

3. The network device of claim 1 , wherein:
the packet processor includes a classifier configured to identify packet flows with which packets are associated;
the one or more memories store packet flow configuration information indicating packet flows, among a plurality of packet flows, that are enabled for latency measurement; and
the latency monitoring trigger unit is configured to:
identify packets that belong to flows enabled for latency measurement using the packet flow configuration information, and
responsive to identifying packets that belong to flows enabled for latency measurement, select packets for latency monitoring that belong to flows enabled for latency measurement.

4. The network device of claim 1 , wherein:
the packet processor is configured to generate respective packet descriptors for packets received via the plurality of network interfaces;
the latency monitoring trigger unit is configured to store, in selected packet descriptors, information that indicates packets corresponding to the selected packet descriptors are selected for latency monitoring; and
the one or more latency measurement units are configured to determine for which packets latency statistics are to be calculated using information in the packet descriptors.

5. The network device of claim 4 , wherein:
the latency monitoring trigger unit is configured to store, in packet descriptors corresponding to packets selected for latency monitoring, information that indicates where in the one or more memories latency statistics for packets selected for latency monitoring are to be stored; and
the one or more latency measurement units are configured to store latency statistics in the one or more memories at locations determined using information in the packet descriptors.

6. The network device of claim 1 , wherein the one or more latency measurement units are configured to:
determine the latency for the packet by comparing a receipt time of the packet and a transmit time of the packet.

7. The network device of claim 1 , wherein:
the one or more latency measurement units include one or more shift registers; and
the one or more latency measurement units are configured to calculate the EWMA at least by:
calculating a multiplication of the previously calculated average latency by a parameter by left shifting the previously calculated average latency in the one or more shift registers, and
calculating a division of an intermediate calculation by the parameter by right shifting the previously calculated average latency in the one or more shift registers.

8. The network device of claim 1 , wherein:
the one or more memories comprise a first memory and a second memory;
the first memory stores the configuration information;
the latency monitoring trigger unit is coupled to the first memory and is configured to use the configuration information stored in the first memory; and
the one or more latency measurement units are coupled to the second memory and are configured to store the latency statistics in the second memory.

9. The network device of claim 1 , wherein:
the one or more memories comprise a single memory;
the single memory stores the configuration information;
the latency monitoring trigger unit is coupled to the single memory and is configured to use the configuration information stored in the single memory; and
the one or more latency measurement units are coupled to the single memory and are configured to store the latency statistics in the single memory.

10. The network device of claim 1 , wherein at least some of the latency measurement units are included in respective network interfaces.

11. A method, comprising:
receiving a plurality of packets via a plurality of network interfaces of a network device;
measuring, at the network device, respective receipt times at which packets were received via network links among the plurality of network interfaces;
selecting, at the network device, packets that are being forwarded between certain network interface pairs and/or belong to certain packet flows for measuring latency using configuration information stored in one or more memories of the network device, the configuration information indicating certain network interface pairs and/or certain packet flows that are enabled for latency measurement;
measuring, at the network device, respective transmit times at which packets are transmitted via network links among the plurality of network links;
determining, at the network device, respective latencies for selected packets, that are being forwarded between the certain network interface pairs and/or belong to the certain packet flows indicated by the configuration information, using respective receipt times and respective transmit times for the selected packets, so that, for packets that are not selected, no latencies are determined by the network device;
storing the latency information corresponding to the certain network interface pairs and/or the certain packet flows in the one or more memories of the network device;
calculating, as an exponentially

Assignees

• Marvell Israel Misl Ltd

Inventors

• Mizrahi Tal
• Melman David
• Peery Adar
• Zemach Rami

Classifications

• H04L69/40

  for recovering from a failure of a protocol instance or entity, e.g. service redundancy protocols, protocol state redundancy or protocol service redirection (management of faults, events, alarms or notifications in data switching networks H04L41/06) · CPC title

• H04L43/026

  using flow identification · CPC title

• H04L69/28

  Timers or timing mechanisms used in protocols · CPC title

• H04L43/0852

  Delays · CPC title

• H04L43/022

  by sampling · CPC title