Telemetry data abstraction

Patent metadata

Field	Value
Publication number	US-12192082-B1
Application number	US-202318232299-A
Country	US
Kind code	B1
Filing date	Aug 9, 2023
Priority date	Aug 9, 2023
Publication date	Jan 7, 2025
Grant date	Jan 7, 2025

Abstract

Methods, systems, and computer program products to generate a telemetry pipeline. In embodiments, the system includes a communication interface that receives one or more user-defined functions for the telemetry pipeline. The system also includes control logic that implements programmatically the one or more user-defined functions to collect telemetry data at a plurality of layers in the telemetry pipeline based on the one or more user-defined functions and calculate smart metrics at different layers of the plurality of layers in the telemetry pipeline. The smart metrics may be calculated at a layer closest to where associated telemetry data is collected.

First claim

What is claimed is:

1. A system to generate a telemetry pipeline, the system comprising:
an interface that receives one or more user-defined functions for the telemetry pipeline; and
a processor including logic that:
implements programmatically the one or more user-defined functions to:
collect telemetry data at a plurality of Operating System (OS) layers in the telemetry pipeline based on the one or more user-defined functions; and
calculate smart metrics at different layers of the plurality of OS layers in the telemetry pipeline, wherein the smart metrics are built in a hierarchal manner with increasing complexity from a lower layer to an upper layer, wherein the smart metrics are calculated at a layer closest to where associated telemetry data is collected, and wherein the smart metrics aggregate the collected telemetry data.

2. The system of claim 1 , wherein calculating the smart metrics comprises taking a mathematical function of a collected metric.

3. The system of claim 2 , wherein the collected metric comprises at least one of a counter, a state, and an event.

4. The system of claim 2 , wherein the collected metric comprises a scalar metric (collected at a point in time).

5. The system of claim 2 , wherein the collected metric comprises a sequence/time-based metric.

6. The system of claim 1 , wherein the smart metrics are transferred between the plurality of OS layers in the telemetry pipeline.

7. The system of claim 1 , wherein the telemetry pipeline spans across each OS layer of the system.

8. The system of claim 1 , wherein the plurality of OS layers includes a hardware layer.

9. The system of claim 1 , wherein the plurality of OS layers includes a firmware layer.

10. The system of claim 1 , wherein the plurality of OS layers includes a software layer.

11. The system of claim 1 , wherein the plurality of OS layers includes a user space layer.

12. The system of claim 1 , wherein the plurality of OS layers includes a telemetry collector layer.

13. The system of claim 1 , wherein the telemetry pipeline uses domain specific language (DSL).

14. The system of claim 1 , wherein the logic further:
aggregates the telemetry data and the smart metrics across the plurality of OS layers in the telemetry pipeline.

15. A system comprising:
an interface that receives one or more user-defined functions for the system; and one or more processors to:
implement programmatically the one or more user-defined functions;
collect telemetry data at a plurality of Operating System (OS) layers in a telemetry pipeline based on the one or more user-defined functions;
calculate smart metrics at different layers in the plurality of OS layers in the telemetry pipeline, wherein the smart metrics are built in a hierarchal manner with increasing complexity from a lower layer to an upper layer, and wherein the smart metrics are calculated at a layer closest to where associated telemetry data is collected; and
aggregate the telemetry data and the smart metrics across the plurality of OS layers in the telemetry pipeline.

16. The system of claim 15 , wherein calculating the smart metrics comprise taking a mathematical function of a collected metric, and wherein the collected metric comprises at least one of a counter, a state, and an event.

17. The system of claim 16 , wherein the collected metric comprises a scalar metric (collected at a point in time) or a sequence/time-based metric.

18. The system of claim 15 , wherein the plurality of OS layers includes: a hardware layer, a firmware layer, a software layer, a user space layer, and a telemetry collector layer.

19. The system of claim 15 , wherein the telemetry pipeline uses domain specific language (DSL).

20. A method of using a telemetry pipeline to abstract telemetry data, the method comprising:
receiving one or more user-defined functions for a system;
implementing programmatically the one or more user-defined functions;
collecting telemetry data at a plurality of Operating System (OS) layers in the telemetry pipeline based on the one or more user-defined functions;
calculating smart metrics at different layers in the plurality of OS layers in the telemetry pipeline, wherein calculating the smart metrics comprises taking a mathematical function of the telemetry data, wherein the smart metrics are built in a hierarchal manner with increasing complexity from a lower layer to an upper layer, and wherein the smart metrics are calculated at a layer closest to where respective telemetry data is collected; and
aggregating the telemetry data and the smart metrics across the plurality of OS layers in the telemetry pipeline.

Assignees

• Mellanox Technologies Ltd

Inventors

• Sandhaus Ran
• Shalikashvili Vladimir
• Bashan Ortal

Classifications

• G06F11/3409

  for performance assessment · CPC title

• H04L43/08 Primary

  Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters · CPC title