Data latency evaluation

Patent metadata

Field	Value
Publication number	US-11595281-B2
Application number	US-202117236697-A
Country	US
Kind code	B2
Filing date	Apr 21, 2021
Priority date	Apr 21, 2021
Publication date	Feb 28, 2023
Grant date	Feb 28, 2023

Abstract

The described technology is generally directed towards methods for data latency evaluation. The techniques disclosed herein can provide useful information about when a data consumer can expect to receive data. Methods can create and compare data latency cumulative probability distributions comprising probabilities associated with different latency values, at various different levels of completeness.

First claim

What is claimed is:

1. A method, comprising:
collecting, by a system comprising a processor, for a first performance benchmark, first data latency values associated with data delivery via a first configuration of a network, resulting in first collected data latency values;
collecting, by the system, for a second performance benchmark, second data latency values associated with data delivery via a second configuration of the network, resulting in second collected data latency values,
wherein the first collected data latency values and second collected data latency values are associated with a same level of data delivery completeness;
generating, by the system, using the first collected data latency values, a first data latency cumulative probability distribution associated with the first performance benchmark, the first data latency cumulative probability distribution representing first probabilities of observed data latency values being less than or equal to distribution latency values;
generating, by the system, using the second collected data latency values, a second data latency cumulative probability distribution associated with the second performance benchmark, the second data latency cumulative probability distribution representing second probabilities of the observed data latency values being less than or equal to the distribution latency values;
comparing, by the system, the second data latency cumulative probability distribution associated with the second performance benchmark with the first data latency cumulative probability distribution associated with the first performance benchmark; and
selecting, by the system, based on a result of the comparing of the second data latency cumulative probability distribution associated with the second benchmark with the first data latency cumulative probability distribution associated with the first performance benchmark, the first configuration of the network or the second configuration of the network for data delivery via the network.

2. The method of claim 1 , further comprising determining, by the system, based on the first data latency cumulative probability distribution, whether a probability of the first probabilities is less than or equal to a determined value.

3. The method of claim 1 , wherein the same level of data delivery completeness comprises a same group of multiple different levels of data completeness.

4. The method of claim 1 , wherein the same level of data delivery completeness comprises a partial level of data delivery completeness.

5. The method of claim 1 , wherein comparing the second data latency cumulative probability distribution with the first data latency cumulative probability distribution comprises comparing a second probability of the second probabilities and a first probability of the first probabilities, wherein the first probability and the second probability are associated with a selected distribution latency value of the distribution latency values.

6. The method of claim 1 , wherein comparing the second data latency cumulative probability distribution with the first data latency cumulative probability distribution comprises determining whether second ones of the second probabilities of the second data latency cumulative probability distribution comprise greater probabilities of respective latencies being below selected distribution latency values than corresponding first ones of the first probabilities associated with the first data latency cumulative probability distribution.

7. The method of claim 1 , wherein the same level of data delivery completeness comprises a minimum amount of data to complete a minimum computation using the data.

8. The method of claim 1 , wherein the same level of data delivery completeness comprises an amount of data sufficient to complete a full computation using the data.

9. A system, comprising:
a processor; and
a memory that stores executable instructions that, when executed by the processor, perform operations, comprising:
generating, fora first performance benchmark associated with a first equipment configuration, a first data latency cumulative probability distribution for a first level of data delivery completeness, the first data latency cumulative probability distribution comprising first distribution probabilities of observed data latency values being less than or equal to distribution latency values;
generating, fora second performance benchmark associated with a second equipment configuration, a second data latency cumulative probability distribution for the first level of data delivery completeness, the second data latency cumulative probability distribution comprising second distribution probabilities of the observed data latency values being less than or equal to the distribution latency values;
comparing the second data latency cumulative probability distribution with the first data latency cumulative probability distribution to determine which of the second data latency cumulative probability distribution or the first data latency cumulative probability distribution comprises a greater probability of an observed data latency value of the observed data latency values being below a selected target latency value; and
selecting, based on a result of the comparing of the second data latency cumulative probability distribution with the first data latency cumulative probability distribution, the first equipment configuration or the second equipment configuration for data delivery to a consumer.

10. The system of claim 9 , wherein comparing the second data latency cumulative probability distribution with the first data latency cumulative probability distribution comprises comparing the second distribution probabilities with the first distribution probabilities at multiple distribution latency values of the distribution latency values.

11. The system of claim 9 , wherein comparing the second data latency cumulative probability distribution with the first data latency cumulative probability distribution comprises comparing the second distribution probabilities with the first distribution probabilities at all of the distribution latency values.

12. The system of claim 9 , wherein generating the first data latency cumulative probability distribution comprises collecting, for the first performance benchmark of data, first data latency values associated with multiple levels of data delivery completeness including the first level of data delivery completeness, and
wherein generating the second data latency cumulative probability distribution comprises collecting, for the second performance benchmark of data, second data latency values associated with the multiple levels of data delivery completeness including the first level of data delivery completeness.

13. The system of claim 9 , wherein:
generating the first data latency cumulative probability distribution comprises conducting the first performance benchmark using the first equipment configuration; and
generating the second data latency cumulative probability distribution comprises conducting the second performance benchmark using the second equipment configuration.

14. The system of claim 13 , wherein first level of data delivery completeness comprises a partial level of data delivery completeness.

15. A non-transitory machine-readable medium, comprising executable instructions that, when executed by a processor of a user equipment, perform operations comprising:
collecting, for a first performance benchmark, first data latency values associated with data delivery via a first configuration of a network to a consumer, resulting in first coll

Assignees

• At & T Ip I Lp

Inventors

• Ehrlich Willa
• Backas Elissa
• Mir Farhan
• Frabetti Jo

Classifications

• H04L43/0852 Primary

  Delays · CPC title

• H04L41/0816

  the condition being an adaptation, e.g. in response to network events · CPC title

• H04L43/065

  related to network devices · CPC title

• H04L43/0817 Primary

  by checking functioning · CPC title

• H04L41/142

  using statistical or mathematical methods · CPC title