main.pdf (5.19 MB)
Internet traffic volumes are not Gaussian - they are log-normal: an 18-year longitudinal study with implications for modelling and prediction
journal contribution
posted on 2023-06-09, 22:58 authored by Mohammed Alasmar, Richard Clegg, Nickolay Zakhleniuk, George ParisisGeorge ParisisGetting good statistical models of traffic on network links is a well-known, often-studied problem. A lot of attention has been given to correlation patterns and flow duration. The distribution of the amount of traffic per unit time is an equally important but less studied problem. We study a large number of traffic traces from many different networks including academic, commercial and residential networks using state-of-the-art statistical techniques. We show that traffic obeys the log-normal distribution which is a better fit than the Gaussian distribution commonly claimed in the literature. We also investigate an alternative heavy-tailed distribution (the Weibull) and show that its performance is better than Gaussian but worse than log-normal. We examine anomalous traces which exhibit a poor fit for all distributions tried and show that this is often due to traffic outages or links that hit maximum capacity. We demonstrate that the data we look at is stationary if we consider samples of 15-minute long or even 1-hour long. This gives confidence that we can use the distributions for estimation and modelling purposes. We demonstrate the utility of our findings in two contexts: predicting that the proportion of time traffic will exceed a given level (for service level agreement or link capacity estimation) and predicting 95th percentile pricing. We also show that the log-normal distribution is a better predictor than Gaussian or Weibull distributions in both contexts.
History
Publication status
- Published
File Version
- Accepted version
Journal
IEEE/ACM Transactions on NetworkingISSN
1063-6692Publisher
IEEEExternal DOI
Issue
3Volume
29Page range
1266-1279Department affiliated with
- Informatics Publications
Notes
© 20XX IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.Full text available
- Yes
Peer reviewed?
- Yes
Legacy Posted Date
2021-02-04First Open Access (FOA) Date
2021-03-02First Compliant Deposit (FCD) Date
2021-02-03Usage metrics
Categories
No categories selectedKeywords
Licence
Exports
RefWorks
BibTeX
Ref. manager
Endnote
DataCite
NLM
DC