paper.pdf (6.38 MB)
SCDP: systematic rateless coding for efficient data transport in data centres
journal contribution
posted on 2023-06-10, 00:26 authored by Mohammed Alasmar, George ParisisGeorge Parisis, Jon CrowcroftIn this paper we propose SCDP, a general-purpose data transport protocol for data centres that, in contrast to all other protocols proposed to date, supports efficient one-to-many and many-to-one communication, which is extremely common in modern data centres. SCDP does so without compromising on efficiency for short and long unicast flows. SCDP achieves this by integrating RaptorQ codes with receiver-driven data transport, packet trimming and Multi-Level Feedback Queuing (MLFQ); (1) RaptorQ codes enable efficient one-to-many and many-to-one data transport; (2) on top of RaptorQ codes, receiver-driven flow control, in combination with in-network packet trimming, enable efficient usage of network resources as well as multi-path transport and packet spraying for all transport modes. Incast and Outcast are eliminated; (3) the systematic nature of RaptorQ codes, in combination with MLFQ, enable fast, decoding-free completion of short flows. We extensively evaluate SCDP in a wide range of simulated scenarios with realistic data centre workloads. For one-to-many and many-to-one transport sessions, SCDP performs significantly better compared to NDP and PIAS. For short and long unicast flows, SCDP performs equally well or better compared to NDP and PIAS.
History
Publication status
- Published
File Version
- Accepted version
Journal
IEEE/ACM Transactions on NetworkingISSN
1063-6692Publisher
IEEEExternal DOI
Issue
6Volume
29Page range
2723-2736Department affiliated with
- Informatics Publications
Notes
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.Full text available
- Yes
Peer reviewed?
- Yes
Legacy Posted Date
2021-07-22First Open Access (FOA) Date
2021-07-27First Compliant Deposit (FCD) Date
2021-07-21Usage metrics
Categories
No categories selectedKeywords
Licence
Exports
RefWorks
BibTeX
Ref. manager
Endnote
DataCite
NLM
DC