Efficient Coflow Scheduling in Hybrid-Switched Data Center Networks

06/16/2023
by   Xin Wang, et al.
1

To improve the application-level communication performance, scheduling of coflows, a collection of parallel flows sharing the same objective, is prevalent in modern data center networks (DCNs). Meanwhile, a hybrid-switched DCN design combining optical circuit switches (OPS) and electrical packet switches (EPS) for transmitting high-volume traffic and low-volume traffic separately has received considerable research attention recently. Efficient scheduling of coflows on hybrid network links is crucial for reducing the overall communication time. However, because of the reconfiguration delay in the circuit switch due to the ultra-high transmission rate and the limitation of bandwidth in the packet switch, coflow scheduling becomes increasingly challenging. The existing coflow scheduling algorithms in hybrid-switched DCNs are all heuristic and provide no performance guarantees. In this work, we propose an approximation algorithm with the worst-case performance guarantee of 2+ λ?, where λ? is a factor related to system parameters and demand characteristics, for single coflow scheduling in hybridswitched DCN to minimize the coflow completion time (CCT). Extensive simulations based on Facebook data traces show that our algorithm outperforms the state-of-the-art schemes Solstice by 1.14? and Reco-Sin by 1.42? in terms of minimizing CCT.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/18/2017

Better Algorithms for Hybrid Circuit and Packet Switching in Data Centers

Hybrid circuit and packet switching for data center networking (DCN) has...
research
12/03/2021

Energy-Proportional Data Center Network Architecture Through OS, Switch and Laser Co-design

Optical interconnects are already the dominant technology in large-scale...
research
06/20/2020

Makespan minimization of Time-Triggered traffic on a TTEthernet network

The reliability of the increasing number of modern applications and syst...
research
06/17/2019

Near Optimal Coflow Scheduling in Networks

The coflow scheduling problem has emerged as a popular abstraction in th...
research
09/23/2022

Optimal Job Scheduling and Bandwidth Augmentation in Hybrid Data Center Networks

Optimizing data transfers is critical for improving job performance in d...
research
11/05/2020

Birkhoff's Decomposition Revisited: Sparse Scheduling for High-Speed Circuit Switches

Data centers are increasingly using high-speed circuit switches to cope ...
research
08/29/2023

Compiler Discovered Dynamic Scheduling of Irregular Code in High-Level Synthesis

Dynamically scheduled high-level synthesis (HLS) achieves higher through...

Please sign up or login with your details

Forgot password? Click here to reset