DeepCC: Bridging the Gap Between Congestion Control and Applications via Multi-Objective Optimization

by   Lei Zhang, et al.

The increasingly complicated and diverse applications have distinct network performance demands, e.g., some desire high throughput while others require low latency. Traditional congestion controls (CC) have no perception of these demands. Consequently, literatures have explored the objective-specific algorithms, which are based on either offline training or online learning, to adapt to certain application demands. However, once generated, such algorithms are tailored to a specific performance objective function. Newly emerged performance demands in a changeable network environment require either expensive retraining (in the case of offline training), or manually redesigning a new objective function (in the case of online learning). To address this problem, we propose a novel architecture, DeepCC. It generates a CC agent that is generically applicable to a wide range of application requirements and network conditions. The key idea of DeepCC is to leverage both offline deep reinforcement learning and online fine-tuning. In the offline phase, instead of training towards a specific objective function, DeepCC trains its deep neural network model using multi-objective optimization. With the trained model, DeepCC offers near Pareto optimal policies w.r.t different user-specified trade-offs between throughput, delay, and loss rate without any redesigning or retraining. In addition, a quick online fine-tuning phase further helps DeepCC achieve the application-specific demands under dynamic network conditions. The simulation and real-world experiments show that DeepCC outperforms state-of-the-art schemes in a wide range of settings. DeepCC gains a higher target completion ratio of application requirements up to 67.4 other schemes, even in an untrained environment.


Statistical Learning Based Congestion Control for Real-time Video Communication

With the increasing demands on interactive video applications, how to ad...

Multi-Objective Congestion Control

Decades of research on Internet congestion control (CC) has produced a p...

Robust Congestion Control for Demand-Based Optimization in Precoded Multi-Beam High Throughput Satellite Communications

High-throughput satellite communications systems are growing in strategi...

A Model-Based Solution to the Offline Multi-Agent Reinforcement Learning Coordination Problem

Training multiple agents to coordinate is an important problem with appl...

Learning to Optimize: Balancing Two Conflict Metrics in MB-HTS Networks

For multi-beam high throughput (MB-HTS) geostationary (GEO) satellite ne...

Supervised Contrastive Learning as Multi-Objective Optimization for Fine-Tuning Large Pre-trained Language Models

Recently, Supervised Contrastive Learning (SCL) has been shown to achiev...

Please sign up or login with your details

Forgot password? Click here to reset