research
∙
09/05/2023
AdaPlus: Integrating Nesterov Momentum and Precise Stepsize Adjustment on AdamW Basis
This paper proposes an efficient optimizer called AdaPlus which integrat...
share
research
∙
05/26/2023
XGrad: Boosting Gradient-Based Optimizers With Weight Prediction
In this paper, we propose a general deep learning training framework XGr...
research
∙
02/01/2023
Weight Prediction Boosts the Convergence of AdamW
In this paper, we introduce weight prediction into the AdamW optimizer t...
research
∙
08/11/2020
Covert Transmission Assisted by Intelligent Reflecting Surface
Covert transmission is studied for an intelligent reflecting surface (IR...
research
∙
10/24/2019
XPipe: Efficient Pipeline Model Parallelism for Multi-GPU DNN Training
We propose XPipe, an efficient asynchronous pipeline model parallelism a...
research
∙
11/05/2018
Non-ergodic Convergence Analysis of Heavy-Ball Algorithms
In this paper, we revisit the convergence of the Heavy-ball method, and ...
research
∙
09/11/2018