A Practical Incremental Method to Train Deep CTR Models

by   Yichao Wang, et al.

Deep learning models in recommender systems are usually trained in the batch mode, namely iteratively trained on a fixed-size window of training data. Such batch mode training of deep learning models suffers from low training efficiency, which may lead to performance degradation when the model is not produced on time. To tackle this issue, incremental learning is proposed and has received much attention recently. Incremental learning has great potential in recommender systems, as two consecutive window of training data overlap most of the volume. It aims to update the model incrementally with only the newly incoming samples from the timestamp when the model is updated last time, which is much more efficient than the batch mode training. However, most of the incremental learning methods focus on the research area of image recognition where new tasks or classes are learned over time. In this work, we introduce a practical incremental method to train deep CTR models, which consists of three decoupled modules (namely, data, feature and model module). Our method can achieve comparable performance to the conventional batch mode training with much better training efficiency. We conduct extensive experiments on a public benchmark and a private dataset to demonstrate the effectiveness of our proposed method.


page 1

page 2

page 3

page 4


A Survey on Incremental Update for Neural Recommender Systems

Recommender Systems (RS) aim to provide personalized suggestions of item...

Incremental Learning for Personalized Recommender Systems

Ubiquitous personalized recommender systems are built to achieve two see...

Few-Shot Batch Incremental Road Object Detection via Detector Fusion

Incremental few-shot learning has emerged as a new and challenging area ...

GraphSAIL: Graph Structure Aware Incremental Learning for Recommender Systems

Given the convenience of collecting information through online services,...

Incremental Permutation Feature Importance (iPFI): Towards Online Explanations on Data Streams

Explainable Artificial Intelligence (XAI) has mainly focused on static l...

Micro Batch Streaming: Allowing the Training of DNN models Using a large batch size on Small Memory Systems

The size of the deep learning models has greatly increased over the past...

Lambda Learner: Fast Incremental Learning on Data Streams

One of the most well-established applications of machine learning is in ...

Please sign up or login with your details

Forgot password? Click here to reset