Self-Guided Learning to Denoise for Robust Recommendation

by   Yunjun Gao, et al.

The ubiquity of implicit feedback makes them the default choice to build modern recommender systems. Generally speaking, observed interactions are considered as positive samples, while unobserved interactions are considered as negative ones. However, implicit feedback is inherently noisy because of the ubiquitous presence of noisy-positive and noisy-negative interactions. Recently, some studies have noticed the importance of denoising implicit feedback for recommendations, and enhanced the robustness of recommendation models to some extent. Nonetheless, they typically fail to (1) capture the hard yet clean interactions for learning comprehensive user preference, and (2) provide a universal denoising solution that can be applied to various kinds of recommendation models. In this paper, we thoroughly investigate the memorization effect of recommendation models, and propose a new denoising paradigm, i.e., Self-Guided Denoising Learning (SGDL), which is able to collect memorized interactions at the early stage of the training (i.e., "noise-resistant" period), and leverage those data as denoising signals to guide the following training (i.e., "noise-sensitive" period) of the model in a meta-learning manner. Besides, our method can automatically switch its learning phase at the memorization point from memorization to self-guided learning, and select clean and informative memorized data via a novel adaptive denoising scheduler to improve the robustness. We incorporate SGDL with four representative recommendation models (i.e., NeuMF, CDAE, NGCF and LightGCN) and different loss functions (i.e., binary cross-entropy and BPR loss). The experimental results on three benchmark datasets demonstrate the effectiveness of SGDL over the state-of-the-art denoising methods like T-CE, IR, DeCA, and even state-of-the-art robust graph-based methods like SGCN and SGL.


page 4

page 5

page 6

page 7

page 8

page 9

page 10

page 11


Denoising Implicit Feedback for Recommendation

The ubiquity of implicit feedback makes them the default choice to build...

Knowledge-refined Denoising Network for Robust Recommendation

Knowledge graph (KG), which contains rich side information, becomes an e...

Quick Graph Conversion for Robust Recommendation

Implicit feedback plays a huge role in recommender systems, but its high...

Robust Preference-Guided Denoising for Graph based Social Recommendation

Graph Neural Network(GNN) based social recommendation models improve the...

Probabilistic and Variational Recommendation Denoising

Learning from implicit feedback is one of the most common cases in the a...

A Missing Information Loss function for implicit feedback datasets

Latent factor models with implicit feedback typically treat unobserved u...

Learning Robust Recommender from Noisy Implicit Feedback

The ubiquity of implicit feedback makes it indispensable for building re...

Please sign up or login with your details

Forgot password? Click here to reset