SimpleX: A Simple and Strong Baseline for Collaborative Filtering

09/26/2021
by   Kelong Mao, et al.
0

Collaborative filtering (CF) is a widely studied research topic in recommender systems. The learning of a CF model generally depends on three major components, namely interaction encoder, loss function, and negative sampling. While many existing studies focus on the design of more powerful interaction encoders, the impacts of loss functions and negative sampling ratios have not yet been well explored. In this work, we show that the choice of loss function as well as negative sampling ratio is equivalently important. More specifically, we propose the cosine contrastive loss (CCL) and further incorporate it to a simple unified CF model, dubbed SimpleX. Extensive experiments have been conducted on 11 benchmark datasets and compared with 29 existing CF models in total. Surprisingly, the results show that, under our CCL loss and a large negative sampling ratio, SimpleX can surpass most sophisticated state-of-the-art models by a large margin (e.g., max 48.5 improvement in NDCG@20 over LightGCN). We believe that SimpleX could not only serve as a simple strong baseline to foster future research on CF, but also shed light on the potential research direction towards improving loss function and negative sampling.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/11/2023

Toward a Better Understanding of Loss Functions for Collaborative Filtering

Collaborative filtering (CF) is a pivotal technique in modern recommende...
research
08/30/2018

Towards Large Scale Training Of Autoencoders For Collaborative Filtering

In this paper, we apply a mini-batch based negative sampling method to e...
research
06/23/2022

Rethinking Collaborative Metric Learning: Toward an Efficient Alternative without Negative Sampling

The recently proposed Collaborative Metric Learning (CML) paradigm has a...
research
08/03/2020

Noise Contrastive Estimation for Autoencoding-based One-Class Collaborative Filtering

One-class collaborative filtering (OC-CF) is a common class of recommend...
research
06/23/2017

On Sampling Strategies for Neural Network-based Collaborative Filtering

Recent advances in neural networks have inspired people to design hybrid...
research
09/07/2020

Simplify and Robustify Negative Sampling for Implicit Collaborative Filtering

Negative sampling approaches are prevalent in implicit collaborative fil...
research
08/11/2023

Augmented Negative Sampling for Collaborative Filtering

Negative sampling is essential for implicit-feedback-based collaborative...

Please sign up or login with your details

Forgot password? Click here to reset