Investigating the Robustness of Sequential Recommender Systems Against Training Data Perturbations: an Empirical Study

by   Filippo Betello, et al.
Sapienza University of Rome

Sequential Recommender Systems (SRSs) have been widely used to model user behavior over time, but their robustness in the face of perturbations to training data is a critical issue. In this paper, we conduct an empirical study to investigate the effects of removing items at different positions within a temporally ordered sequence. We evaluate two different SRS models on multiple datasets, measuring their performance using Normalized Discounted Cumulative Gain (NDCG) and Rank Sensitivity List metrics. Our results demonstrate that removing items at the end of the sequence significantly impacts performance, with NDCG decreasing up to 60%, while removing items from the beginning or middle has no significant effect. These findings highlight the importance of considering the position of the perturbed items in the training data and shall inform the design of more robust SRSs.


page 1

page 2

page 3

page 4


Recommender systems: when memory matters

In this paper, we study the effect of long memory in the learnability of...

A Study of Position Bias in Digital Library Recommender Systems

"Position bias" describes the tendency of users to interact with items o...

Robustness of Deep Recommendation Systems to Untargeted Interaction Perturbations

While deep learning-based sequential recommender systems are widely used...

Large Language Models are Zero-Shot Rankers for Recommender Systems

Recently, large language models (LLMs) (e.g. GPT-4) have demonstrated im...

Membership Inference Attacks Against Recommender Systems

Recently, recommender systems have achieved promising performances and b...

Improving the Robustness of Summarization Models by Detecting and Removing Input Noise

The evaluation of abstractive summarization models typically uses test d...

A Re-visit of the Popularity Baseline in Recommender Systems

Popularity is often included in experimental evaluation to provide a ref...

Please sign up or login with your details

Forgot password? Click here to reset