Generalized Delayed Feedback Model with Post-Click Information in Recommender Systems

by   Jia-Qi Yang, et al.

Predicting conversion rate (e.g., the probability that a user will purchase an item) is a fundamental problem in machine learning based recommender systems. However, accurate conversion labels are revealed after a long delay, which harms the timeliness of recommender systems. Previous literature concentrates on utilizing early conversions to mitigate such a delayed feedback problem. In this paper, we show that post-click user behaviors are also informative to conversion rate prediction and can be used to improve timeliness. We propose a generalized delayed feedback model (GDFM) that unifies both post-click behaviors and early conversions as stochastic post-click information, which could be utilized to train GDFM in a streaming manner efficiently. Based on GDFM, we further establish a novel perspective that the performance gap introduced by delayed feedback can be attributed to a temporal gap and a sampling gap. Inspired by our analysis, we propose to measure the quality of post-click information with a combination of temporal distance and sample complexity. The training objective is re-weighted accordingly to highlight informative and timely signals. We validate our analysis on public datasets, and experimental performance confirms the effectiveness of our method.


page 1

page 2

page 3

page 4


Entire Space Cascade Delayed Feedback Modeling for Effective Conversion Rate Prediction

Conversion rate (CVR) prediction is an essential task for large-scale e-...

Degenerate Feedback Loops in Recommender Systems

Machine learning is used extensively in recommender systems deployed in ...

Multimodal Recommender Systems in the Prediction of Disease Comorbidity

While deep-learning based recommender systems utilizing collaborative fi...

Streaming CTR Prediction: Rethinking Recommendation Task for Real-World Streaming Data

The Click-Through Rate (CTR) prediction task is critical in industrial r...

Delayed Feedback Modeling for the Entire Space Conversion Rate Prediction

Estimating post-click conversion rate (CVR) accurately is crucial in E-c...

Using consumer feedback from location-based services in PoI recommender systems for people with autism

When suggesting Points of Interest (PoIs) to people with autism spectrum...

Freshness or Accuracy, Why Not Both? Addressing Delayed Feedback via Dynamic Graph Neural Networks

The delayed feedback problem is one of the most pressing challenges in p...

Please sign up or login with your details

Forgot password? Click here to reset