Towards the Better Ranking Consistency: A Multi-task Learning Framework for Early Stage Ads Ranking

by   Xuewei Wang, et al.

Dividing ads ranking system into retrieval, early, and final stages is a common practice in large scale ads recommendation to balance the efficiency and accuracy. The early stage ranking often uses efficient models to generate candidates out of a set of retrieved ads. The candidates are then fed into a more computationally intensive but accurate final stage ranking system to produce the final ads recommendation. As the early and final stage ranking use different features and model architectures because of system constraints, a serious ranking consistency issue arises where the early stage has a low ads recall, i.e., top ads in the final stage are ranked low in the early stage. In order to pass better ads from the early to the final stage ranking, we propose a multi-task learning framework for early stage ranking to capture multiple final stage ranking components (i.e. ads clicks and ads quality events) and their task relations. With our multi-task learning framework, we can not only achieve serving cost saving from the model consolidation, but also improve the ads recall and ranking consistency. In the online A/B testing, our framework achieves significantly higher click-through rate (CTR), conversion rate (CVR), total value and better ads-quality (e.g. reduced ads cross-out rate) in a large scale industrial ads ranking system.


On Ranking Consistency of Pre-ranking Stage

Industrial ranking systems, such as advertising systems, rank items by a...

PathRank: A Multi-Task Learning Framework to Rank Paths in Spatial Networks

Modern navigation services often provide multiple paths connecting the s...

Multi-Task Deep Learning with Dynamic Programming for Embryo Early Development Stage Classification from Time-Lapse Videos

Time-lapse is a technology used to record the development of embryos dur...

Multi Stage Screening: Enforcing Fairness and Maximizing Efficiency in a Pre-Existing Pipeline

Consider an actor making selection decisions using a series of classifie...

TwERC: High Performance Ensembled Candidate Generation for Ads Recommendation at Twitter

Recommendation systems are a core feature of social media companies with...

CoRT: Complementary Rankings from Transformers

Recent approaches towards passage retrieval have successfully employed r...

Optimizing Airbnb Search Journey with Multi-task Learning

At Airbnb, an online marketplace for stays and experiences, guests often...

Please sign up or login with your details

Forgot password? Click here to reset