Lifelong Sequential Modeling with Personalized Memorization for User Response Prediction

05/02/2019
by   Kan Ren, et al.
0

User response prediction, which models the user preference w.r.t. the presented items, plays a key role in online services. With two-decade rapid development, nowadays the cumulated user behavior sequences on mature Internet service platforms have become extremely long since the user's first registration. Each user not only has intrinsic tastes, but also keeps changing her personal interests during lifetime. Hence, it is challenging to handle such lifelong sequential modeling for each individual user. Existing methodologies for sequential modeling are only capable of dealing with relatively recent user behaviors, which leaves huge space for modeling long-term especially lifelong sequential patterns to facilitate user modeling. Moreover, one user's behavior may be accounted for various previous behaviors within her whole online activity history, i.e., long-term dependency with multi-scale sequential patterns. In order to tackle these challenges, in this paper, we propose a Hierarchical Periodic Memory Network for lifelong sequential modeling with personalized memorization of sequential patterns for each user. The model also adopts a hierarchical and periodical updating mechanism to capture multi-scale sequential patterns of user interests while supporting the evolving user behavior logs. The experimental results over three large-scale real-world datasets have demonstrated the advantages of our proposed model with significant improvement in user response prediction performance against the state-of-the-arts.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/25/2022

Adversarial Filtering Modeling on Long-term User Behavior Sequences for Click-Through Rate Prediction

Rich user behavior information is of great importance for capturing and ...
research
05/28/2021

Rethinking Lifelong Sequential Recommendation with Incremental Multi-Interest Attention

Sequential recommendation plays an increasingly important role in many e...
research
02/18/2021

Dynamic Memory based Attention Network for Sequential Recommendation

Sequential recommendation has become increasingly essential in various o...
research
04/26/2019

Hierarchical Context enabled Recurrent Neural Network for Recommendation

A long user history inevitably reflects the transitions of personal inte...
research
10/22/2020

Learning Transferrable Parameters for Long-tailed Sequential User Behavior Modeling

Sequential user behavior modeling plays a crucial role in online user-or...
research
02/18/2021

Multi-Interest-Aware User Modeling for Large-Scale Sequential Recommendations

Precise user modeling is critical for online personalized recommendation...
research
08/10/2021

End-to-End User Behavior Retrieval in Click-Through RatePrediction Model

Click-Through Rate (CTR) prediction is one of the core tasks in recommen...

Please sign up or login with your details

Forgot password? Click here to reset