Sequeval: A Framework to Assess and Benchmark Sequence-based Recommender Systems

10/11/2018
by   Diego Monti, et al.
0

In this paper, we present sequeval, a software tool capable of performing the offline evaluation of a recommender system designed to suggest a sequence of items. A sequence-based recommender is trained considering the sequences already available in the system and its purpose is to generate a personalized sequence starting from an initial seed. This tool automatically evaluates the sequence-based recommender considering a comprehensive set of eight different metrics adapted to the sequential scenario. sequeval has been developed following the best practices of software extensibility. For this reason, it is possible to easily integrate and evaluate novel recommendation techniques. sequeval is publicly available as an open source tool and it aims to become a focal point for the community to assess sequence-based recommender systems.

READ FULL TEXT

page 1

page 2

research
10/11/2018

A Distributed and Accountable Approach to Offline Recommender Systems Evaluation

Different software tools have been developed with the purpose of perform...
research
08/09/2021

Recommender Systems for Software Project Managers

The design of recommendation systems is based on complex information pro...
research
05/26/2022

Sequential Nature of Recommender Systems Disrupts the Evaluation Process

Datasets are often generated in a sequential manner, where the previous ...
research
10/28/2010

Random Graphs for Performance Evaluation of Recommender Systems

The purpose of this article is to introduce a new analytical framework d...
research
09/10/2018

The LKPY Package for Recommender Systems Experiments: Next-Generation Tools and Lessons Learned from the LensKit Project

Since 2010, we have built and maintained LensKit, an open-source toolkit...
research
11/22/2019

Order Matters at Fanatics Recommending Sequentially Ordered Products by LSTM Embedded with Word2Vec

A unique challenge for e-commerce recommendation is that customers are o...
research
11/02/2022

Where Do We Go From Here? Guidelines For Offline Recommender Evaluation

Various studies in recent years have pointed out large issues in the off...

Please sign up or login with your details

Forgot password? Click here to reset