A Multi-Objective Anytime Rule Mining System to Ease Iterative Feedback from Domain Experts

by   Tobias Baum, et al.

Data extracted from software repositories is used intensively in Software Engineering research, for example, to predict defects in source code. In our research in this area, with data from open source projects as well as an industrial partner, we noticed several shortcomings of conventional data mining approaches for classification problems: (1) Domain experts' acceptance is of critical importance, and domain experts can provide valuable input, but it is hard to use this feedback. (2) The evaluation of the model is not a simple matter of calculating AUC or accuracy. Instead, there are multiple objectives of varying importance, but their importance cannot be easily quantified. Furthermore, the performance of the model cannot be evaluated on a per-instance level in our case, because it shares aspects with the set cover problem. To overcome these problems, we take a holistic approach and develop a rule mining system that simplifies iterative feedback from domain experts and can easily incorporate the domain-specific evaluation needs. A central part of the system is a novel multi-objective anytime rule mining algorithm. The algorithm is based on the GRASP-PR meta-heuristic but extends it with ideas from several other approaches. We successfully applied the system in the industrial context. In the current article, we focus on the description of the algorithm and the concepts of the system. We provide an implementation of the system for reuse.


page 1

page 2

page 3

page 4


Cambrian Explosion Algorithm for Multi-Objective Association Rules Mining

Association rule mining is one of the most studied research fields of da...

Enabling Open-World Specification Mining via Unsupervised Learning

Many programming tasks require using both domain-specific code and well-...

Leveraging Data Mining Algorithms to Recommend Source Code Changes

Context: Recent research has used data mining to develop techniques that...

Nugget Discovery with a Multi-objective Cultural Algorithm

Partial classification popularly known as nugget discovery comes under d...

An Industrial Case Study on Shrinking Code Review Changesets through Remark Prediction

Change-based code review is used widely in industrial software developme...

A framework for redescription set construction

Redescription mining is a field of knowledge discovery that aims at find...

A Survey on Online Judge Systems and Their Applications

Online judges are systems designed for the reliable evaluation of algori...

Please sign up or login with your details

Forgot password? Click here to reset