Ensembling classification models based on phalanxes of variables with applications in drug discovery

by   Jabed H Tomal, et al.

Statistical detection of a rare class of objects in a two-class classification problem can pose several challenges. Because the class of interest is rare in the training data, there is relatively little information in the known class response labels for model building. At the same time the available explanatory variables are often moderately high dimensional. In the four assays of our drug-discovery application, compounds are active or not against a specific biological target, such as lung cancer tumor cells, and active compounds are rare. Several sets of chemical descriptor variables from computational chemistry are available to classify the active versus inactive class; each can have up to thousands of variables characterizing molecular structure of the compounds. The statistical challenge is to make use of the richness of the explanatory variables in the presence of scant response information. Our algorithm divides the explanatory variables into subsets adaptively and passes each subset to a base classifier. The various base classifiers are then ensembled to produce one model to rank new objects by their estimated probabilities of belonging to the rare class of interest. The essence of the algorithm is to choose the subsets such that variables in the same group work well together; we call such groups phalanxes.


page 1

page 2

page 3

page 4


Regression Phalanxes

Tomal et al. (2015) introduced the notion of "phalanxes" in the context ...

Improving traffic sign recognition by active search

We describe an iterative active-learning algorithm to recognise rare tra...

Ensembles of Models and Metrics for Robust Ranking of Homologous Proteins

An ensemble of models (EM), where each model is constructed on a diverse...

Transfer and Active Learning for Dissonance Detection: Addressing the Rare-Class Challenge

While transformer-based systems have enabled greater accuracies with few...

An Exploration of How Training Set Composition Bias in Machine Learning Affects Identifying Rare Objects

When training a machine learning classifier on data where one of the cla...

Detection and Mitigation of Rare Subclasses in Neural Network Classifiers

Regions of high-dimensional input spaces that are underrepresented in tr...

Exemplar Guided Active Learning

We consider the problem of wisely using a limited budget to label a smal...

Please sign up or login with your details

Forgot password? Click here to reset