Ablate, Variate, and Contemplate: Visual Analytics for Discovering Neural Architectures

by   Dylan Cashman, et al.

Deep learning models require the configuration of many layers and parameters in order to get good results. However, there are currently few systematic guidelines for how to configure a successful model. This means model builders often have to experiment with different configurations by manually programming different architectures (which is tedious and time consuming) or rely on purely automated approaches to generate and train the architectures (which is expensive). In this paper, we present Rapid Exploration of Model Architectures and Parameters, or REMAP, a visual analytics tool that allows a model builder to discover a deep learning model quickly via exploration and rapid experimentation of neural network architectures. In REMAP, the user explores the large and complex parameter space for neural network architectures using a combination of global inspection and local experimentation. Through a visual overview of a set of models, the user identifies interesting clusters of architectures. Based on their findings, the user can run ablation and variation experiments to identify the effects of adding, removing, or replacing layers in a given architecture and generate new models accordingly. They can also handcraft new models using a simple graphical interface. As a result, a model builder can build deep learning models quickly, efficiently, and without manual programming. We inform the design of REMAP through a design study with four deep learning model builders. Through a use case, we demonstrate that REMAP allows users to discover performant neural network architectures efficiently using visual exploration and user-defined semi-automated searches through the model space.


page 1

page 5

page 6


Automated Robustness with Adversarial Training as a Post-Processing Step

Adversarial training is a computationally expensive task and hence searc...

Transfer Learning to Learn with Multitask Neural Model Search

Deep learning models require extensive architecture design exploration a...

Parameters Optimization of Deep Learning Models using Particle Swarm Optimization

Deep learning has been successfully applied in several fields such as ma...

LAMVI-2: A Visual Tool for Comparing and Tuning Word Embedding Models

Tuning machine learning models, particularly deep learning architectures...

Finding Competitive Network Architectures Within a Day Using UCT

The design of neural network architectures for a new data set is a labor...

A Simple and efficient deep Scanpath Prediction

Visual scanpath is the sequence of fixation points that the human gaze t...

Toward Evaluating the Complexity to Operate a Network

The task of determining which network architectures provide the best rat...

Please sign up or login with your details

Forgot password? Click here to reset