Browsing by Author "Jiang, Xiaoyi"

Now showing 1 - 1 of 1
  • Thumbnail Image
    Item
    Visual Ensemble Analysis to Study the Influence of Hyper-parameters on Training Deep Neural Networks
    (The Eurographics Association, 2019) Hamid, Sagad; Derstroff, Adrian; Klemm, Sören; Ngo, Quynh Quang; Jiang, Xiaoyi; Linsen, Lars; Archambault, Daniel and Nabney, Ian and Peltonen, Jaakko
    A good deep neural network design allows for efficient training and high accuracy. The training step requires a suitable choice of several hyper-parameters. Limited knowledge exists on how the hyper-parameters impact the training process, what is the interplay of multiple hyper-parameters, and what is the interrelation of hyper-parameters and network topology. In this paper, we present a structured analysis towards these goals by investigating an ensemble of training runs.We propose a visual ensemble analysis based on hyper-parameter space visualizations, performance visualizations, and visualizing correlations of topological structures. As a proof of concept, we apply our approach to deep convolutional neural networks.