Eugster, Manuel J. A. and Leisch, Friedrich
Bench Plot and Mixed Effects Models: First steps toward a comprehensiv benchmark analysis toolbox.
Department of Statistics: Technical Reports, No.26
Benchmark experiments produce data in a very specific format. The observations are drawn from the performance distributions of the candidate algorithms on resampled data sets. In this paper we introduce new visualisation techniques and show how formal test procedures can be used to evaluate the results. This is the first step towards a comprehensive toolbox of exploratory and inferential analysis methods for benchmark experiments.
Available Versions of this Item
Bench Plot and Mixed Effects Models: First steps toward a comprehensiv benchmark analysis toolbox. (deposited 09. Apr 2008 08:54)