|Eugster, Manuel J. A. and Leisch, Friedrich (2008): Bench Plot and Mixed Effects Models: First steps toward a comprehensive benchmark analysis toolbox. Department of Statistics: Technical Reports, No.26|
This is the latest version of this item.
Benchmark experiments produce data in a very specific format. The observations are drawn from the performance distributions of the candidate algorithms on resampled data sets. In this paper we introduce new visualisation techniques and show how formal test procedures can be used to evaluate the results. This is the first step towards a comprehensive toolbox of exploratory and inferential analysis methods for benchmark experiments.
|Item Type:||Paper (Technical Report)|
|Published in:||Compstat 2008-Proceedings in Computational Statistics|
|Keywords:||benchmark experiments, visualisation, hypothesis tests|
|Collections:||Mathematics, Computer Science and Statistics > Statistics > Technical Reports|
|Deposited On:||11. Apr 2008 11:12|
|Last Modified:||22. May 2012 08:57|
Available Versions of this Item
Bench Plot and Mixed Effects Models: First steps toward a comprehensiv benchmark analysis toolbox. (deposited 09. Apr 2008 08:54)
- Bench Plot and Mixed Effects Models: First steps toward a comprehensive benchmark analysis toolbox. (deposited 11. Apr 2008 11:12) [Currently Displayed]