Bench plot and mixed effects models: first steps toward a comprehensive benchmark analysis toolbox

RIS ID

26996

Publication Details

Eugster, M. J. A. & Leisch, F. (2008). Bench plot and mixed effects models: first steps toward a comprehensive benchmark analysis toolbox. In P. Brito (Eds.), Compstat 2008-Proceedings in Computational Statistics (pp. 299-309). Heidelberg, Germany: Physica Verlag.

Abstract

Benchmark experiments produce data in a very specific format. The observations are drawn from the performance distributions of the candidate algorithms on resampled data sets. In this paper we introduce new visualisation techniques and show how formal test procedures can be used to evaluate the results. This is the first step towards a comprehensive toolbox of exploratory and inferential analysis methods for benchmark experiments.

Link to publisher version (URL)

Computational Statistics Symposium

Please refer to publisher version or contact your library.

Share

COinS