The browser you are using is not supported by this website. All versions of Internet Explorer are no longer supported, either by us or Microsoft (read more here: https://www.microsoft.com/en-us/microsoft-365/windows/end-of-ie-support).

Please use a modern browser to fully experience our website, such as the newest versions of Edge, Chrome, Firefox or Safari etc.

Photo of Mattias Ohlsson

Mattias Ohlsson

Professor

Photo of Mattias Ohlsson

Comparison of standard resampling methods for performance estimation of artificial neural network ensembles

Author

  • Michael Green
  • Mattias Ohlsson

Editor

  • Emmanuel Ifeachor

Summary, in English

Estimation of the generalization performance for classification within the medical applications domain is always an important task. In this study we focus on artificial neural network ensembles as the machine learning technique. We present a numerical comparison between five common resampling techniques: k-fold cross validation (CV), holdout, using three cutoffs, and bootstrap using five different data sets. The results show that CV together with holdout $0.25$ and $0.50$ are the best resampling strategies for estimating the true performance of ANN ensembles. The bootstrap, using the .632+ rule, is too optimistic, while the holdout $0.75$ underestimates the true performance.

Department/s

  • Computational Biology and Biological Physics - Undergoing reorganization

Publishing year

2007

Language

English

Publication/Series

Third International Conference on Computational Intelligence in Medicine and Healthcare

Document type

Conference paper

Topic

  • Biophysics

Keywords

  • performance estimation
  • k-fold cross validation
  • bootstrap
  • artificial neural networks

Conference name

Third International Conference on Computational Intelligence in Medicine and Healthcare

Conference date

2007-07-25 - 2007-07-27

Status

Published