Abstract
We introduce a cross-validation algorithm called nPool that can be applied in a distributed fashion. Unlike classic k-fold cross-validation, the data segments are mutually exclusive, and training takes place only on one segment. This system is well suited to run in concert with the EC-Star distributed Evolutionary system, cross-validating solution candidates during a run. The system is tested with different numbers of validation segments using a real-world problem of classifying ICU blood-pressure time series.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Goldberger AL, Amaral LA, Glass L, Hausdorff JM, Ivanov PC, Mark RG, Mietus JE, Moody GB, Peng CK, Stanley HE (2000) Physiobank, physiotoolkit, and physionet components of a new research resource for complex physiologic signals. Circulation 101(23):e215–e220
Hodjat B, Shahrzad H (2013) Introducing an age-varying fitness estimation function. In: Genetic programming theory and practice X. Springer, Berlin, pp 59–71
Hodjat B, Hemberg E, Shahrzad H, O’Reilly UM (2014) Maintenance of a long running distributed genetic programming system for solving problems requiring big data. In: Genetic programming theory and practice XI. Springer, Berlin, pp 65–83
Hornby, GS (2006) ALPS: the age-layered population structure for reducing the problem of premature convergence. In: Proceedings of the 8th annual conference on Genetic and evolutionary computation, ACM, New York, pp 815–822
O’Reilly UM, Wagy M, Hodjat B (2013) Ec-star: a massive-scale, hub and spoke, distributed genetic programming system. In: Genetic programming theory and practice X. Springer, Berlin, pp 73–85
Refaeilzadeh P, Tang L, Liu H (2009) Cross-validation. In: Encyclopedia of database systems. Springer, Berlin, pp 532–538
Rivest RL (1987) Learning decision lists. Mach Learn 2(3):229–246
Acknowledgements
The authors wish to thank Sentient Technologies for sponsoring this research and providing the processing capacity required for the experiments presented in this paper.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Hodjat, B., Shahrzad, H. (2016). nPool: Massively Distributed Simultaneous Evolution and Cross-Validation in EC-Star. In: Riolo, R., Worzel, W., Kotanchek, M., Kordon, A. (eds) Genetic Programming Theory and Practice XIII. Genetic and Evolutionary Computation. Springer, Cham. https://doi.org/10.1007/978-3-319-34223-8_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-34223-8_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-34221-4
Online ISBN: 978-3-319-34223-8
eBook Packages: Computer ScienceComputer Science (R0)