Abstract
Research in the rule induction algorithm field produced many algorithms in the last 30 years. However, these algorithms are usually obtained from a few basic rule induction algorithms that have been often changed to produce better ones. Having these basic algorithms and their components in mind, this work proposes the use of Grammar-based Genetic Programming (GGP) to automatically evolve rule induction algorithms. The proposed GGP is evaluated in extensive computational experiments involving 11 data sets. Overall, the results show that effective rule induction algorithms can be automatically generated using GGP. The automatically evolved rule induction algorithms were shown to be competitive with well-known manually designed ones. The proposed approach of automatically evolving rule induction algorithms can be considered a pioneering one, opening a new kind of research area.
Download to read the full chapter text
Chapter PDF
References
Clark, P., Boswell, R.: Rule induction with cn2: some recent improvements. In: Kodratoff, Y. (ed.) EWSL 1991. LNCS, vol. 482, pp. 151–163. Springer, Heidelberg (1991)
Cohen, W.W.: Fast effective rule induction. In: Proc. of the 12th International Conference on Machine Learning (1995)
Quinlan, J.R.: C4.5: programs for machine learning. Morgan Kaufmann, San Francisco (1993)
Furnkranz, J., Widmer, G.: Incremental reduced error pruning. In: Proc. the 11th Int. Conf. on Machine Learning, New Brunswick, NJ, pp. 70–77 (1994)
Koza, J.R.: Genetic Programming: On the Programming of Computers by the means of natural selection. The MIT Press, Massachusetts (1992)
Koza, J.: http://www.genetic-programming.org/ (June 2006)
Whigham, P.A.: Grammatically-based genetic programming. In: Proc. of the Workshop on GP: From Theory to Real-World Applications (1995)
Domingos, P.: Rule induction and instance-based learning: A unified approach. In: Proc. of the 14th International Joint Conference on Artificial Intelligence, pp. 1226–1232 (1995)
Lim, T., Loh, W., Shih, Y.: A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms. Machine Learning 40(3), 203–228 (2000)
Pappa, G.L., Freitas, A.A.: Towards a genetic programming algorithm for automatically evolving rule induction algorithms. In: Furnkranz, J. (ed.) Proc. ECML/PKDD-2004 Workshop on Advances in Inductive Learning, pp. 93–108 (2004)
Mitchell, T.: Machine Learning. Mc Graw Hill, New York (1997)
Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann, San Francisco (1999)
Freitas, A.A.: Data Mining and Knowledge Discovery with Evolutionary Algorithms. Springer, Heidelberg (2002)
Wong, M.L., Leung, K.S.: Data Mining Using Grammar-Based Genetic Programming and Applications. Kluwer, Dordrecht (2000)
Furnkranz, J.: Separate-and-conquer rule learning. Artificial Intelligence Review 13(1), 3–54 (1999)
Banzhaf, W., Nordin, P., Keller, R., Francone, F.: GP – An Introduction; On the Automatic Evolution of Computer Programs and its Applications. Morgan Kaufmann, San Francisco (1998)
O’Neill, M., Ryan, C.: Grammatical Evolution Evolutionary Automatic Programming in an Arbitrary Language. Morgan Kaufmann, San Francisco (2003)
Wong, M.L.: An adaptive knowledge-acquisition system using generic genetic programming. Expert Systems with Applications 15(1), 47–58 (1998)
Suyama, A., Negishi, N., Yamaguchi, T.: CAMLET: A platform for automatic composition of inductive learning systems using ontologies. In: Pacific Rim International Conference on Artificial Intelligence, pp. 205–215 (1998)
Zhang, J.: Selecting typical instances in instance-based learning. In: Proc. of the 9th Int. Workshop on Machine Learning, pp. 470–479. Morgan Kaufmann, San Francisco (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pappa, G.L., Freitas, A.A. (2006). Automatically Evolving Rule Induction Algorithms. In: Fürnkranz, J., Scheffer, T., Spiliopoulou, M. (eds) Machine Learning: ECML 2006. ECML 2006. Lecture Notes in Computer Science(), vol 4212. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11871842_34
Download citation
DOI: https://doi.org/10.1007/11871842_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-45375-8
Online ISBN: 978-3-540-46056-5
eBook Packages: Computer ScienceComputer Science (R0)