Abstract
This chapter describes an approach to the use of genetic programming for multiclass object classification. Instead of using the standard tree-based genetic programming approach, where each genetic program returns just one floating point number that is then translated into different class labels, this approach invents a new program structure with multiple outputs, each for a particular class. A voting scheme is then applied to these output values to determine the class of the input object. The approach is examined and compared with the standard genetic programming approach on four multiclass object classification tasks with increasing difficulty. The results show that the new approach outperforms the basic approach on these problems. A characteristic of the proposed program structure is that it can easily produce multiple outputs for multiclass object classification problems, while still keeping the advantages of the standard genetic programming approach for easy crossover and mutation. This approach can solve a multiclass object recognition problem using a single evolved program in a single run.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Holland, J.H. (ed.): Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. University of Michigan Press/ MIT Press, Ann Arbor, Cambridge (1975)
Michalewicz, Z.: Genetic algorithms + data structures = evolution programs, 3rd edn. Springer, London (1996)
Friedberg, R.: A learning machine, Part I. IBM Journal of Research and Development 2, 2–13 (1958)
Koza, J.R.: Genetic programming: on the programming of computers by means of natural selection. MIT Press, Cambridge (1992)
Koza, J.R.: Genetic Programming II: Automatic Discovery of Reusable Programs. MIT Press, Cambridge (1994)
Banzhaf, W., Nordin, P., Keller, R.E., Francone, F.D.: Genetic Programming: An Introduction on the Automatic Evolution of computer programs and its Applications. In: Subject: Genetic programming (Computer science). Morgan Kaufmann Publishers, San Francisco (1998)
MacKay, D.J.C.: Information Theory, Inference, and Learning Algorithms. Cambridge University Press, Cambridge (2003)
Banzhaf, W.: Genetic programming for pedestrians. In: Forrest, S. (ed.) Proceedings of the 5th International Conference on Genetic Algorithms, ICGA 1993, University of Illinois at Urbana-Champaign, July 17-21, p. 628. Morgan Kaufmann, San Francisco (1993)
Jacob, C.: Evolving evolution programs: Genetic programming and L-systems. In: Koza, J.R., Goldberg, D.E., Fogel, D.B., Riolo, R.L. (eds.) Genetic Programming 1996: Proceedings of the First Annual Conference, Stanford University, CA, USA, July 28–31, pp. 107–115. MIT Press, Cambridge (1996)
Teller, A., Veloso, M.: PADO: Learning tree structured algorithms for orchestration into an object recognition system. Technical Report CMU-CS-95-101, Department of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA (1995)
Kantschik, W., Banzhaf, W.: Linear-graph GP—A new GP structure. In: Foster, J.A., Lutton, E., Miller, J., Ryan, C., Tettamanzi, A.G.B. (eds.) EuroGP 2002. LNCS, vol. 2278, pp. 83–92. Springer, Heidelberg (2002)
Whigham, P.A.: Grammatically-based genetic programming. In: Rosca, J.P. (ed.) Proceedings of the Workshop on Genetic Programming: From Theory to Real-World Applications, Tahoe City, California, USA, July 9, pp. 33–41 (1995)
Nordin, P.: A compiling genetic programming system that directly manipulates the machine code. In: Kinnear Jr., K.E. (ed.) Advances in Genetic Programming, ch. 14, pp. 311–331. MIT Press, Cambridge (1994)
Eggermont, J., Eiben, A.E., van Hemert, J.I.: A comparison of genetic programming variants for data classification. In: Hand, D.J., Kok, J.N., Berthold, M.R. (eds.) IDA 1999. LNCS, vol. 1642, p. 281. Springer, Heidelberg (1999)
Howard, D., Roberts, S.C., Ryan, C.: The boru data crawler for object detection tasks in machine vision. In: Cagnoni, S., Gottlieb, J., Hart, E., Middendorf, M., Raidl, G.R. (eds.) EvoIASP 2002, EvoWorkshops 2002, EvoSTIM 2002, EvoCOP 2002, and EvoPlan 2002. LNCS, vol. 2279, pp. 220–230. Springer, Heidelberg (2002)
Song, A., Ciesielski, V., Williams, H.: Texture classifiers generated by genetic programming. In: Fogel, D.B., El-Sharkawi, M.A., Yao, X., Greenwood, G., Iba, H., Marrow, P., Shackleton, M. (eds.) Proceedings of the 2002 Congress on Evolutionary Computation CEC 2002, pp. 243–248. IEEE Press, Los Alamitos (2002)
Tackett, W.A.: Genetic programming for feature discovery and image discrimination. In: Forrest, S. (ed.) Proceedings of the 5th International Conference on Genetic Algorithms, ICGA 1993, University of Illinois at Urbana-Champaign, July 17-21, pp. 303–309. Morgan Kaufmann, San Francisco (1993)
Zhang, M., Andreae, P., Pritchard, M.: Pixel statistics and false alarm area in genetic programming for object detection. In: Raidl, G.R., Cagnoni, S., Cardalda, J.J.R., Corne, D.W., Gottlieb, J., Guillot, A., Hart, E., Johnson, C.G., Marchiori, E., Meyer, J.-A., Middendorf, M. (eds.) EvoIASP 2003, EvoWorkshops 2003, EvoSTIM 2003, EvoROB/EvoRobot 2003, EvoCOP 2003, EvoBIO 2003, and EvoMUSART 2003. LNCS, vol. 2611, pp. 455–466. Springer, Heidelberg (2003)
Zhang, M., Ciesielski, V., Andreae, P.: A domain independent window-approach to multiclass object detection using genetic programming. EURASIP Journal on Signal Processing, Special Issue on Genetic and Evolutionary Computation for Signal Processing and Image Analysis 2003(8), 841–859 (2003)
Zhang, M., Smart, W.: Using gaussian distribution to construct fitness functions in genetic programming for multiclass object classification. Pattern Recognition Letters 27(11), 1266–1274 (2006)
Lin, Y., Bhanu, B.: Object detection via feature synthesis using MDL-based genetic programming. IEEE Transactions on Systems, Man and Cybernetics, Part B 35(3), 538–547 (2005)
Song, A., Loveard, T., Ciesielski, V.: Towards genetic programming for texture classification. In: Stumptner, M., Corbett, D.R., Brooks, M. (eds.) Canadian AI 2001. LNCS, vol. 2256, pp. 461–472. Springer, Heidelberg (2001)
Tackett, W.A.: Recombination, Selection, and the Genetic Construction of Computer Programs. PhD thesis, Faculty of the Graduate School, University of Southern California, Canoga Park, California, USA (April 1994)
Zhang, M., Ciesielski, V.: Genetic programming for multiple class object detection. In: Foo, N.Y. (ed.) Canadian AI 1999. LNCS (LNAI), vol. 1747, pp. 180–192. Springer, Heidelberg (1999)
Loveard, T., Ciesielski, V.: Representing classification problems in genetic programming. In: Proceedings of the Congress on Evolutionary Computation, COEX, World Trade Center, 159 Samseong-dong, Gangnam-gu, Seoul, Korea, May 27-30, vol. 2, pp. 1070–1077. IEEE Press, Los Alamitos (2001)
Zhang, M., Smart, W.: Multiclass object classification using genetic programming. In: Raidl, G.R., Cagnoni, S., Branke, J., Corne, D.W., Drechsler, R., Jin, Y., Johnson, C.G., Machado, P., Marchiori, E., Rothlauf, F., Smith, G.D., Squillero, G. (eds.) EvoWorkshops 2004. LNCS, vol. 3005, pp. 369–378. Springer, Heidelberg (2004)
Song, A.: Texture Classification: A Genetic Programming Approach. PhD thesis, Department of Computer Science, RMIT University, Melbourne, Australia (2003)
Roberts, M., Claridge, E.: A multi-stage approach to cooperatively coevolving image feature construction and object detection. In: Rothlauf, F.R., et al. (eds.) Applications of Evolutionary Computation, Proceedings of Evolutionary Computing in Image and Signal Analysis (EvoIASP), Lausanne Switzerland, March 30- April 1. LNCS, vol. 3003. Springer, Heidelberg (2005)
Montana, D.J.: Strongly typed genetic programming. Evolutionary Computation 3(2), 199–230 (1995)
Forsyth, D.A., Ponce, J.: Computer Vision: A Modern Approach. Prentice-Hall, Englewood Cliffs (2003)
Caelli, T., Bischof, W.F.: Machine Learning and Image Interpretation. Plenum Press, New York (1997)
Gose, E., Johnsonbaugh, R., Jost, S.: Pattern Recognition and Image Analysis. Prentice Hall PTR, Upper Saddle River (1996)
Howard, D., Roberts, S.C., Brankin, R.: Target detection in SAR imagery by genetic programming. Advances in Engineering Software 30, 303–311 (1999)
Teller, A., Veloso, M.: A controlled experiment: Evolution for learning difficult image classification. In: Pinto-Ferreira, C., Mamede, N.J. (eds.) EPIA 1995. LNCS (LNAI), vol. 990, pp. 165–176. Springer, Heidelberg (1995)
Robinson, G., McIlroy, P.: Exploring some commercial applications of genetic programming. In: Fogarty, T.C. (ed.) AISB-WS 1995. LNCS, vol. 993. Springer, Heidelberg (1995)
Isaka, S.: An empirical study of facial image feature extraction by genetic programming. In: Koza, J.R. (ed.) The Genetic Programming 1997 Conference, Stanford Bookstore, Stanford University, CA, USA, pp. 93–99 (July 1997) (Late Breaking Papers)
Andre, D.: Automatically defined features: The simultaneous evolution of 2-dimensional feature detectors and an algorithm for using them. In: Kinnear, K.E. (ed.) Advances in Genetic Programming, pp. 477–494. MIT Press, Cambridge (1994)
Ciesielski, V., Innes, A., John, S., Mamutil, J.: Understanding evolved genetic programs for a real world object detection problem. In: Keijzer, M., Tettamanzi, A.G.B., Collet, P., van Hemert, J., Tomassini, M. (eds.) EuroGP 2005. LNCS, vol. 3447, pp. 351–360. Springer, Heidelberg (2005)
Song, A., Ciesielski, V.: Texture analysis by genetic programming. In: Proceedings of the 2004 IEEE Congress on Evolutionary Computation, Portland, Oregon, June 20-23, pp. 2092–2099. IEEE Press, Los Alamitos (2004)
Bhanu, B., Lin, Y.: Object detection in multi-modal images using genetic programming. Applied Soft Computing 4(2), 175–201 (2004)
Bhanu, B., Lin, Y., Krawiec, K.: Evolutionary Synthesis of Pattern Recognition Systems. In: Monographs in Computer Science. Springer, New York (2005)
Cagnoni, S., Lutton, E., Olague, G.: Genetic and Evolutionary Computation for Image Processing and Analysis. In: EURASIP Book Series on Signal Processing and Communications, vol. 8. Hindawi Publishing Corporation (to appear) (2007)
Olaguea, G., Cagnoni, S., Lutton, E. (eds.): special issue on evolutionary computer vision and image understanding. Pattern Recognition Letters 27(11) (2006)
Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning internal representations by error propagation. In: Rumelhart, D.E., McClelland, J.L. (eds.) Parallel distributed Processing, Explorations in the Microstructure of Cognition. Foundations, vol. 1, MIT Press, Cambridge (1986)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Zhang, M., Johnston, M. (2009). A Variant Program Structure in Tree-Based Genetic Programming for Multiclass Object Classification. In: Cagnoni, S. (eds) Evolutionary Image Analysis and Signal Processing. Studies in Computational Intelligence, vol 213. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01636-3_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-01636-3_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01635-6
Online ISBN: 978-3-642-01636-3
eBook Packages: EngineeringEngineering (R0)