Skip to main content

On the Transfer Learning of Genetic Programming Classification Algorithms

  • Conference paper
  • First Online:
Book cover Theory and Practice of Natural Computing (TPNC 2021)

Abstract

Data classification is a real-world problem that is encountered daily in various problem domains. Genetic programming (GP) has proved to be one of the most versatile algorithms leading to its popularity as a classification algorithm. However, due to its large number of parameters, the manual design process of GP is considered to be a time consuming tedious task. As a result, there have been initiatives by the machine learning community to automate the design of GP classification algorithms. In this paper, we propose the transfer of the design knowledge gained from the automated design of GP classification algorithms from a specific source domain and apply it to design GP classification algorithms for a target domain. The results of the experiments demonstrate that the proposed approach is capable of evolving classifiers that achieve results that are competitive when compared to automated designed classifiers and better than manually tuned parameter classifiers. To the best of our knowledge, this is the first study that examines transfer learning in automated design. The proposed approach is shown to achieve positive transfer.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 44.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 59.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Espejo, P.G., Romero, C., Ventura, S., Hervás, C.: Induction of classification rules with grammar-based genetic programming. In: Conference on Machine Intelligence, pp. 596–601 (2005)

    Google Scholar 

  2. Goldberg, D.E., Holland, J.H.: Genetic algorithms and machine learning. Mach. Learn. 3, 95–99 (1988)

    Article  Google Scholar 

  3. Hutter, F., Hoos, H.H., Leyton-Brown, K., Stützle, T.: ParamILS: an automatic algorithm configuration framework. J. Artif. Intell. Res. 36, 267–306 (2009)

    Article  Google Scholar 

  4. Koza, J.R.: Concept formation and decision tree induction using the genetic programming paradigm. In: Schwefel, H.-P., Männer, R. (eds.) PPSN 1990. LNCS, vol. 496, pp. 124–128. Springer, Heidelberg (1991). https://doi.org/10.1007/BFb0029742

    Chapter  Google Scholar 

  5. Montero, E., Riff, M.-C.: Towards a method for automatic algorithm configuration: a design evaluation using tuners. In: Bartz-Beielstein, T., Branke, J., Filipič, B., Smith, J. (eds.) PPSN 2014. LNCS, vol. 8672, pp. 90–99. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10762-2_9

    Chapter  Google Scholar 

  6. Nyathi, T.: Automated design of genetic programming of classification algorithms. Ph.D. thesis (2018)

    Google Scholar 

  7. Nyathi, T., Pillay, N.: Comparison of a genetic algorithm to grammatical evolution for automated design of genetic programming classification algorithms. Expert Syst. Appl. 104, 213–234 (2018)

    Article  Google Scholar 

  8. O’Neill, M., Ryan, C.: Grammatical evolution. IEEE Trans. Evol. Comput. 5(4), 349–358 (2001)

    Article  Google Scholar 

  9. Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2009)

    Article  Google Scholar 

  10. Pillay, N., Qu, R., Srinivasan, D., Hammer, B., Sorensen, K.: Automated design of machine learning and search algorithms [guest editorial]. IEEE Comput. Intell. Mag. 13(2), 16–17 (2018)

    Article  Google Scholar 

  11. Tavallaee, M., Bagheri, E., Lu, W., Ghorbani, A.A.: A detailed analysis of the KDD cup 99 data set. In: 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications, pp. 1–6. IEEE (2009)

    Google Scholar 

  12. Torrey, L., Shavlik, J.: Transfer learning. In: Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques, pp. 242–264. IGI Global (2010)

    Google Scholar 

  13. Vanneschi, L., Castelli, M., Silva, S.: A survey of semantic methods in genetic programming. Genet. Program Evolvable Mach. 15(2), 195–214 (2014)

    Article  Google Scholar 

  14. Woolson, R.: Wilcoxon signed-rank test. In: Wiley Encyclopedia of Clinical Trials, pp. 1–3 (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Thambo Nyathi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Nyathi, T., Pillay, N. (2021). On the Transfer Learning of Genetic Programming Classification Algorithms. In: Aranha, C., Martín-Vide, C., Vega-Rodríguez, M.A. (eds) Theory and Practice of Natural Computing. TPNC 2021. Lecture Notes in Computer Science(), vol 13082. Springer, Cham. https://doi.org/10.1007/978-3-030-90425-8_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-90425-8_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-90424-1

  • Online ISBN: 978-3-030-90425-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics