Abstract
Much recent progress in Genetic Programming (GP) can be ascribed to work in semantic GP, which facilitates program induction by considering program behavior on individual fitness cases. It is therefore interesting to consider whether alternative decompositions of fitness cases might also provide useful information. The one we present here is motivated by work in analogical reasoning. So-called proportional analogies (‘gills are to fish as lungs are to mammals’) have a hierarchical relational structure that can be captured using the formalism of Structural Information Theory. We show how proportional analogy problems can be solved with GP and, conversely, how analogical reasoning can be engaged in GP to provide for problem decomposition. The idea is to treat pairs of fitness cases as if they formed a proportional analogy problem, identify relational consistency between them, and use it to inform the search process.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
- 2.
Strictly, Iter here is slightly more complex than that previously mentioned, in that it expresses an inductive construction known as a catamorphism [26].
References
Aamodt, A., Plaza, E.: Case-based reasoning: foundational issues, methodological variations, and system approaches. AI Commun. 7(1), 39–59 (1994). http://dl.acm.org/citation.cfm?id=196108.196115
Baumgartner, A., Kutsia, T.: A Library of Anti-Unification Algorithms. RISC Report Series 14-07, Research Institute for Symbolic Computation (RISC), Johannes Kepler University Linz, Schloss Hagenberg, Hagenberg (2014). http://www.risc.jku.at/publications/download/risc_5003/au_library.pdf
Cooke, H., Tredennick, H.: Aristotle: the Organon, vol. 1. Harvard University Press, Harvard (1938). https://books.google.co.uk/books?id=TgeISwAACAAJ
Dastani, M., Indurkhya, B., Scha, R.: Analogical projection in pattern perception. J. Exp. Theor. Artif. Intell. 15(4), 489–511 (2003). https://doi.org/10.1080/09528130310001626283
Dastani, M., Marchiori, E., Voorn, R.: Finding perceived pattern structures using genetic programming. In: Spector, L., et al. (eds.) Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2001), pp. 3–10. Morgan Kaufmann, San Francisco, CA (2001). http://www.cs.bham.ac.uk/~wbl/biblio/gecco2001/d01.pdf
Dershowitz, N.: The evolution of programs: program abstraction and instantiation. In: Proceedings of the 5th International Conference on Software Engineering, ICSE ’81, pp. 79–88. IEEE Press, Piscataway, NJ (1981). http://dl.acm.org/citation.cfm?id=800078.802519
Dershowitz, N., Manna, Z.: On automating structured programming. In: Huet G., Kahn, G. (eds.) IRIA Symposium on Proving and Improving Programs, pp. 167–193. Arc-et-Senans (1975)
Ehrenfels, C.V.: Über Gestaltqualitäten. Vierteljahresschr. für Philosophie 14, 249–292 (1890)
Evans, T.G.: A heuristic program to solve geometric-analogy problems. In: Proceedings of the April 21–23, 1964, Spring Joint Computer conference, AFIPS ’64 (Spring), pp. 327–338. ACM, New York, NY (1964). http://doi.acm.org/10.1145/1464122.1464156
Falkenhainer, B., Forbus, K.D., Gentner, D.: The structure-mapping engine: algorithm and examples. Artif. Intell. 41(1), 1–63 (1989). http://dx.doi.org/10.1016/0004-3702(89)90077-5
French, R.M.: The subtlety of sameness: a theory and computer model of analogy-making. The MIT Press, Cambridge (1995)
Hofmann, M.: Igor II - an analytical inductive functional programming system. In: In Proceedings of the 2010 ACM SIGPLAN Workshop on Partial Evaluation and Program Manipulation, pp. 29–32 (2010)
Hofstadter, D.R.: Fluid Concepts and Creative Analogies: Computer Models of the Fundamental Mechanisms of Thought. Basic Books, Inc., New York, NY (1996)
Holyoak, K.J., Thagard, P.: Analogical mapping by constraint satisfaction. Cogn. Sci. 13(3), 295–355 (1989). http://dx.doi.org/10.1207/s15516709cog1303_1
Hummel, J.E., Holyoak, K.J.: Distributed representations of structure: a theory of analogical access and mapping. Psycholog. Rev. 1997, 427–466 (1997)
Katayama, S.: An analytical inductive functional programming system that avoids unintended programs. In: Proceedings of the ACM SIGPLAN 2012 Workshop on Partial Evaluation and Program Manipulation, PEPM ’12, pp. 43–52. ACM, New York, NY (2012). http://doi.acm.org/10.1145/2103746.2103758
Kocsis, Z.A., Swan, J.: Asymptotic Genetic Improvement programming via type functors and catamorphisms. In: Johnson, C., Krawiec, K., Moraglio, A., O’Neill, M. (eds.) Semantic Methods in Genetic Programming. Ljubljana, Slovenia (2014). http://www.cs.put.poznan.pl/kkrawiec/smgp2014/uploads/Site/Kocsis.pdf. Workshop at Parallel Problem Solving from Nature 2014 Conference
Kovitz, B., Swan, J.: Structural stigmergy: a speculative pattern language for metaheuristics. In: Proceedings of the Companion Publication of the 2014 Annual Conference on Genetic and Evolutionary Computation, GECCO Comp ’14, pp. 1407–1410. ACM, New York, NY (2014). http://doi.acm.org/10.1145/2598394.2609845
Krawiec, K.: Behavioral Program Synthesis with Genetic Programming, 1st edn. Springer Publishing Company, Incorporated, Berlin (2015)
Krawiec, K., O’Reilly, U.M.: Behavioral programming: a broader and more detailed take on semantic GP. In: Proceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation, GECCO ’14, pp. 935–942. ACM, New York, NY (2014). http://doi.acm.org/10.1145/2576768.2598288
Krawiec, K., Swan, J.: Guiding evolutionary learning by searching for regularities in behavioral trajectories: a case for representation agnosticism. In: AAAI Fall Symposium: How Should Intelligence be Abstracted in AI Research (2013)
Krawiec, K., Swan, J., O’Reilly, U.M.: Behavioral program synthesis: Insights and prospects. In: Riolo, R., Worzel, W.P., Groscurth, K. (eds.) Genetic Programming Theory and Practice XIII, Genetic and Evolutionary Computation. Springer, Ann Arbor (2015). http://www.cs.put.poznan.pl/kkrawiec/wiki/uploads/Research/2015GPTP.pdf
Leeuwenberg, E., van der Helm, P.: Structural Information Theory: The Simplicity of Visual Form. Cambridge University Press, Cambridge (2015)
Luqi, Goguen, J.A.: Formal methods: promises and problems. IEEE Softw. 14(1), 73–85 (1997). http://dx.doi.org/10.1109/52.566430
Manna, Z., Waldinger, R.: Knowledge and reasoning in program synthesis. In: Programming Methodology, 4th Informatik Symposium, pp. 236–277. Springer, London (1975). http://dl.acm.org/citation.cfm?id=647950.742874
Meijer, E., Fokkinga, M., Paterson, R.: Functional programming with bananas, lenses, envelopes and barbed wire. In: Proceedings of the 5th ACM Conference on Functional Programming Languages and Computer Architecture, pp. 124–144. Springer New York, Inc., New York (1991). http://dl.acm.org/citation.cfm?id=127960.128035
Mitchell, M.: Analogy-Making as Perception: A Computer Model. MIT Press, Cambridge (1993). http://portal.acm.org/citation.cfm?id=152203
Muggleton, S.: Inductive Logic Programming: Derivations, successes and shortcomings. SIGART Bull. 5(1), 5–11 (1994). http://doi.acm.org/10.1145/181668.181671
Otero, F., Castle, T., Johnson, C.: EpochX: Genetic programming in java with statistics and event monitoring. In: Proceedings of the 14th Annual Conference Companion on Genetic and Evolutionary Computation, GECCO ’12, pp. 93–100. ACM, New York, NY (2012). https://doi.org/10.1145/2330784.2330800
Phillips, S., Wilson, W.H.: Categorial compositionality: a category theory explanation for the systematicity of human cognition. PLoS Comput. Biol. 6(7) (2010)
Plotkin, G.D.: A note on inductive generalization. Mach. Intell. 5, 153–163 (1970)
Prade, H., Richard, G.: Computational Approaches to Analogical Reasoning: Current Trends. Springer Publishing Company, Incorporated, Berlin (2014)
Raza, M., Gulwani, S., Milic-Frayling, N.: Programming by example using least general generalizations. In: Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, July 27–31, 2014, Québec City, QC, pp. 283–290 (2014). http://www.aaai.org/ocs/index.php/AAAI/AAAI14/paper/view/8520
Reynolds, J.C.: Transformational systems and the algebraic structure of atomic formulas. In: Meltzer, B., Michie, D. (eds.) Machine Intelligence, vol. 5, pp. 135–151. Edinburgh University Press, Edinburgh (1969)
Schmid, U.: Inductive Synthesis of Functional Programs, Universal Planning, Folding of Finite Programs, and Schema Abstraction by Analogical Reasoning, Lecture Notes in Computer Science, vol. 2654. Springer, Berlin (2003). http://dx.doi.org/10.1007/b12055
Schmid, U., Burghardt, J.: An algebraic framework for solving proportional and predictive analogies. In: Schmalhofer, F., et.al. (eds.) Proceedings of the European Conference on Cognitive Science, pp. 295–300, Erlbaum (2003)
Schmidt, M., Krumnack, U., Gust, H., Kühnberger, K.: Heuristic-driven theory projection: an overview. In: Prade, H., Richard, G. (eds.) Computational Approaches to Analogical Reasoning: Current Trends, vol. 548, pp. 163–194. Springer, Berlin (2014). https://doi.org/10.1007/978-3-642-54516-0_7
Silva, S., Dignum, S., Vanneschi, L.: Operator equalisation for bloat free genetic programming and a survey of bloat control methods. Genet. Program Evolvable Mach. 13(2), 197–238 (2012). http://dx.doi.org/10.1007/s10710-011-9150-5
Stewart, I., Cohen, J.: Figments of Reality: The Evolution of the Curious Mind. Cambridge University Press, Cambridge (1999)
Swan, J., Drake, J., Krawiec, K.: Semantically-meaningful numeric constants for genetic programming. In: Johnson, C., Krawiec, K., Moraglio, A., O’Neill, M. (eds.) Semantic Methods in Genetic Programming. Ljubljana, Slovenia (2014). http://www.cs.put.poznan.pl/kkrawiec/smgp2014/uploads/Site/Swan.pdf. Workshop at Parallel Problem Solving from Nature 2014 Conference
Ulrich, J.W., Moll, R.: Program synthesis by analogy. SIGART Bull. 64, 22–28 (1977). http://doi.acm.org/10.1145/872736.806928
van der Helm, P., Leeuwenberg, E.: Avoiding explosive search in automatic selection of simplest pattern codes. Pattern Recogn. 19(2), 181–191 (1986). http://dx.doi.org/10.1016/0031-3203(86)90022-1
Van Der Helm, P.A., Leeuwenberg, E.L.J.: Accessibility: A criterion for regularity and hierarchy in visual pattern codes. J. Math. Psychol. 35(2), 151–213 (1991). http://dx.doi.org/10.1016/0022-2496(91)90025-O
Weller, S., Schmid, U.: Analogy by abstraction. In: Proceedings of the Seventh International Conference on Cognitive Modeling (ICCM). Trieste (2006)
Weller, S., Schmid, U.: Solving proportional analogies by E-generalization. In: KI 2006: Advances in Artificial Intelligence, 29th Annual German Conference on AI, KI 2006, Bremen, Germany, June 14–17, 2006, Proceedings, pp. 64–75 (2006). https://doi.org/10.1007/978-3-540-69912-5_6
Yanai, K., Iba, H.: Estimation of distribution programming: EDA-based approach to program generation. In: Towards a New Evolutionary Computation: Advances in the Estimation of Distribution Algorithms, pp. 103–122. Springer, Berlin (2006). https://doi.org/10.1007/3-540-32494-1_5
Yu, T.: Structure abstraction and genetic programming. In: Angeline, P.J., Michalewicz, Z., Schoenauer, M., Yao, X., Zalzala, A. (eds.) Proceedings of the Congress on Evolutionary Computation, vol. 1, pp. 652–659. IEEE Press, Mayflower Hotel, Washington, DC (1999). https://doi.org/10.1109/CEC.1999.781995. http://www.cs.mun.ca/~tinayu/index_files/addr/public_html/cec99.pdf
Acknowledgements
Thanks are due to Dave Bender and the CRCC in Bloomington for providing us with the original list of letter-string analogy examples. K. Krawiec acknowledges support from grant 2014/15/B/ST6/05205 funded by the National Science Centre, Poland. Both authors thank the reviewers for valuable and insightful suggestions and comments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Swan, J., Krawiec, K. (2018). Discovering Relational Structure in Program Synthesis Problems with Analogical Reasoning. In: Riolo, R., Worzel, B., Goldman, B., Tozier, B. (eds) Genetic Programming Theory and Practice XIV. Genetic and Evolutionary Computation. Springer, Cham. https://doi.org/10.1007/978-3-319-97088-2_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-97088-2_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-97087-5
Online ISBN: 978-3-319-97088-2
eBook Packages: Computer ScienceComputer Science (R0)