ABSTRACT
This paper presents Kaizen Programming, an evolutionary tool based on the concepts of Continuous Improvement from Kaizen Japanese methodology. One may see Kaizen Programming as a new paradigm since, as opposed to classical evolutionary algorithms where individuals are complete solutions, in Kaizen Programming each expert proposes an idea to solve part of the problem, thus a solution is composed of all ideas together. Consequently, evolution becomes a collaborative approach instead of an egocentric one. An idea's quality (analog to an individual's fitness) is not how good it fits the data, but a measurement of its contribution to the solution, which improves the knowledge about the problem. Differently from evolutionary algorithms that simply perform trial-and-error search, one can determine, exactly, parts of the solution that should be removed or improved. That property results in the reduction in bloat, number of function evaluations, and computing time. Even more important, the Kaizen Programming tool, proposed to solve symbolic regression problems, builds the solutions as linear regression models - not linear in the variables, but linear in the parameters, thus all properties and characteristics of such statistical tool are valid. Experiments on benchmark functions proposed in the literature show that Kaizen Programming easily outperforms Genetic Programming and other methods, providing high quality solutions for both training and testing sets while requiring a small number of function evaluations.
- F.-A. Fortin, F.-M. De Rainville, M.-A. Gardner, M. Parizeau, and C. Gagné. DEAP: Evolutionary algorithms made easy. Journal of Machine Learning Research, 13:2171--2175, jul 2012. Google ScholarDigital Library
- H. Gitlow, S. Gitlow, A. Oppenheim, and R. Oppenheim. Tools and Methods for the Improvement of Quality. Irwin series in quantitative analysis for business. Taylor & Francis, 1989.Google Scholar
- D. E. Goldberg. Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, 1989. Google ScholarDigital Library
- M. Imai. Kaizen (Ky'zen), the key to Japan's competitive success. McGraw-Hill, 1986.Google Scholar
- D. Karaboga, C. Ozturk, N. Karaboga, and B. Gorkemli. Artificial bee colony programming for symbolic regression. Information Sciences, 209(0):1 -- 15, 2012. Google ScholarDigital Library
- M. F. Korns. Abstract expression grammar symbolic regression. In Genetic Programming Theory and Practice VIII, volume 8 of Genetic and Evolutionary Computation, chapter 7, pages 109--128. Springer, Ann Arbor, USA, 20--22 May 2010.Google Scholar
- M. F. Korns. Abstract expression grammar symbolic regression. In Genetic Programming Theory and Practice VIII, volume 8 of Genetic and Evolutionary Computation, pages 109--128. Springer New York, 2011.Google ScholarCross Ref
- J. R. Koza. Genetic programming - on the programming of computers by means of natural selection. Complex adaptive systems. MIT Press, 1993. Google ScholarDigital Library
- J. McDermott, D. R. White, S. Luke, L. Manzoni, M. Castelli, L. Vanneschi, W. Jaskowski, K. Krawiec, R. Harper, K. A. D. Jong, and U.-M. O'Reilly. Genetic programming needs better benchmarks. In T. Soule and J. H. Moore, editors, GECCO, pages 791--798. ACM, 2012. Google ScholarDigital Library
- A. Moraglio, K. Krawiec, and C. G. Johnson. Geometric semantic genetic programming. In C. A. C. Coello, V. Cutello, K. Deb, S. Forrest, G. Nicosia, and M. Pavone, editors, PPSN (1), volume 7491 of Lecture Notes in Computer Science, pages 21--31. Springer, 2012. Google ScholarDigital Library
- M. O'Neill, L. Vanneschi, S. Gustafson, and W. Banzhaf. Open issues in genetic programming. Genetic Programming and Evolvable Machines, 11(3--4):339--363, 2010. Google ScholarDigital Library
- C. L. Pennachin, M. Looks, and J. A. de Vasconcelos. Robust symbolic regression with affine arithmetic. In GECCO '10: Proceedings of the 12th annual conference on Genetic and evolutionary computation, pages 917--924, Portland, Oregon, USA, 7--11 July 2010. ACM. Google ScholarDigital Library
- R. Poli, W. Langdon, and N. McPhee. A field guide to genetic programming. Lulu Enterprises Uk Ltd, 2008. Google ScholarDigital Library
- K. Veeramachaneni, O. Derby, D. Sherry, and U.-M. O'Reilly. Learning regression ensembles with genetic programming at scale. In Proceedings of the 15th Annual Conference on Genetic and Evolutionary Computation, GECCO '13, pages 1117--1124, New York, NY, USA, 2013. ACM. Google ScholarDigital Library
- Kaizen programming
Recommendations
Inclusive Genetic Programming
Genetic ProgrammingAbstractThe promotion and maintenance of the population diversity in a Genetic Programming (GP) algorithm was proved to be an important part of the evolutionary process. Such diversity maintenance improves the exploration capabilities of the GP algorithm, ...
A Novel Neural Network-Based Symbolic Regression Method: Neuro-Encoded Expression Programming
Artificial Neural Networks and Machine Learning – ICANN 2019: Deep LearningAbstractNeuro-encoded expression programming (NEEP) that aims to offer a novel continuous representation of combinatorial encoding for genetic programming methods is proposed in this paper. Genetic programming with linear representation uses nature-...
Solving the Lawn Mower problem with Kaizen Programming and λ-Linear Genetic Programming for Module Acquisition
GECCO '16 Companion: Proceedings of the 2016 on Genetic and Evolutionary Computation Conference CompanionIn this work, we have tested a new approach for evolving modular programs: Kaizen Programming (KP) with ε-Linear Genetic Programming (ε-LGP) and a heuristic search procedure to solve the well-known Lawn Mower problem. KP is a novel hybrid approach that ...
Comments