Abstract
This paper investigates how varying the difficulty of the environment can affect the evolution of team behaviour in a combative game setting. The difficulty of the environment is altered by varying the perceptual capabilities of the agents in the game. The behaviours of the agents are evolved using a genetic program. These experiments show that the level of difficulty of the environment does have an impact on the evolvability of effective team behaviours; i.e. simpler environments are more conducive to the evolution of effective team behaviours than more difficult environments. In addition, the experiments show that no one best solution from any environment is optimal for all environments.
Similar content being viewed by others
References
Bakkes S, Spronck P, Postma EO (2004) Team: the team-oriented evolutionary adaptability mechanism. In: Rauterberg M (ed) Proceedings of the third international conference on entertainment computing (ICEC 2004). Lecture notes in computer science, vol 3166. Springer, pp 273–282
Buckland M (2005) Programming game AI by example. Wordware Publishing, Inc., Plano, TX
Buckland M, Collins M (2002) AI techniques for game programming. Premier Press, Portland, OR
Champandard AJ (2004) AI game development: synthetic creatures with learning and reactive behaviours. New Riders Publishing, Thousand Oaks, CA
Cole N, Louis S, Miles C (2004) Using a genetic algorithm to tune first–person shooter bots. In: Congress on evolutionary computation 2004, vol 1, pp 139–145
Doherty D, O’Riordan C (2006) Evolving tactical behaviours for teams of agents in single player action games. In: CGAMES 2006 9th international conference on computer games: AI, animation, mobile, educational & serious games, pp 121–126
Doherty D, O’Riordan C (2007) A phenotypic analysis of gp-evolved team behaviours. In: GECCO ’07: Proceedings of the 9th annual conference on genetic and evolutionary computation. ACM Press, New York, NY, USA, pp 1951–1958
Ehlis T (2000) Application of genetic programming to the “snake game”. GamedevNet 1(175), http://www.gamedev.net/reference/articles/article1175.asp. Accessed 9th October 2003
Eskin E, Siegel E (1999) Genetic programming applied to othello: introducing students to machine learning research. In: SIGCSE ’99: The proceedings of the thirtieth SIGCSE technical symposium on computer science education. ACM Press, New York, NY, USA, pp 242–246
Fogel DB (1993) Using evolutionary programming to create neural networks that are capable of playing tic-tac-toe. In: Proceedings of the American power conference, IEEE, pp 875–879
Fogel DB (2002) Blondie24: playing at the edge of AI. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA
Frayn C (2005) An evolutionary approach to strategies for the game of monopoly. In: Proceedings of the 2005 IEEE symposium on computational intelligence and games (CIG05)
GSC-GameWorld (2006) S.T.A.L.K.E.R.: Shadow of Chernobyl. http://www.stalker-game.com/en/
Hauptman A, Sipper M (2005) Gp-endchess: using genetic programming to evolve chess endgame players. In: Proceedings of the 8th European conference on genetic programming, pp 120–131
Haynes T, Sen S (1995) Evolving behavioral strategies in predators and prey. In: Sen S(eds) International joint conference on artificial intelligence-95 workshop on adaptation and learning in multiagent systems. Morgan Kaufmann, Montreal, Quebec, Canada, pp 32–37
Haynes T, Sen S, Schoenefeld D, Wainwright R (1995) Evolving a team. In: Siegel EV, Koza JR(eds) Working notes for the AAAI symposium on genetic programming. AAAI, Cambridge, MA
Haynes T, Wainwright R, Sen S (1995b) Evolving cooperation strategies. In: Lesser V (ed) Proceedings of the 1st international conference on multi-agent systems. MIT Press, San Francisco, CA, p 450, citeseer.ist.psu.edu/haynes94evolving.html
ID-Software (1994) Doom. http://www.idsoftware.com/
ID-Software (1996) Quake. http://www.idsoftware.com/
Jones T, Forrest S (1995) Fitness distance correlation as a measure of problem difficulty for genetic algorithms. In: Eshelman L (ed) Proceedings of the 6th international conference on genetic algorithms. Morgan Kaufmann, San Francisco, CA, pp 184–192
Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection. MIT Press, Cambridge, MA, USA
LaLena M (1997) Teamwork in genetic programming. Master’s thesis, Rochester Institute of Technology, School of Computer Science and Technology
Lassabe N, Sanchez S, Luga H, Duthen Y (2006) Genetically programmed strategies for chess endgame. In: GECCO ’06: Proceedings of the 8th annual conference on genetic and evolutionary computation. ACM Press, New York, NY, USA, pp 831–838
Lionhead-Studios (2001) Black & White. http://www.lionhead.com/bw/
Luke S, Spector L (1996) Evolving teamwork and coordination with genetic programming. In: Koza JR, Goldberg DE, Fogel DB, Riolo RL (eds) Genetic programming, 1996: Proceedings of the 1st annual conference. MIT Press, Stanford University, CA, USA pp 150–156
Luke S, Hohn C, Farris J, Jackson G, Hendler J (1997) Co-evolving soccer softbot team coordination with genetic programming. In: International joint conference on artificial intelligence-97 first international workshop on RoboCup. Nagoya, Japan
Poli R, Vanneschi L (2007) Fitness-proportional negative slope coefficient as a hardness measure for genetic algorithms. In: GECCO ’07: Proceedings of the 9th annual conference on genetic and evolutionary computation. ACM Press, New York, NY, USA, pp 1335–1342
Ponsen M (2004) Improving adaptive game-AI with evolutionary learning. Master’s thesis, Delft University of Technology
Raik S, Durnota B (1994) The evolution of sporting strategies. In: Stonier RJ, Yu XH(eds) Complex systems: mechanisms of adaption. IOS Press, Amsterdam, The Netherlands, pp 85–92
Reynolds CW (1993) An evolved, vision-based behavioral model of coordinated group motion. In: Proceedings of the 2nd international conference on from animals to animats 2: simulation of adaptive behavior. MIT Press, Cambridge, MA, USA, pp 384–392
Richards N, Moriarty D, McQuesten P, Miikkulainen R (1997) Evolving neural networks to play Go. In: Proceedings of the 7th international conference on genetic algorithms. East Lansing, MI
Richards MD, Whitley D, Beveridge JR, Mytkowicz T, Nguyen D, Rome D (2005) Evolving cooperative strategies for uav teams. In: GECCO ’05: Proceedings of the 7th annual conference on genetic and evolutionary computation. ACM Press, New York, NY, USA, pp 1721–1728
Rosin CD, Belew RK (1995) Methods for competitive co-evolution: finding opponents worth beating. In: Eshelman L(eds) Proceedings of the 6th international conference on genetic algorithms. Morgan Kaufmann, San Francisco, CA, pp 373–380
Stanley KO, Bryant BD, Miikkulainen R (2005) Evolving neural network agents in the nero video game. In: Proceedings of the IEEE 2005 symposium on computational intelligence and games (CIG05)
Thurau C, Bauckhage C, Sagerer G (2004) Imitation learning at all levels of game–AI. In: Proceedings of the international conference on computer games, Artificial Intelligence, Design and Education, pp 402–408
Valve (2000) Counter strike. http://www.counter-strike.com
Vanneschi L, Clergue M, Collard P, Tomassini M, Verel S (2004) Fitness clouds and problem hardness in genetic programming. In: KD et al (ed) GECCO ’04: Proceedings of the 6th annual conference on genetic and evolutionary computation. Lecture notes in computer science, vol 3103. Springer-Verlag, Seattle, WA, USA, pp 690–701
Vanneschi L, Tomassini M, Collard P, Vérel S (2006) Negative slope coefficient: a measure to characterize genetic programming fitness landscapes. In: Collet P, Tomassini M, Ebner M, Gustafson S, Ekárt A (eds) Proceedings of the 9th European conference on genetic programming. Lecture notes in computer science, vol 3905. Springer, pp 178–189
Yannakakis GN, Hallam J (2004) Evolving opponents for interesting interactive computer games. In: Proceedings of the 8th international conference on simulation of adaptive behaviour (SAB04), pp 499–508
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Doherty, D., O’Riordan, C. Evolving team behaviours in environments of varying difficulty. Artif Intell Rev 27, 223–244 (2007). https://doi.org/10.1007/s10462-008-9078-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10462-008-9078-1