Skip to main content

Advertisement

Log in

Evolving team behaviours in environments of varying difficulty

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

This paper investigates how varying the difficulty of the environment can affect the evolution of team behaviour in a combative game setting. The difficulty of the environment is altered by varying the perceptual capabilities of the agents in the game. The behaviours of the agents are evolved using a genetic program. These experiments show that the level of difficulty of the environment does have an impact on the evolvability of effective team behaviours; i.e. simpler environments are more conducive to the evolution of effective team behaviours than more difficult environments. In addition, the experiments show that no one best solution from any environment is optimal for all environments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Bakkes S, Spronck P, Postma EO (2004) Team: the team-oriented evolutionary adaptability mechanism. In: Rauterberg M (ed) Proceedings of the third international conference on entertainment computing (ICEC 2004). Lecture notes in computer science, vol 3166. Springer, pp 273–282

  • Buckland M (2005) Programming game AI by example. Wordware Publishing, Inc., Plano, TX

    Google Scholar 

  • Buckland M, Collins M (2002) AI techniques for game programming. Premier Press, Portland, OR

    Google Scholar 

  • Champandard AJ (2004) AI game development: synthetic creatures with learning and reactive behaviours. New Riders Publishing, Thousand Oaks, CA

    Google Scholar 

  • Cole N, Louis S, Miles C (2004) Using a genetic algorithm to tune first–person shooter bots. In: Congress on evolutionary computation 2004, vol 1, pp 139–145

  • Doherty D, O’Riordan C (2006) Evolving tactical behaviours for teams of agents in single player action games. In: CGAMES 2006 9th international conference on computer games: AI, animation, mobile, educational & serious games, pp 121–126

  • Doherty D, O’Riordan C (2007) A phenotypic analysis of gp-evolved team behaviours. In: GECCO ’07: Proceedings of the 9th annual conference on genetic and evolutionary computation. ACM Press, New York, NY, USA, pp 1951–1958

  • Ehlis T (2000) Application of genetic programming to the “snake game”. GamedevNet 1(175), http://www.gamedev.net/reference/articles/article1175.asp. Accessed 9th October 2003

  • Eskin E, Siegel E (1999) Genetic programming applied to othello: introducing students to machine learning research. In: SIGCSE ’99: The proceedings of the thirtieth SIGCSE technical symposium on computer science education. ACM Press, New York, NY, USA, pp 242–246

  • Fogel DB (1993) Using evolutionary programming to create neural networks that are capable of playing tic-tac-toe. In: Proceedings of the American power conference, IEEE, pp 875–879

  • Fogel DB (2002) Blondie24: playing at the edge of AI. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA

    Google Scholar 

  • Frayn C (2005) An evolutionary approach to strategies for the game of monopoly. In: Proceedings of the 2005 IEEE symposium on computational intelligence and games (CIG05)

  • GSC-GameWorld (2006) S.T.A.L.K.E.R.: Shadow of Chernobyl. http://www.stalker-game.com/en/

  • Hauptman A, Sipper M (2005) Gp-endchess: using genetic programming to evolve chess endgame players. In: Proceedings of the 8th European conference on genetic programming, pp 120–131

  • Haynes T, Sen S (1995) Evolving behavioral strategies in predators and prey. In: Sen S(eds) International joint conference on artificial intelligence-95 workshop on adaptation and learning in multiagent systems. Morgan Kaufmann, Montreal, Quebec, Canada, pp 32–37

    Google Scholar 

  • Haynes T, Sen S, Schoenefeld D, Wainwright R (1995) Evolving a team. In: Siegel EV, Koza JR(eds) Working notes for the AAAI symposium on genetic programming. AAAI, Cambridge, MA

    Google Scholar 

  • Haynes T, Wainwright R, Sen S (1995b) Evolving cooperation strategies. In: Lesser V (ed) Proceedings of the 1st international conference on multi-agent systems. MIT Press, San Francisco, CA, p 450, citeseer.ist.psu.edu/haynes94evolving.html

  • ID-Software (1994) Doom. http://www.idsoftware.com/

  • ID-Software (1996) Quake. http://www.idsoftware.com/

  • Jones T, Forrest S (1995) Fitness distance correlation as a measure of problem difficulty for genetic algorithms. In: Eshelman L (ed) Proceedings of the 6th international conference on genetic algorithms. Morgan Kaufmann, San Francisco, CA, pp 184–192

  • Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection. MIT Press, Cambridge, MA, USA

    MATH  Google Scholar 

  • LaLena M (1997) Teamwork in genetic programming. Master’s thesis, Rochester Institute of Technology, School of Computer Science and Technology

  • Lassabe N, Sanchez S, Luga H, Duthen Y (2006) Genetically programmed strategies for chess endgame. In: GECCO ’06: Proceedings of the 8th annual conference on genetic and evolutionary computation. ACM Press, New York, NY, USA, pp 831–838

  • Lionhead-Studios (2001) Black & White. http://www.lionhead.com/bw/

  • Luke S, Spector L (1996) Evolving teamwork and coordination with genetic programming. In: Koza JR, Goldberg DE, Fogel DB, Riolo RL (eds) Genetic programming, 1996: Proceedings of the 1st annual conference. MIT Press, Stanford University, CA, USA pp 150–156

  • Luke S, Hohn C, Farris J, Jackson G, Hendler J (1997) Co-evolving soccer softbot team coordination with genetic programming. In: International joint conference on artificial intelligence-97 first international workshop on RoboCup. Nagoya, Japan

  • Poli R, Vanneschi L (2007) Fitness-proportional negative slope coefficient as a hardness measure for genetic algorithms. In: GECCO ’07: Proceedings of the 9th annual conference on genetic and evolutionary computation. ACM Press, New York, NY, USA, pp 1335–1342

  • Ponsen M (2004) Improving adaptive game-AI with evolutionary learning. Master’s thesis, Delft University of Technology

  • Raik S, Durnota B (1994) The evolution of sporting strategies. In: Stonier RJ, Yu XH(eds) Complex systems: mechanisms of adaption. IOS Press, Amsterdam, The Netherlands, pp 85–92

    Google Scholar 

  • Reynolds CW (1993) An evolved, vision-based behavioral model of coordinated group motion. In: Proceedings of the 2nd international conference on from animals to animats 2: simulation of adaptive behavior. MIT Press, Cambridge, MA, USA, pp 384–392

  • Richards N, Moriarty D, McQuesten P, Miikkulainen R (1997) Evolving neural networks to play Go. In: Proceedings of the 7th international conference on genetic algorithms. East Lansing, MI

  • Richards MD, Whitley D, Beveridge JR, Mytkowicz T, Nguyen D, Rome D (2005) Evolving cooperative strategies for uav teams. In: GECCO ’05: Proceedings of the 7th annual conference on genetic and evolutionary computation. ACM Press, New York, NY, USA, pp 1721–1728

  • Rosin CD, Belew RK (1995) Methods for competitive co-evolution: finding opponents worth beating. In: Eshelman L(eds) Proceedings of the 6th international conference on genetic algorithms. Morgan Kaufmann, San Francisco, CA, pp 373–380

    Google Scholar 

  • Stanley KO, Bryant BD, Miikkulainen R (2005) Evolving neural network agents in the nero video game. In: Proceedings of the IEEE 2005 symposium on computational intelligence and games (CIG05)

  • Thurau C, Bauckhage C, Sagerer G (2004) Imitation learning at all levels of game–AI. In: Proceedings of the international conference on computer games, Artificial Intelligence, Design and Education, pp 402–408

  • Valve (2000) Counter strike. http://www.counter-strike.com

  • Vanneschi L, Clergue M, Collard P, Tomassini M, Verel S (2004) Fitness clouds and problem hardness in genetic programming. In: KD et al (ed) GECCO ’04: Proceedings of the 6th annual conference on genetic and evolutionary computation. Lecture notes in computer science, vol 3103. Springer-Verlag, Seattle, WA, USA, pp 690–701

  • Vanneschi L, Tomassini M, Collard P, Vérel S (2006) Negative slope coefficient: a measure to characterize genetic programming fitness landscapes. In: Collet P, Tomassini M, Ebner M, Gustafson S, Ekárt A (eds) Proceedings of the 9th European conference on genetic programming. Lecture notes in computer science, vol 3905. Springer, pp 178–189

  • Yannakakis GN, Hallam J (2004) Evolving opponents for interesting interactive computer games. In: Proceedings of the 8th international conference on simulation of adaptive behaviour (SAB04), pp 499–508

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Darren Doherty.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Doherty, D., O’Riordan, C. Evolving team behaviours in environments of varying difficulty. Artif Intell Rev 27, 223–244 (2007). https://doi.org/10.1007/s10462-008-9078-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-008-9078-1

Keywords

Navigation