Methods and approaches analysis of artificial intelligence designing for real time strategy game

Authors

DOI:

https://doi.org/10.20535/2411-1031.2021.9.2.249882

Keywords:

artificial intelligence, real-time strategies, video games, neural networks, tactical decision-making, strategic decision

Abstract

The research provides a detailed analysis of approaches to creating AI in video games. The main area of research is AI for real-time strategies, as this genre is characterized by the complexity of the game environment and the practice of creating a comprehensive AI, consisting of several agents responsible for a particular aspect of the game. The analysis shows that the main areas of use of AI methods in strategies are strategic and tactical decisions, as well as analysis of the current situation and forecasting the enemy and his chosen strategy. Among the analyzed approaches to tactical AI, reinforcement, game tree search, Bayesian model, precedent-based solutions and neural networks are most often used. Popular approaches to building strategic AI are precedent-based decision-making, hierarchical planning, and autonomous achievement of goals. When creating a module for research and determination of plans, the most popular methods are deductive, abduction, probabilistic and precedent. In addition to the considered methods, others are used in the development, but they are not as popular as above, due to problems with speed or specific implementation, which does not allow to adapt them to the standard rules of genre games. Comparison of algorithms and implementations of AI in the framework of commercial and scientific developments. Among the main differences are the high cost of commercial development of complex agents, as well as the specifics of the scientific approach, which aims to create the most effective agent in terms of game quality, rather than maximizing positive impressions of players, which is the basis of commercial development. The reasons for insufficiently active development of scientific research in the field of AI for games in general and the genre of real-time strategies in particular are described.

Author Biographies

Yaroslav Dorohyi, National technical university of Ukraine “Igor Sikorsky Kyiv polytechnic institute”, Kyiv

doctor of technical sciences, associate professor, associate professor at the automation and control in technical systems academic department

Oleksandr Svyrydenko, National technical university of Ukraine “Igor Sikorsky Kyiv polytechnic institute”, Kyiv

master’s student

References

R. Morris, “Workshop Summary Kasparov vs. Big Blue: The Significance for AI”, ICGA Journal, vol. 20, no. 3, pp. 204-206, 1997, doi: https://doi.org/10.3233/ICG-1997-20315.

M. Buro, “Call for AI research in RTS games”, in Proc. of the AAAI Workshop on AI in Games, 2004, pp. 139-141.

A. Shantia, E. Begue and M. Wiering, “Connectionist reinforcement learning for intelligent unit micro management in StarCraft”, in Proc. of International Joint Conference on Neural Networks, 2011, pp. 1794-1801, doi: https://doi.org/10.1109/IJCNN.2011.6033442.

L. Amado, “Reinforcement learning applied to RTS games”, in Proc. of the 2017 Workshop on Adaptive Learning Agents, 2017, pp. 1-8.

N. Remi, J. Krebbers, M. Drugan, and M. Wiering, “Hierarchical Reinforcement Learning for Real-Time Strategy Games”, in Proc. of International Conference on Agents and AI, 2018, pp. 470-477, doi: https://doi.org/10.5220/0006593804700477.

A. Aamodt, “Case-based reasoning for improved micromanagement in Real-time strategy games”, in Proc. of the Workshop on Case-Based Reasoning for Computer Games, 2009, pp. 1-11.

M. Molineaux, D. W. Aha, and P. Moore, “Learning Continuous Action Models in a Real-Time Strategy Environment”, in Proc. of the Twenty-First International Florida AI Research Society Conference, Palo Alto, 2008, pp. 257-262.

F. Sailer, M. Buro, and M. Lanctot, “Adversarial Planning Through Strategy Simulation”, in Proc. of the IEEE Conference on Computational Intelligence and Games, Piscataway, 2007, pp. 80-87, doi: https://doi.org/10.1109/CIG.2007.368082.

D. Churchill, A. Saffidine, and M. Buro, “Fast Heuristic Search for RTS Game Combat Scenarios”, in Proc. of the Eighth AAAI Conference on AI and Interactive Digital Entertainment, Palo Alto, 2012, pp. 112-117, doi: https://doi.org/10.5555/3014629.3014650.

G. Synnaeve, and P. Bessière, “A Bayesian Model for RTS Units Control Applied to StarCraft”, in Proc. of the IEEE Conference on Computational Intelligence and Games, Piscataway, 2011, pp. 190-196, doi: https://doi.org/10.1109/CIG.2011.6032006.

I. Gabriel, V. Negru, and D. Zaharie, “Neuroevolution Based MultiAgent System for Micromanagement in Real-Time Strategy Games”, іn Proc. of the Fifth Balkan Conference in Informatics, New York, 2012, pp. 32-39, doi: https://doi.org/10.1145/2371316.2371324.

M. Stanescu, N. A. Barriga, A. Hess, and M. Buro, “Evaluating real-time strategy game states using convolutional neural networks”, in Proc. of IEEE Conference on Computational Intelligence and Games, Santorini, 2016, pp. 1-7, doi: https://doi.org/10.1109/CIG.2016.7860439.

J. Huang, and W. Yang, “A multi-size convolution neural network for RTS games winner prediction”, in Proc. of MATEC Web of Conferences, vol. 232, 2018, pp. 1-5, doi: https://doi.org/10.1051/matecconf/201823201054.

D. Aha, M. Molineaux, and M. Ponsen, “Learning to Win: Case-Based Plan Selection in a Real-Time Strategy Game”, in Proc. of ICCBR 2005: Case-Based Reasoning Research and Development, 2005, pp. 5-20, doi: https://doi.org/10.1007/11536406_4.

P. Cadena, and L. Garrido, “Fuzzy Case-Based Reasoning for Managing Strategic and Tactical Reasoning in StarCraft”, in Proc. of MICAI 2011: Advances in AI, Mexico, 2011, pp. 113-124, doi: https://doi.org/10.1007/978-3-642-25324-9_10.

H. Muñoz-Avila, and D. Aha, “On the Role of Explanation for Hierarchical Case-Based Planning in Real-Time Strategy Games”, in Proc. of 7th European Conference Advances in Case-Based Reasoning, Lecture Notes in Computer Science, Berlin, 2004, pp. 1-10.

J. Laagland, “A HTN Planner for a Real-Time Strategy Game”, 2008, pp. 1-10. [Online]. Available: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.406.8722&rep=rep1&type=pdf. Accessed on: June 12, 2021.

B. Weber, and S. Ontañón, “Using Automated Replay Annotation for Case-Based Planning in Games”, in Proc. of 8th International Conference on Case-Based Reasoning, Seattle, 2010, pp. 1-10.

M. Molineaux, M. Klenk, and D. Aha, “Goal-Driven Autonomy in a Navy Strategy Simulation”, in Proc. of the Twenty-Fourth AAAI Conference on AI, Palo Alto, 2010, pp. 1548-1554.

B. Weber, M. Mateas, and A. Jhala, “Applying Goal-Driven Autonomy to StarCraft”, in Proc. of the Sixth AAAI Conference on AI and Interactive Digital Entertainment, Palo Alto, 2010, pp. 101-106, doi: https://doi.org/10.5555/3014666.3014685.

F. Kabanza, P. Bellefeuille, F. Bisson, A. Benaskeur, and H. Irandoust, “Opponent Behaviour Recognition for Real-Time Strategy Games”, in Proc. of Plan, Activity, and Intent Recognition: Papers from the AAAI Workshop. Technical Report WS-10-15, Palo Alto, 2010, pp. 29-36.

B. Weber, and M. Mateas, “A Data Mining Approach to Strategy Prediction”, in Proc. of the 2009 IEEE Symposium on Computational Intelligence and Games, Piscataway, 2009, pp. 140-147, doi: https://doi.org/10.1109/CIG.2009.5286483.

E. Dereszynski, J. Hostetler, A. Fern, T. Dietterich, T. Hoang, and M. Udarbe, “Learning Probabilistic Behavior Models in Real-Time Strategy Games”, in Proc. of the Seventh AAAI Conference on AI and Interactive Digital Entertainment, Palo Alto, 2011, pp. 20-25.

E. Dereszynski, J. Hostetler, A. Fern, T. Dietterich, and T. Hoang, “Inferring Strategies from Limited Reconnaissance in Real-Time Strategy Games”, in Paper presented at the Conference on Unceertainty in AI, Avalon, 2012, pp. 367-376.

J. Zhu, J. Villareale, N. Javvaji, S. Risi, M. Löwe, R. Weigelt, and C. Harteveld, “Player-AI Interaction: What Neural Network Games Reveal About AI as Play”, in Proc. of CHI Conference on Human Factors in Computing Systems, Yokohama, 2021, pp. 1-17, doi: https://doi.org/10.1145/3411764.3445307.

Downloads

Published

2021-12-30

How to Cite

Dorohyi, Y., & Svyrydenko, O. (2021). Methods and approaches analysis of artificial intelligence designing for real time strategy game. Collection "Information Technology and Security", 9(2), 128–136. https://doi.org/10.20535/2411-1031.2021.9.2.249882

Issue

Vol. 9 No. 2 (2021)

Section

INFORMATION TECHNOLOGY

License

Copyright (c) 2021 Information Technology and Security

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

The authors that are published in this collection, agree to the following terms:

  1. The authors reserve the right to authorship of their work and pass the collection right of first publication this work is licensed under the Creative Commons Attribution License, which allows others to freely distribute the published work with the obligatory reference to the authors of the original work and the first publication of the work in this collection.
     
  2. The authors have the right to conclude an agreement on exclusive distribution of the work in the form in which it was published this anthology (for example, to place the work in a digital repository institution or to publish in the structure of the monograph), provided that references to the first publication of the work in this collection.
     
  3. Policy of the journal allows and encourages the placement of authors on the Internet (for example, in storage facilities or on personal web sites) the manuscript of the work, prior to the submission of the manuscript to the editor, and during its editorial processing, as it contributes to productive scientific discussion and positive effect on the efficiency and dynamics of citations of published work (see The Effect of Open Access).