Real-Time Prediction of Gamers Behavior Using Variable Order Markov and Big Data Technology: A Case of Study

Authors

DOI:

https://doi.org/10.9781/ijimai.2016.367

Keywords:

Behaviour Control and Monitoring, User Experience, Big Data, Hidden Markov Models, Real-Time Prediction
Supporting Agencies
This work is part of Memento Data Analysis project, co-funded by the Spanish Ministry of Industry, Energy and Tourism with identifier TSI-020601-2012-99 and is supported by the Spanish Ministry of Education, Culture and Sport through FPU fellowship with identifier FPU13/03917.

Abstract

This paper presents the results and conclusions found when predicting the behavior of gamers in commercial videogames datasets. In particular, it uses Variable-Order Markov (VOM) to build a probabilistic model that is able to use the historic behavior of gamers and to infer what will be their next actions. Being able to predict with accuracy the next user’s actions can be of special interest to learn from the behavior of gamers, to make them more engaged and to reduce churn rate. In order to support a big volume and velocity of data, the system is built on top of the Hadoop ecosystem, using HBase for real-time processing; and the prediction tool is provided as a service (SaaS) and accessible through a RESTful API. The prediction system is evaluated using a case of study with two commercial videogames, attaining promising results with high prediction accuracies.

Downloads

Download data is not yet available.

References

[1] Alam, M. R., Reaz, M. B. I., & Mohd Ali, M. a. (2012). SPEED: An inhabitant activity prediction algorithm for smart homes. IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans, 42(4), 985–990.

[2] Antwarg, L., Rokach, L., & Shapira, B. (2012). Attribute-driven hidden markov model trees for intention prediction. IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews, 42(6), 1103–1119.

[3] Awad, M., & Khalil, I. (2012). Prediction of User’s web - browsing behavior : Application of Markov Models. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 42(4), 1131–1142.

[4] Baldominos, A., Albacete, E., Saez, Y., & Isasi, P. (2014). A scalable machine learning online service for big data real-time analysis. 2014 IEEE Symposium on Computational Intelligence in Big Data (CIBD) (pp. 1–8).

[5] Bindu Madhuri, C., Anand Chandulal, J., Ramya, K., & Phanidra, M. (2011). Analysis of Users’ Web Navigation Behavior using GRPA with Variable Length Markov Chains. International Journal of Data Mining & Knowledge Management Process, 1(2), 1–20.

[6] Bolivar, H., Martinez, M., Gonzalez, R., & Sanjuan, O. (2012). A multiagent matchmaker based on hidden Markov model for decentralized grid scheduling. Proceedings of the 2012 4th International Conference on Intelligent Networking and Collaborative Systems (INCoS) (pp. 62–69).

[7] Bolivar, H., Martinez, M., Gonzalez, R., & Sanjuan, O. (2014). Complexity analysis of a matchmaker based on hidden Markov model for decentralized grid scheduling. International Journal of Grid and Utility Computing, 5(3), 190–197.

[8] Chierichetti, F., Kumar, R., Raghavan, P., & Sarlos, T. (2012). Are web users really Markovian? Proceedings of the 21st international conference on World Wide Web - WWW ’12, WWW ’12 (p. 609). ACM.

[9] Dereszynski, E., Hostetler, J., Fern, A., Dietterich, T., Hoang, T.-T., & Udarbe, M. (2011). Learning Probabilistic Behavior Models in Real-Time Strategy Games. Proceedings of the Seventh AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE-11) (pp. 20–25).

[10] Deshpande, M., & Karypis, G. (2004). Selective Markov Models for Predicting Web Page Access. ACM Transactions on Internet Technology, 4(2), 163–184.

[11] Harrison, B., & Roberts, D. L. (2011). Using sequential observations to model and predict player behavior. Proceedings of the 6th International Conference on Foundations of Digital Games (FDG) (pp. 91–98).

[12] Hogg, T., Lerman, K., & Smith, L. (2013). Stochastic Models Predict User Behavior in Social Media. arXiv preprint arXiv:1308.2705. Retrieved from http://arxiv.org/abs/1308.2705

[13] Jin, L., Chen, Y., Wang, T., Hui, P., & Vasilakos, a V. (2013). Understanding user behavior in online social networks: a survey. IEEE Communications Magazine, 51(9), 144–150.

[14] Kang, W., Shine, D., & Shin, D. (2010). Prediction of state of user’s behavior using Hidden Markov Model in ubiquitous home network. Industrial Engineering and Engineering Management (IEEM), 2010 IEEE International Conference on (pp. 1752–1756).

[15] Katsaros, D., & Manolopoulos, Y. (2009). Prediction in wireless networks by Markov chains. IEEE Wireless Communications, 16(2), 56–63.

[16] Kim, Y., & Cho, S.-B. (2009). A recommendation agent for mobile phone users using Bayesian behavior prediction. 3rd International Conference on Mobile Ubiquitous Computing, Systems, Services, and Technologies, UBICOMM 2009 (pp. 283–288).

[17] Lerman, K., & Hogg, T. (2012). Using Stochastic Models to Describe and Predict Social Dynamics of Web Users. ACM Trans. Intell. Syst. Technol., 3(4), 1–33.

[18] Marques, A., & Belo, O. (2010). Discovering student web usage profiles using Markov chains. 9th European Conference on eLearning 2010, ECEL 2010, 9(1), 335–342.

[19] Rao, V. V. R. M., & Kumari, V. V. (2011). An Efficient Hybrid Successive Markov Model for Predicting Web User Usage Behavior using Web Usage Mining. International Journal of Data Engineering, 1(5), 43–62.

[20] Rendle, S., Freudenthaler, C., & Schmidt-Thieme, L. (2010). Factorizing personalized Markov chains for next-basket recommendation. Proceedings of the 19th international conference on World Wide Web (WWW) (p. 811).

[21] Shim, K. J., Sharan, R., & Srivastava, J. (2010). Player Performance Prediction in Massively Multiplayer Online Role-Playing Games (MMORPGs). Advances in Knowledge Discovery and Data Mining (pp. 71–81).

[22] Song-Zhu, D., Jon-Kuo, M., & Hao-Liou, S. (2014). The Study of Continuance Intention for Online Social Games. Proceedings of the 3rd International Conference on Advanced Applied Informatics (pp. 230–235).

[23] Vishwakarma, S., Lade, S., Kumar-Suman, M., & Patel, D. (2013). Web User Prediction by Integrating Markov Model with Different Features. International Journal of Engineering Research and Science & Technology, 2(4), 74–83.

[24] Wang, P., & Deng, Q. (2014). User Behavior Prediction: A Combined Model of Topic Level Influence and Contagion Interaction. Proceedings of the 2014 20th IEEE International Conference on Parallel and Distributed Systems (pp. 851–852).

[25] Wu, T., He, H., Gu, X., Peng, Y., Zhang, Y., Zhou, Y., & Xu, S. (2013). An intelligent network user behavior analysis system based on collaborative Markov model and distributed data processing. Proceedings of the 2013 IEEE 17th International Conference on Computer Supported Cooperative Work in Design (CSCWD) (pp. 221–228).

[26] Xue, G., Li, Z., Zhu, H., & Liu, Y. (2009). Traffic-known urban vehicular route prediction based on partial mobility patterns. Proceedings of the International Conference on Parallel and Distributed Systems (ICPADS) (pp. 369–375).

[27] Yuan, H., Xu, W., & Wang, M. (2014). Can online user behavior improve the performance of sales prediction in E-commerce? 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 2347–2352).

[28] Zukerman, I., Albrecht, D. W., & Nicholson, A. E. (1999). Predicting Users’ Requests on the WWW. Proceedings of the 7th International Conference on User Modeling (pp. 275–284).

Downloads

Published

2016-03-01
Metrics
Views/Downloads
  • Abstract
    46
  • PDF
    27

How to Cite

Saez, Y., Gómez, A. B., Albacete, E., and Marrero, I. (2016). Real-Time Prediction of Gamers Behavior Using Variable Order Markov and Big Data Technology: A Case of Study. International Journal of Interactive Multimedia and Artificial Intelligence, 3(6), 44–51. https://doi.org/10.9781/ijimai.2016.367

Most read articles by the same author(s)