Classification-based Deep Neural Network Architecture for Collaborative Filtering Recommender Systems.
DOI:
https://doi.org/10.9781/ijimai.2020.02.006Keywords:
Recommendation Systems, Classification, Neural Network, Collaborative Filtering, Deep Learning, Scalable Neural ArchitectureAbstract
This paper proposes a scalable and original classification-based deep neural architecture. Its collaborative filtering approach can be generalized to most of the existing recommender systems, since it just operates on the ratings dataset. The learning process is based on the binary relevant/non-relevant vote and the binary voted/non-voted item information. This data reduction provides a new level of abstraction and it makes possible to design the classification-based architecture. In addition to the original architecture, its prediction process has a novel approach: it does not need to make a large number of predictions to get recommendations. Instead to run forward the neural network for each prediction, our approach runs forward the neural network just once to get a set of probabilities in its categorical output layer. The proposed neural architecture has been tested by using the MovieLens and FilmTrust datasets. A state-of-the-art baseline that outperforms current competitive approaches has been used. Results show a competitive recommendation quality and an interesting quality improvement on large number of recommendations, consistent with the architecture design. The architecture originality makes it possible to address a broad range of future works.
Downloads
References
[1] J. Bobadilla, F. Ortega, A. Hernando, A. Gutiérrez, “Recommender systems survey,” Knowledge-Based Syst., vol. 46, pp. 109–132, 2013.
[2] Xin Dong, Lei Yu, ZhonghuoWu, Yuxia Sun, Lingfeng Yuan, and Fangxi Zhang, “A hybrid collaborative filtering model with deep structure for recommender systems”. In Proceedings of the AAAI.1309–1315,2017. Available: https://aaai.org/ocs/index.php/AAAI/AAAI17/paper/view/14676
[3] M.J. Pazzani, “A framework for collaborative, content-based and demographic filtering”, Artif. Intell. Rev. 13 (5-6) pp. 393–408, 1999.
[4] T. Ebesu and Y. Fang. “Neural citation network for context-aware citation recommendation”. In Proceedings of the SIGIR. ACM, Shinjuku, Tokyo, pp. 1093–1096. 2017.
[5] C. Musto, C. Greco, A. Suglia, and G. Semeraro, “Askme any rating: A content-based recommender system based on recurrent neural networks”, Proceedings of the IIR, 2016.
[6] X.Wang, X. He, L. Nie, and T.-S. Chua, “Item silk road: Recommending items from information domains to social users”, Proceedings of the SIGIR. ACM, pp. 185–194, 2017.
[7] C. Yang, L. Bai, C. Zhang, Q. Yuan, and J. Han, “Bridging collaborative filtering and semisupervised learning: A neural approach for POI recommendation”, Proceedings of the SIGKDD, pp. 1245–1254. Available: http://dl.acm.org/citation.cfm?id=3172077.3172336.
[8] B. Yi, X. Shen, Z. Zhang, J. Shu, and H. Liu, “Expanded autoencoder recommendation framework and its application in movie recommendation”. Proceedings of the SKIMA, pp. 298–303, 2016.
[9] W. Chu and Y. Tsai. “A hybrid recommendation system considering visual information for predicting favorite restaurants”. WWWJ (2017), pp. 1–19, 2017.
[10] R. He and J. McAuley. “Ups and downs: Modeling the visual evolution of fashion trends with oneclass collaborative filtering”, Proceedings of the WWW, pp. 507–517. 2016. Available: https://doi.org/10.1145/2736277.2741667.
[11] C. Hsieh, L. Yang, H. Wei, M. Naaman, and D. Estrin, “Immersive recommendation: News and event recommendations using personal digital traces”, Proceedings of the WWW, pp. 51–62. 2016. Available: https://doi.org/10.1145/2872427.2883006
[12] X. Deng, F. Huangfu, “Collaborative Variational Deep Learning for Healthcare Recommendation”, IEEE Access, Vol. 7, 2019.
[13] Z. Chen, L. Li, H. Peng, Y. Liu, H. Zhu, Y. Yang, “Sparse General NonNegative Matrix Factorization Based on Left Semi-Tensor Product”, IEEE Access, Vol. 7, pp. 81599 – 81611, 2019.
[14] K. Li, X. Zhou, F. Lin, W. Zeng, G. Alterovitz, “Deep Probabilistic Matrix Factorization Framework for Online Collaborative Filtering”, IEEE Access, Volume: 7, 2019.
[15] A. Hernando, F. Bobadilla, F. Ortega, “A non negative matrix factorization for collaborative filtering recommender systems based on a Bayesian probabilistic model”, Knowledge-Based Syst. 197C (2016) pp. 188–202.
[16] S. Rendle, C. Freudenthaler, Z. Gantner, and L. Schmidt-Thieme. “Bpr: Bayesian personalized ranking from implicit feedback”. In UAI, pp. 452- 461, 2009.
[17] X. He, H. Zhang, M.-Y. Kan, and T.-S. Chua. “Fast matrix factorization for online recommendation with implicit feedback”. SIGIR, pp. 549-558, 2016.
[18] S. Zhang, L. Yao, A. Sun, and Y. Tay. “Deep Learning based Recommender System: A Survey and New Perspectives”. ACM Comput. Surv.1, 1, Article 1. July 2018, pp. 35.
[19] R. Mu, “A Survey of Recommender Systems Based on Deep Learning”, IEEE Access, Year: 2018 | Volume: 6, pp. 69009–69022, DOI: 10.1109/ACCESS.2018.2880197
[20] X. Wang, L. Yu, K. Ren, G. Tao, W. Zhang, Y. Yu, and J. Wang, “Dynamic attention deep model for article recommendation by learning human editors’ demonstration”, Proceedings of the SIGKDD, 2017, Available:
[21] http://doi.acm.org/10.1145/3097983.3098096
[22] D. Liang, M. Zhan, and D. P.W. Ellis, “Content-aware collaborative music recommendation using pre-trained neural networks”, Proceedings of the ISMIR, 2015, pp. 295–301.
[23] X. Wang and Y. Wang, “Improving content-based and hybrid music recommendation using deep learning”. Proceedings of the MM, 2014, pp. 627–636. Available: http://doi.acm.org/10.1145/2647868.2654940
[24] J. Chen, H. Zhang, X. He, L. Nie, W. Liu, and T.-S. Chua. “Attentive collaborative filtering: Multimedia recommendation with item- and component-level attention”. Proceedings of the SIGIR. 2017. ACM. Available: http://doi.acm.org/10.1145/3077136.3080797
[25] X. Chen, Y. Zhang, Q. Ai, H. Xu, J. Yan, and Z. Qin. “Personalized key frame recommendation”, Proceedings of the SIGIR, 2017, pp. 315–324. Available: http://doi.acm.org/10.1145/3077136.3080776
[26] B. Hidasi, M. Quadrana, A. Karatzoglou, and D. Tikk, “Parallel recurrent neural network architectures for feature-rich session-based recommendations”, Proceedings of the Recsys, 2016, pp. 241–248. Available: http://doi.acm.org/10.1145/2959100.2959167
[27] D. Jannach and M. Ludewig, “When recurrent neural networks meet the neighborhood for sesión based recommendation”, Proceedings of the Recsys (RecSys’17), 2017, ACM, Como, pp. 306–310.
[28] I. Tang and K. Wang, “Personalized top-n sequential recommendation via convolutional sequence embedding”, Proceedings of the WSDM, 2018, pp. 565–573. Available: http://doi.acm.org/10.1145/3159652.3159656
[29] T. Xuan Tuan and T. Minh Phuong, “3D convolutional networks for session-based recommendation with content features”, Proceedings of the Recsys, 2017, pp. 138–146.
[30] A. Suglia, C. Greco, C. Musto, M. de Gemmis, P. Lops, and G. Semeraro, “A deep architecture for content-based recommendations exploiting recurrent neural networks”, Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization, 2017, ACM, Bratislava, pp. 202–211.
[31] Y. Kiam Tan, X. Xu, and Y. Liu. “Improved recurrent neural networks for session-based recommendations”, Proceedings of the Recsys, 2016, pp. 17–22. Available: http://doi.acm.org/10.1145/2988450.2988452
[32] T. Alashkar, S. Jiang, S. Wang, and Y. Fu, “Examples-rules guided deep neural network for makeup recommendation”, Proceedings of the AAAI, pp. 941–947. Available: https://aaai.org/ocs/index.php/AAAI/AAAI17/paper/view/14773
[33] S. Zhang, L. Yao, and X. Xu, “AutoSVD++: An efficient hybrid collaborative filtering model via contractive auto-encoders”, ACM, 2017, pp. 957–960.
[34] X. He, L. Liao, H. Zhang, L. Nie, X. Hu, and T.-Seng Chua, “Neural collaborative filtering”, Proceedings of the WWW. 2017, pp.173–182. Available: https://doi.org/10.1145/3038912.3052569
[35] H. Guo, R. Tang, Y. Ye, Z. Li, and X. He, “DeepFM: A factorizationmachine based neural network for CTR prediction”, Proceedings of the IJCAI, 2017, pp. 2782–2788. Available: http://dl.acm.org/citation.cfm?id=3172077.3172127
[36] G. K. Dziugaite and D. M. Roy. 2015. “Neural network matrix factorization”. arXiv preprint arXiv:1511.06443 (2015).
[37] H.-T. Cheng, L. Koc, J. Harmsen, T. Shaked, T. Chandra, H. Aradhye, G. Anderson, G. Corrado, W. Chai, M. Ispir et al., “Wide & deep learning for recommender systems”. Proceedings of the Recsys, 2016, pp. 7–10. Available: http://doi.acm.org/10.1145/2988450.2988454
[38] W. Yuan, H. Wang, B. Hu, L. Wang, Q. Wang, “Wide and Deep Model of Multi-Source Information-Aware Recommender System”, IEEE Access, Year: 2018 | Volume: 6, pp. 49385-49398.
[39] S. Rendle, “Factorization machines”, 2010 IEEE International Conference on Data Mining, December pp. 13-17, 2010, Sydney, Australia.
[40] J. Bobadilla, F. Serradilla, J. Bernal, “A new collaborative filtering metric that improves the behavior of recommender systems”, Knowledge-Based Systems 23 (2010), pp. 520–528.
[41] B. Sarwar, G. Karypis, J. Konstan, J. Riedl, “Item-based collaborative _ltering recommendation algorithms”, WWW10, May 1-5, 2001, Hong Kong. ACM 1-58113-348-0/01/0005, pp. 285-295.
[42] H. Wang, N. Wang, D.-Y. Yeung, “Collaborative deep learning for recommender systems”, Proceedings of the SIGKDD, 2015, pp.1235- 1244.
[43] F. Zhang, N. Jing Yuan, D. Lian, X. Xie, W.-Y. Ma, “Collaborative knowledge base embedding for recommender systems”. Proceedings of the SIGKDD, 2015, pp. 353–362. Available: http://doi.acm.org/10.1145/2939672.2939673
[44] H. Lee, Y. Ahn, H. Lee, S. Ha, S. Lee, “Quote recommendation in dialogue using deep neural network”, Proceedings of the SIGIR, 2016, pp. 957– 960. Available: http://dx.doi.org/10.1145/2911451.2914734
[45] J. Golbeck, J. Hendler, “FilmTrust: movie recommendations using trust in web-based social networks”, CCNC 2006, 3rd IEEE Consumer Communications and Networking Conference, 2006, DOI: 10.1109/CCNC.2006.1593032
[46] F. M. Harper and J. A. Konstan. 2015. “The MovieLens Datasets: History and Context”. ACM Transactions on Interactive Intelligent Systems (TiiS) 5, 4, Article 19 (December 2015), pp. 19. Available: http://dx.doi.org/10.1145/2827872
Downloads
Published
-
Abstract356
-
PDF86
Submit Article
Information
