A Fine-Grained Model to Assess Learner-Content and Methodology Satisfaction in Distance Education.

Magdalena Cantabella; Raquel Martínez España; Belén López; Andrés Muñoz

doi:10.9781/ijimai.2020.09.002

Authors

Magdalena Cantabella Universidad Católica de Murcia
Raquel Martínez España Universidad Católica de Murcia
Belén López Universidad Católica de Murcia
Andrés Muñoz Universidad Católica de Murcia

DOI:

https://doi.org/10.9781/ijimai.2020.09.002

Keywords:

e-learning, Learning Management Systems, Learning Analytics, Students’ Success, User Monitoring

Supporting Agencies

This work is supported by the Spanish innovation project funded by the UCAM under grant PID-05/19. Authors would like to thank the Online Vice-Rectorate of this University for their participation in this paper.

Abstract

Learning Management System (LMS) platforms have led to a transformation in Universities in the last decade, helping them to adapt and expand their services to new technological challenges. These platforms have made possible the expansion of distance education. A current trend in this area is focused on the evaluation and improvement of the students’ satisfaction. In this work a new tool to assess student satisfaction using emoticons (smileys) is proposed to evaluate the quality of the learning content and the methodology at unit level for any course and at any time. The results indicate that the assessment of student satisfaction is sensitive to the period when the survey is performed and to the student’s study level. Moreover, the results of this new proposal are compared to the satisfaction results using traditional surveys, showing different results due to a more accuracy and flexibility when using the tool proposed in this work.

Downloads

Download data is not yet available.

References

[1] A. Corbi, and D. Burgos, “Review of current student-monitoring techniques used in e-learning focused recommender systems and learning analytics. the experience api & lime model case study”, International Journal of Interactive Multimedia and Artificial Intelligence, vol. 2, no. 7, pp.44-52, 2014.

[2] S. K. Parahoo, M. I. Santally, Y. Rajabalee, and H. L. Harvey, “Designing a predictive model of student satisfaction in online learning”. Journal of Marketing for Higher Education, vol. 26, no. 1, pp. 1-19, 2016.

[3] S. N. Uribe and M. Vaughan, “Facilitating student learning in distance education: a case study on the development and implementation of a multifaceted feedback system”, Distance Education, vol. 38, no. 3, pp. 288- 301, 2017.

[4] M. A. O’Neill and A. Palmer, “Importance-performance analysis: a useful tool for directing continuous quality improvement in higher education”, Quality Assurance in Education, vol. 12, no. 1, pp. 39-52, 2004.

[5] V. Teeroovengadum, T. Kamalanabhan and A. K. Seebaluck, “Measuring service quality in higher education: Development of a hierarchical model (HESQUAL)”, Quality Assurance in Education, vol. 24, no. 2, pp. 244-258, 2016.

[6] R. Ferguson, “Learning analytics: drivers, developments and challenges”, International Journal of Technology Enhanced Learning, vol. 4 no. 5/6, pp. 304–317, 2012. Retrieved from http://oro.open.ac.uk/36374/

[7] V. A. Secades, and O. Arranz, “Big Data & eLearning: A Binomial to the Future of the Knowledge Society”, International Journal of Interactive Multimedia and Artificial Intelligence, vol. 3, no. 6, pp. 29-33, 2016.

[8] M. Cantabella, B. López, A. Caballero and A. Muñoz, “Analysis and evaluation of lecturers activity in Learning Management Systems: Subjective and objective perceptions”, Interactive Learning Environments, vol. 26, no. 7, pp. 911-923, 2018.

[9] M. Cantabella, R. Martínez-España, B. Ayuso, J. A. Yáñez, and A. Muñoz, “Analysis of student behavior in learning management systems through a Big Data framework”, Future Generation Computer Systems, vol. 90, pp. 262 – 272, 2019

[10] A. Espasa, and J. Meneses, “Analysing Feedback Processes in an Online Teaching and Learning Environment: An Exploratory Study”, Higher Education, vol. 59, no. 3, pp. 277–292, 2010.

[11] B. E. Shelton, J-L. Hung and P. R. Lowenthal, “Predicting student success by modeling student interaction in asynchronous online courses”, Distance Education, vol. 38, no. 1, pp. 59-69, 2017.

[12] W. S. Cheung, “A new role for teachers: software evaluator. In Proceedings of the IFIP TC3/WG3.” in Proceedings of 5th International Working Conference on Exploring a New Partnership: Children, Teachers and Technology, 1994, pp. 191–199.

[13] D. Hawkridge, “Software for schools: British reviews in the late 1980s”, Computers and learning, pp. 88–108, 1990.

[14] T. Plomp and D. P. Ely, “International encyclopedia of educational technology”, ERIC, 1996

[15] V. F. Sharp, “Computer education for teachers: Integrating technology into classroom teaching”, Wiley, 2008.

[16] W. Nakamura, L. Marques, L. Rivero, E. Oliveira and T. Conte, “Are generic UX evaluation techniques enough? A study on the UX Evaluation of the Edmodo Learning Management System”, In Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE), vol. 28, no. 1, p. 1007, 2017.

[17] G. Ssekakubo, H. Suleman and G, Marsden, “Designing mobile LMS interfaces: Learners’ expectations and experiences”, Interactive Technology and Smart Education, vol. 10, no. 2, pp. 147-167, 2013.

[18] C. Fallon and S. Brown, S., “E-learning standards: a guide to purchasing, developing, and deploying standards-conformant e-learning”. CRC Press, 2016.

[19] S. P. McKenna, “The Design Activity Framework: Investigating the Data Visualization Design Process” Doctoral dissertation, The University of Utah, 2017.

[20] H. Al-Samarraie, B. K. Teng, A. I. Alzahrani and N. Alalwan, “E-learning continuance satisfaction in higher education: a unified perspective from instructors and students”, Studies in Higher Education, vol. 43, no. 11, pp. 2003–2019, 2018.

[21] T. Markova, I. Glazkova and E. Zaborova, “Quality issues of online distance learning”, Procedia-Social and Behavioral Sciences, vol. 237, pp. 685-691, 2017.

[22] Q. T. Pham and T. P. Tran, “Impact factors on using of e-learning system and learning achievement of students at several universities in vietnam”, In O. Gervasi et al. (Eds.), International Conference on Computational Science and Its Applications – ICCSA 2018, pp. 394–409, Springer International Publishing, 2018.

[23] I. S. Weerasinghe and R. L. Fernando, “Students’ satisfaction in higher education”, American Journal of Educational Research, vol. 5, no. 5, pp. 533-539, 2017.

[24] E. Martínez-Caro, J. G. Cegarra-Navarro and G. Cepeda-Carrión, “An application of the performance-evaluation model for e-learning quality in higher education”, Total Quality Management & Business Excellence, vol. 26, no. 5-6, pp. 632–647, 2015.

[25] W. Sahusilawane and L. S. Hiariey, “The Role of Service Quality Toward Open University Website on The Level of Student Satisfaction”, Journal of Education and Learning, vol. 10, no. 2, pp. 85-92, 2016.

[26] I. Almarashdeh, I., “Sharing instructors experience of learning management system: A technology perspective of user satisfaction in distance learning course”, Computers in Human Behavior, vol. 63, pp. 249- 255, 2016.

[27] N. C. Gee, “The Impact Of Lecturers’ Compeencies On Students’ Satisfaction”, Journal Of Arts and Social Science, vol 1, no. 2, pp. 74-86, 2018.

[28] M. Kangas, P. Siklander, J. Randolph and H. Roukema, “Teachers’ engagement and students’ satisfaction with a playful learning environment”, Teaching and Teacher Education, vol. 63, pp. 274-284, 2017.

[29] R. Yilmaz, “Exploring the role of e-learning readiness on student satisfaction and motivation in flipped classroom”, Computers in Human Behavior, vol. 70, pp. 251–260, 2017.

[30] X. Zhai, J. Gu, H. Liu, J. C. Liang and T. Chin-Chung, “An experiential learning perspective on students’ satisfaction model in a flipped classroom context”, Journal of Educational Technology & Society, vol. 20, no. 1, 198-210, 2017.

[31] R. Prifti, “Self–efficacy and student satisfaction in the context of blended learning courses”, Open Learning: The Journal of Open, Distance and e-Learning, pp. 1-15, 2020.

[32] M. Asoodar, S. Vaezi and B. Izanloo, “Framework to improve e-learner satisfaction and further strengthen e-learning implementation”, Computers in Human Behavior, vol. 63, pp. 704-716, 2016.

[33] A. Uzelac, N. Gligorić and S. Krčo, S., “System for recognizing lecture quality based on analysis of physical parameters”, Telematics and Informatics, vol. 35, no. 3, pp. 579-594, 2018.

[34] M. Cantabella, B. López-Ayuso, A. Muñoz and A. Caballero, A., “Una herramienta para el seguimiento del profesorado universitario en entornos virtuales de aprendizaje”, Revista Española De Documentación Científica, vol. 39, no. 4, pp. 153, 2016.

[35] M. García and B. Harmsen, B., Qlikview 11 for developers. Packt Publishing Ltd, 2012.

[36] D. A. Norman, “The way I see it. Memory is more important than actuality”, Interactions, vol. 16, no. 2, pp. 24-26, 2009.