Design and Validation of a Framework for the Creation of User Experience Questionnaires
DOI:
https://doi.org/10.9781/ijimai.2019.06.006Keywords:
User Experience, Evaluation, QuestionnaireAbstract
Existing user experience questionnaires have a fixed number of scales. Each of these scales measures a distinct aspect of user experience. These questionnaires can be used with little effort and provide a number of useful support materials that make the application of such a questionnaire quite easy. However, in practical evaluation scenarios it can happen that none of the existing questionnaires contains all scales necessary to answer the research question. It is of course possible to combine several UX questionnaires in such cases, but due to the variations of item formats this is also not an optimal solution. In this paper, we describe the development and first validation studies of a modular framework that allows the creation of user experience questionnaires that fit perfectly to a given research question. The framework contains several scales that measure different UX aspects. These scales can be combined to cover the relevant research questions.Downloads
References
Dumas, J. S. and Redish, J. (1999). A Practical Guide to Usability Testing. Intellect Books.
Nielsen, J. and Molich, R. (1990). “Heuristic evaluation of user interfaces.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 249–256. ACM.
Nielsen, J. (1994). “Enhancing the explanatory power of usability heuristics.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 152–158. ACM.
Bader, F., Schön, E.-M., and Thomaschewski, J. (2017). “Heuristics Considering UX and Quality Criteria for Heuristics.” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 4, no. 6, pp. 48–53. https://doi.org/10.9781/ijimai.2017.05.001
Wharton, C., Rieman, J., Lewis, C., and Polson, P. (1994). “The cognitive walkthrough method: A practitioner’s guide.” In J. Nielsen and R. L. Mack (eds.), Usability Inspection Methods, pp. 105–140. John Wiley & Sons, New York, NY.
Lewis, C. and Wharton, C. (1997). “Cognitive walkthroughs.” In Handbook of Human-Computer Interaction, pp. 717–732. North-Holland.
Schrepp, M. (2018). User Experience mit Fragebögen messen (Measure user experience with questionnaires). Amazon Kindle Direct Publishing. ISBN: 9781986843768.
Hassenzahl, M. (2001). “The effect of perceived hedonic quality on product appealingness.” International Journal of Human-Computer Interaction, 13(4), pp. 481–499.
Schrepp, M., Hinderks, A., and Thomaschewski, J. (2014). “Applying the user experience questionnaire (UEQ) in different evaluation scenarios.” In International Conference on Design, User Experience, and Usability, pp. 383–392. Springer, Cham.
Schrepp, M., Hinderks, A., and Thomaschewski, J. (2017). “Construction of a Benchmark for the User Experience Questionnaire (UEQ).” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 4, no. 4, pp. 39–45. https://doi.org/10.9781/ijimai.2017.445
Preece, J., Rogers, Y., Sharp, H., Benyon, D., Holland, S., and Carey, T. (1994). Human-Computer Interaction. Wokingham: Addison-Wesley.
ISO 9241-210. Ergonomics of Human-System Interaction – Part 210: Human-centred design for interactive systems. International Organization for Standardization.
Naumann, A., Hurtienne, J., Israel, J. H., Mohs, C., Kindsmüller, M. C., Meyer, H. A., and Hußlein, S. (2007). “Intuitive use of user interfaces: defining a vague concept.” In International Conference on Engineering Psychology and Cognitive Ergonomics, pp. 128–136. Springer, Berlin, Heidelberg.
Comber, T. and Maltby, J. R. (1997). “Layout complexity: does it measure usability?” In Human-Computer Interaction INTERACT’97, pp. 623–626. Springer, Boston, MA.
Davis, F. D., Bagozzi, R. P., and Warshaw, P. R. (1989). “User acceptance of computer technology: a comparison of two theoretical models.” Management Science, 35(8), pp. 982–1003.
Hatscher, M. (2001). “Joy of use—Determinanten der Freude bei der Software-Nutzung (Determinants of enjoyment during use of software).” In Mensch & Computer 2001: 1. Fachübergreifende Konferenz (Interdisciplinary conference). B.G. Teubner.
Hassenzahl, M., Burmester, M., and Koller, F. (2003). “AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität (AttrakDiff: A questionnaire for the measurement of perceived hedonic and pragmatic quality).” In J. Ziegler and G. Szwillus (eds.), Mensch & Computer 2003: Interaktion in Bewegung, pp. 187–196. Stuttgart/Leipzig: B.G. Teubner.
Moshagen, M. and Thielsch, M. T. (2010). “Facets of visual aesthetics.” International Journal of Human-Computer Studies, 68(10), pp. 689–709.
Laugwitz, B., Schrepp, M., and Held, T. (2006). “Konstruktion eines Fragebogens zur Messung der User Experience von Softwareprodukten (Construction of a questionnaire for the measurement of user experience of software products).” In A. M. Heinecke and H. Paul (eds.), Mensch & Computer 2006 – Mensch und Computer im Strukturwandel, pp. 125–134. Oldenbourg Verlag.
Thielsch, M. T., Blotenberg, I., and Jaron, R. (2014). “User evaluation of websites: From first impression to recommendation.” Interacting with Computers, 26(1), pp. 89–102.
Winter, D., Schrepp, M., and Thomaschewski, J. (2015). “Faktoren der User Experience—Systematische Übersicht über produktrelevante UX-Qualitätsaspekte (Factors of user experience—A systematic overview of product-related UX quality aspects).” In Mensch und Computer 2015 – Usability Professionals.
Winter, D., Hinderks, A., Schrepp, M., and Thomaschewski, J. (2017). “Welche UX Faktoren sind für mein Produkt wichtig? (Which UX factors are important for my product?)” In S. Hess and H. Fischer (eds.), Mensch und Computer 2017 – Usability Professionals, pp. 191–200. Regensburg: Gesellschaft für Informatik e.V.
Brooke, J. (1996). “SUS—A quick and dirty usability scale.” In Usability Evaluation in Industry, 189(194), pp. 4–7.
Kirakowski, J. and Corbett, M. (1993). “SUMI: The software usability measurement inventory.” British Journal of Educational Technology, 24(3), pp. 210–212.
Thielsch, M. T. and Moshagen, M. (2011). “Erfassung visueller Ästhetik mit dem VisAWI (Capture of visual aesthetics with VisAWI).” Tagungsband (Conference transcript) UP11.
Minge, M. and Riedel, L. (2013). “meCUE – Ein modularer Fragebogen zur Erfassung des Nutzungserlebens (meCUE – A modular questionnaire for capturing the user experience).” In S. Boll, S. Maaß and R. Malaka (eds.), Mensch und Computer 2013: Interaktive Vielfalt, pp. 89–98. München: Oldenbourg Verlag.
Gediga, G., Hamborg, K. C., and Düntsch, I. (1999). “The IsoMetrics usability inventory: an operationalization of ISO 9241-10 supporting summative and formative evaluation of software systems.” Behaviour & Information Technology, 18(3), pp. 151–164.
Schrepp, M. and Santoso, H. (2018). “Has Culture an Impact on the Importance of UX Aspects?” In Mensch und Computer 2018 – Workshopband (Workshop transcript).
Hinderks, A. (2016). Modifikation des User Experience Questionnaire (UEQ) zur Verbesserung der Reliabilität und Validität (Modification of the user experience questionnaire for the improvement of reliability and validity). Unpublished Master Thesis, University of Applied Sciences Emden/Leer.
Boos, B. and Brau, H. (2017). “Erweiterung des UEQ um die Dimensionen Akustik und Haptik (Extension of the UEQ by the dimensions acoustics and haptics).” In S. Hess and H. Fischer (eds.), Mensch und Computer 2017 – Usability Professionals, pp. 321–327. Regensburg: Gesellschaft für Informatik e.V.
Sauro, J. and Lewis, J. R. (2011). “When designing usability questionnaires, does it hurt to be positive?” In CHI Proceedings, pp. 2215–2224.
Revelle, W. (2018). psych: Procedures for Personality and Psychological Research. Northwestern University, Evanston, Illinois, USA. https://CRAN.R-project.org/package=psych
(Version 1.8.12).
Schrepp, M. and Thomaschewski, J. (2019). “Construction and first validation of extension scales for the User Experience Questionnaire (UEQ).” Research Report, University of Applied Sciences Emden/Leer. https://doi.org/10.13140/RG.2.2.19260.08325
Hinderks, A., Schrepp, M., Domínguez Mayo, F. J., Escalona, M. J., and Thomaschewski, J. (2019). “Developing a UX KPI based on the User Experience Questionnaire.” Computer Standards & Interfaces. https://doi.org/10.1016/j.csi.2019.01.007
Rauschenberger, M., Schrepp, M., Cota, M. P., Olschner, S., and Thomaschewski, J. (2013). “Efficient measurement of the user experience of interactive products—How to use the User Experience Questionnaire (UEQ). Example: Spanish Language Version.” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 2, no. 1, pp. 39–45. https://doi.org/10.9781/ijimai.2013.215
Cota, M. P., Thomaschewski, J., Schrepp, M., and Goncalves, R. (2013). “Efficient Measurement of the User Experience—A Portuguese Version of the User Experience Questionnaire.” Procedia Computer Science, vol. 27, 5th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion (DSAI 2013), pp. 491–498. https://doi.org/10.1016/j.procs.2014.02.053
Downloads
Published
-
Abstract129
-
PDF57
Submit Article
Information
