Preparation of the reliability and validity test of the Hungarian adaptation of the modified Simulation Effectiveness Tool (SET-M HU)

Abstract

Introduction: The Simulation Effectiveness Tool-Modified (SET-M) questionnaire aims to assess students’ perceptions of the effectiveness of teaching and learning in a simulation environment. Aim: The aim of our research group was to develop a Hungarian version of the questionnaire (SET-M HU) and to test the reliability and validity of the psychometric characteristics of the questionnaire. In the preparatory phase of this process, a pilot study was conducted, and the results of which will serve as a basis for the development of the final Hungarian version and for further validity tests. Material and methods: Data were collected from 91 students who participated in the simulation-based learning experience in the Faculty of Health Sciences at the University of Debrecen, between September 2023 and March 2024. The methods used for data analysis were descriptive statistics, exploratory factor analysis, correlation analysis, calculation of Cronbach alphas, Item-Total analysis, Split-Half reliability, and Rough Set analysis. The data analysis used Microsoft Excel 2016 and SPSS v24 software. Result: As a result of the factor analysis, three factors accounted for 69.8% of the total variance. The correlations of the Hungarian version of the instrument ranged from r = 0.918 to r = 0.894. The overall Cronbach’s alpha coefficient of the instrument was found to be 0.950. The correlations were statistically significant for the full instrument and the subscales. Rough Set analysis showed similar results for the Gauge test. Conclusions: Based on the results of our research, the feasibility of the questionnaire in Hungary has been confirmed, so it is relevant to continue the validation process. The Hungarian version of the questionnaire can be a reliable and valid measurement tool to assess the effectiveness of learning in simulation environments.