Validity and Reliability Assessment of a Motivation Questionnaire for a Collaborative Online Social Learning E-Module: A Pilot Study

Abstract

Students may experience various challenges in online learning environments that can negatively affect their motivation. A collaborative online social learning e-module may help address this issue by promoting interaction, participation, and knowledge sharing among students. However, limited instruments are available to assess students’ motivation after participating in such learning environments. Therefore, this study aimed to adapt and establish the pilot study validity and reliability of the Motivation Questionnaire for Collaborative Online Social Learning E-Module (MQ-COSLE). The 16-item questionnaire was adapted from an existing collaborative learning motivation instrument and evaluated by three experts for content validity. Subsequently, a pilot study was conducted with 42 undergraduate students selected through purposive sampling. All items achieved an item-level content validity index (I-CVI) of 1.00, while both the scale-level content validity index based on average agreement (S-CVI/Ave) and universal agreement (S-CVI/UA) were 1.00. The questionnaire also demonstrated excellent internal consistency, with an overall Cronbach’s alpha coefficient of 0.965. Although this value indicates strong reliability, it may also suggest potential redundancy or overlap among some items. Overall, the findings provide evidence supporting the content validity and internal consistency of the MQ-COSLE. The MQ-COSLE may be used to evaluate students’ motivation in comparable collaborative online social learning environments.