Non-Test Instrument for Pronunciation Self-Assessment among Intermediate-Level English Language Learners in Higher Education: A Rasch Model Approach

Syahadah Albaqiyatul Karimah; Ninuk Lustyantie; Fathiaty Murtadho

doi:10.55681/jige.v6i2.3968

Authors

Syahadah Albaqiyatul Karimah Universitas Negeri Jakarta, Universitas Nahdlatul Ulama Indonesia
Ninuk Lustyantie Universitas Negeri Jakarta
Fathiaty Murtadho Universitas Negeri Jakarta

DOI:

https://doi.org/10.55681/jige.v6i2.3968

Keywords:

English Language Learners, Non-Test Instrument, Pronunciation Self-Assessment, Rasch Model, Intermediate Level

Abstract

Pronunciation is a vital component of oral language proficiency, yet it remains underrepresented in English language instruction, particularly within higher education EFL/ESL contexts. This study aims to address this pedagogical gap by developing and validating a non-test self-assessment instrument to measure pronunciation self-efficacy among intermediate English language learners (ELLs). Grounded in constructivist and learner-centered theories, the instrument integrates four dimensions: Phonological Awareness (PA), Accent and Intonation Awareness (AIA), Self-Confidence (SC), and Self-Monitoring (SM). A total of 43 university students participated, selected via purposive sampling. The instrument, comprising 20 Likert-scale items, underwent content validation by three experts, followed by psychometric evaluation through Rasch analysis using Winsteps software. The results demonstrate strong psychometric properties across all dimensions. Item and person reliability values ranged from moderate to high (0.64–0.90), with Cronbach’s Alpha (KR-20) between 0.68 and 0.90, indicating internal consistency. Person separation indices varied from 1.33 to 2.70, suggesting sufficient ability discrimination. Item fit statistics were within acceptable thresholds, supporting construct validity. Principal Components Analysis (PCA) of residuals confirmed unidimensionality, particularly for the SC construct, where Rasch explained variance reached 70.6%. PT-measure correlations further supported item discrimination quality. The validated instrument fills a methodological gap in the assessment of pronunciation self-efficacy and offers a practical, learner-centered tool for pedagogical implementation. It contributes to the advancement of self-regulated learning in pronunciation and opens pathways for further research into affective-cognitive correlates of pronunciation in EFL contexts.

Downloads

Download data is not yet available.

References

Albelihi, H. H. M., & Al-Ahdal, A. (2024). Overcoming error fossilization in academic writing: strategies for Saudi EFL learners to move beyond the plateau. Asian-Pacific Journal of Second and Foreign Language Education, 9(1), 75. https://doi.org/10.1186/s40862-024-00303-y

Algethami, G., & Al Kamli, H. (2025). Pronunciation Teaching in English Language Classrooms in Saudi Arabia: Teachers’ Cognition and Practice. Sage Open, 15(1). https://doi.org/10.1177/21582440251321299

Babaeian, A. (2023). Pronunciation Assessment: Traditional vs Modern Modes. Journal of Education For Sustainable Innovation, 1(1), 61–68. https://doi.org/10.56916/jesi.v1i1.530

Bandura, A. (1997). Self-efficacy: The exercise of control. (W H Freeman, Ed.). Times Books/ Henry Holt & Co.

Baran-Łucarz, M. (2014). The Link between Pronunciation Anxiety and Willingness to Communicate in the Foreign-Language Classroom: The Polish EFL Context. The Canadian Modern Language Review, 70(4), 445–473. https://doi.org/10.3138/cmlr.2666

Baranyi-Dupák, K. (2024). Pronunciation-and Accent-Related Beliefs, Attitudes, and Pronunciation Learning Strategies of English Language Teacher Trainees in Hungary [Doctoral dissertation]. University of Szeged.

Bond, T. (2015). Applying the Rasch Model. Routledge. https://doi.org/10.4324/9781315814698

Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model: Fundamental measurement in the human sciences (2nd ed.). Lawrence Erlbaum Associates.

Boone, W. J. , Staver, J. R. , & Yale, M. S. (2014). Person reliability, item reliability, and more. Rasch analysis in the human sciences,.

Borg, S., & Alshumaimeri, Y. (2019). Language learner autonomy in a tertiary context: Teachers’ beliefs and practices. Language Teaching Research, 23(1), 9–38. https://doi.org/10.1177/1362168817725759

Cai, H., & Yu, Q. (2024). The effect of self-perceived learning needs on self-regulated learning and learning outcomes in an EFL listening course. System, 127, 103503. https://doi.org/10.1016/j.system.2024.103503

Celce-Murcia, M., Brinton, D. M., & Goodwin, J. M. (2010). Teaching pronunciation hardback with audio CDs (2): A course book and reference guide. Cambridge University Press.

Derwing, T. M., & Munro, M. J. (2005). Second language accent and pronunciation teaching: A research‐based approach. TESOL Quarterly, 39(3), 379-397.

Derwing, T. M., & Munro, M. J. (2022). The Routledge Handbook of Second Language Acquisition and Speaking ; Pronunciation Learning and Teaching.

Dülger, E. (2020). Rasch-based Assessment for Innovative Education Systems. European Journal of Science and Technology. https://doi.org/10.31590/ejosat.824163

Hirschi, K., & Kang, O. (2024). Data‐Driven Learning for Pronunciation: Perception and Production of Lexical Stress and Prominence in Academic English. TESOL Quarterly, 58(3), 1081–1107. https://doi.org/10.1002/tesq.3302

Hofer, B., & Spechtenhauser, B. (2024). Theoretical Considerations on the Literacy-Metacognition Nexus: Exploring the Linguistic-Cognitive Landscape of Young Multilingual Minds. Brain Sciences, 14(10), 979. https://doi.org/10.3390/brainsci14100979

Isaacs, T., & Trofimovich, P. (2012). DECONSTRUCTING COMPREHENSIBILITY. Studies in Second Language Acquisition, 34(3), 475–505. https://doi.org/10.1017/S0272263112000150

Kang, O., & Hirschi, K. (n.d.). Pronunciation Assessment Criteria and Intelligibility. Speak Out.

Kormos, J. , & Smith, A. M. (2023). Teaching languages to students with specific learning differences (Vol. 18). Channel View Publications.

Levis, J. M. (2024). Key issues in L2 pronunciation research. Journal of Second Language Pronunciation, 10(3), 293–308. https://doi.org/10.1075/jslp.25009.lev

Lewkowicz, J. (2020). Why, What, When and How of Assessment in the Language Classroom. Language Assessment Quarterly, 17(1), 125–127. https://doi.org/10.1080/15434303.2019.1672074

Linacre, J. M. (2019). A user’s guide to Winsteps® Rasch-model computer programs. Beaverton.

Medvedev, O. N., & Krägeloh, C. U. (2022). Rasch Measurement Model. In Handbook of Assessment in Mindfulness Research (pp. 1–18). Springer International Publishing. https://doi.org/10.1007/978-3-030-77644-2_4-1

Namaziandost, E., Kargar Behbahani, H., & Heydarnejad, T. (2024). Tapping the alphabets of learning-oriented assessment: self-assessment, classroom climate, mindsets, trait emotional intelligence, and academic engagement are in focus. Language Testing in Asia, 14(1), 21. https://doi.org/10.1186/s40468-024-00293-1

Nguyen, H. A. (2024). Harnessing AI-Based Tools for Enhancing English Speaking Proficiency: Impacts, Challenges, and Long-Term Engagement. International Journal of AI in Language Education, 1(2), 18–29. https://doi.org/10.54855/ijaile.24122

Nu My Nhat, T., & Thi Thu Hien, H. (2024). Pronunciation Competence and Impact of Phonetics and Phonology Instruction in the Vietnamese Tertiary Context. 3L The Southeast Asian Journal of English Language Studies, 30(4), 241–256. https://doi.org/10.17576/3L-2024-3004-17

Pan, Y., Wang, L., & Zhu, Y. (2024). Strategic questioning for formative assessment in TEFL: insights from blended synchronous learning environments. Humanities and Social Sciences Communications, 11(1), 1519. https://doi.org/10.1057/s41599-024-04086-y

Plengkham, B. (2022). An implementation of an integrated performance assessment module to promote English speaking ability and learning engagement of undergraduate students [Chulalongkorn University]. https://doi.org/10.58837/CHULA.THE.2022.142

Raikhel, A. (2025). CHALLENGES AND STRATEGIES FOR IMPLEMENTING A STUDENT-CENTERED APPROACH IN TEACHING ENGLISH AS A SECOND FOREIGN LANGUAGE. Перспективи Та Інновації Науки, 1(47). https://doi.org/10.52058/2786-4952-2025-1(47)-158-167

Regan, M. T., Young, S. W. H., & Mannheimer, S. (2020). Improving Learner-Driven Teaching Practices through Reflective Assessment. Evidence Based Library and Information Practice, 15(3), 59–77. https://doi.org/10.18438/eblip29729

Selinker, L. (2015). Interlanguage. Error analysis. Routledge.

Vandergrift, L. , & Goh, C. (2012). Teaching and Learning Second Language Listening: Metacognition in Action. Routledge.

Yang, C., Wei, M., & Liu, Q. (2025). Intersections between cognitive‐emotion regulation, critical thinking and academic resilience with academic motivation and autonomy in EFL learners: Contributions of AI ‐mediated learning environments. British Educational Research Journal. https://doi.org/10.1002/berj.4140

Zega, Y. S. (2025). Effective strategies for enhancing English speaking competence among learners in English education study programs. Journal of Education, Social & Communication Studies, 2(2), 88–100. https://doi.org/10.71028/jescs.v2i2.27

Zhai, N., Huang, Y., Ma, X., & Chen, J. (2023). Can reflective interventions improve students’ academic achievement? A meta-analysis. Thinking Skills and Creativity, 49, 101373. https://doi.org/10.1016/j.tsc.2023.101373

Zhu, J., Zhang, X., & Li, J. (2024). Using AR filters in L2 pronunciation training: practice, perfection, and willingness to share. Computer Assisted Language Learning, 37(5–6), 1364–1396. https://doi.org/10.1080/09588221.2022.2080716

Zulkifly, N. (2023). Design and Development of a Pronunciation Self-Assessment Checklist for Aircraft Engineering Technology Students in an ESL Higher Education Context [Doctoral Dissertation]. University of Sheffield.