Analisis Kualitas Soal Tes Formatif untuk Mengukur High Order Thinking Skills pada Materi Kesetimbangan Kimia

Nabila Nur Indah Dunggio; Mangara Sihaloho; Netty Ino Ischak; Nurhayati Bialangi; Lukman A. R. Laliyo

doi:10.55681/nusra.v7i3.6525

Authors

Nabila Nur Indah Dunggio Universitas Negeri Gorontalo
Mangara Sihaloho
Netty Ino Ischak
Nurhayati Bialangi
Lukman A. R. Laliyo

DOI:

https://doi.org/10.55681/nusra.v7i3.6525

Keywords:

HOTS, Formative Test, Chemical Equilibrium, Rasch Model, Instrument Quality

Abstract

This study aimed to develop a Higher Order Thinking Skills (HOTS)-based formative test instrument on chemical equilibrium material and to analyze the quality of the instrument based on validity, reliability, difficulty level, discrimination power, and distractor effectiveness using the Rasch Model. This study employed a Research and Development method involving 564 students as research subjects. The developed instrument consisted of HOTS multiple-choice questions at cognitive levels C4, C5, and C6. Instrument validity was analyzed through expert validation, while empirical analysis was conducted using Winsteps and Microsoft Excel. The results showed that the instrument obtained a validity percentage of 88.95%, categorized as very valid. Rasch Model analysis indicated that all items met the item fit criteria with a Cronbach Alpha reliability value of 0.78, categorized as good. The item difficulty levels consisted of easy, moderate, and difficult categories, with moderate items being dominant. All items demonstrated good discrimination power as indicated by positive Pt Measure Corr values. In addition, most distractors functioned effectively because they were selected by students. The distribution of HOTS items consisted of 44.44% C4 level, 33.33% C5 level, and 22.22% C6 level. Therefore, the HOTS-based formative test instrument on chemical equilibrium material was considered feasible for measuring students’ higher-order thinking skills.

Downloads

Download data is not yet available.

References

Ariani, S. N., Yerimadesi, Gazali, F., & Aini, F. Q. (2026). Pengembangan Instrumen Tes Literasi Kimia pada Materi Sistem Periodik Unsur SMA/MA. Journal of Chemistry Education and Integration, 5(1), 68–81.

Asri, S. K., & Julisman, I. (2022). Pengaruh Citra Merek dan Kualitas Produk Philips Terhadap Minat Beli Konsumen pada Yogya Grand Majalengka. Jurnal Impresi Indonesia (JII), 1(3), 282–287. https://doi.org/10.36418/jii.v1i3.40.Siti

Asriadi, M., & Hadi, S. (2021). Analysis of the Quality of the Formative Test Items for Physics Learning Using the Rasch Model in the 21 st Century Learning. Jipf (Jurnal Ilmu Pendidikan Fisika), 6(2), 158–166. https://doi.org/dx.doi.org/10.26737/jipf.v6i2.2030

Aulia, A. F., & Rahmawati, S. (2025). Development of Higher-Order Thinking Skills Oriented to Illustrated Multiple Choice Questions Using A Contextual Approach to Chemical Equilibrium Materials. Jurnal Pendidikan Sains Dan Matematika, 13(130), 45–62. https://doi.org/doi.org/10.23971/11ewke66

Bano, V. O., Marambaawang, D. N., & Njoeroemana, Y. (2022). Analisis Kriteria Butir Soal Ujian Sekolah Mata Pelajaran IPA di SMP Negeri 1 Waingapu. Ideas: Jurnal Pendidikan, Sosial, Dan Budaya, 8(1), 145. https://doi.org/10.32884/ideas.v8i1.660

Basyiroh, U., Mulyani, B., & Dwi, R. (2022). Analisis Kesulitan Belajar pada Materi Kesetimbangan Kimia dengan Tes Diagnostik Three-Tier Multiple Choice pada Siswa Kelas XI SMA Negeri 1 Surakarta Tahun Pelajaran 2020/2021. Jurnal Pendidikan Kimia, 11(1), 51–59. https://doi.org/doi.org/10.20961/jpkim.v11i1.49899

Efendi, F. R., Isnaeni, H. N., & Saputra, R. (2025). Analisis Soal HOTS dalam Latihan Buku Teks Cerdas Cergas Berbahasa dan Bersastra Indonesia Kelas 12. Geram: Jurnal Pendidikan, Bahasa Dan Sastra, 13(2), 269–282. https://doi.org/10.25299/geram.2025.22882

Fadhilah, S. N., & Wisudawati, A. W. (2026). The HOTS-Characteristic Diagnostic Tests Using the System Thinking Approach to Detect Acid-Base Misconceptions in High School Chemistry. Jurnal Kimia Dan Pendidikan Kimia, 11(1), 109–129. https://doi.org/doi.org/10.20961/jkpk.v11i1.111442

Hayat, B. (2022). Adjustment for Guessing In a Basic Statistics Test for Indonesian Undergraduate Psychology Students Using the Rasch Model. Cogent Education, 9(1). https://doi.org/10.1080/2331186X.2022.2059044

Himmah, F., & Sulaikho, S. (2022). Pengembangan Media Pembelajaran Berbasis Android Dengan Pemanfaatan. Journal of Education and Management Studies, 5(4), 38–47. https://creativecommons.org/licenses/by-nc/4.0/

Husada, V. M. S., Yamtinah, S., & Indriyanti, N. Y. (2021). Analisis Konten High Order Thinking Skill pada Soal PAS dan PAT Kimia Kelas XI Tahun Pelajaran 2019/2020 di Kota Surakarta. Jurnal Pendidikan Kimia, 10(2), 215–223. https://doi.org/doi.org/10.20961/jpkim.v10i2.48679

Laliyo, L. A. R., Katili, Y., Lukum, A., Kilo, A. La, & Pikoli, M. (2026). Rasch PCM Diagnostic Analysis of Critical Thinking Item Responses in Indonesian Atomic Structure Learning. Jurnal Kimia Dan Pendidikan Kimia, 11(1), 130–146. https://doi.org/doi.org/10.20961/jkpk.v11i1.112310

Listiani, W., & Rachmawati. (2022). Transformasi Taksonomi Bloom dalam Evaluasi Pembelajaran Berbasis HOTS. Jurnal Jendela Pendidikan, 2(03), 397–402. https://doi.org/doi.org/10.57008/jjp.v2i03.266

Masrifah, K., Ahsanuddin, M., Mahliatussikah, H., & Ismail, Z. (2025). Evaluating Higher-Order Thinking Skills Representation in the 2022 Quadra Arabic Language Textbooks for Indonesian Madrasah Aliyah. Al-Lisan: Jurnal Bahasa, 10(2), 255–269. https://doi.org/10.30603/al.v10i2.6703

Nugrahnastiti, N., & Kamaludin, A. (2024). Development of a Higher-Order Thinking Skills (HOTS) Test Instrument on Electrochemical Material for High School Students. Jurnal Kependidikan: Jurnal Hasil Penelitian Dan Kajian Kepustakaan Di Bidang Pendidikan, Pengajaran Dan Pembelajaran, 10(2), 451–466. https://doi.org/doi.org/10.33394/jk.v10i2.11370

Oktaviani, S. Z., & Harjono. (2025). Development of Two-Tier Multiple-Choice Diagnostic Test Instrument Based on Science Literacy on Chemical Equilibrium Material. Chemistry in Education, 14(1), 1–14. https://doi.org/10.15294/chemined.v14i1.21813

Panjaitan, B. R., Ningrum, E., & Waluya, B. (2024). Analysis of Multiple Choice HOTS Test Questions on the Final Semester Assessment. Jurnal Geografi, 16(2), 170–180. https://doi.org/10.24114/jg.v16i2.55504

Priyani, T., & Sugiharto, B. (2024). Analysis of Biology Midterm Exam Items Using a Comparison of The Classical Theory Test and The Rasch model. JPBI (Jurnal Pendidikan Biologi Indonesia), 10(3), 939–958. https://doi.org/10.22219/jpbi.v10i3.34345

Rezigalla, A. A., Eleragi, A. M. E. S. A., Elhussein, A. B., Alfaifi, J., ALGhamdi, M. A., Al Ameer, A. Y., Yahia, A. I. O., Mohammed, O. A., & Adam, M. I. E. (2024). Item Analysis: The Impact of Distractor Efficiency on The Difficulty Index and Discrimination Power of Multiple-Choice Items. BMC Medical Education, 24(1), 1–7. https://doi.org/10.1186/s12909-024-05433-y

Shavira, A., Fazlia, R., Rahmayani, I., Soal, A. B., & Kimia, K. (2022). Analisis Tingkat Kesulitan dan Kualitas Soal Tes Pada Materi Kesetimbangan Kimia. Jurnal Ilmiah Mahasiswa Jurusan Pendidikan Kimia, 9(2), 44–52. https://doi.org/10.82415/jimpk.v9i2.31324

Sumintono, B., & Widhiarso, W. (2015a). Aplikasi Pemodelan RASCH pada Assesment Pendidikan. Penerbit Trim Komunikata.

Wulandari, T., Sari, D. P., & Nasution, A. R. (2024). Deskripsi Mendalam untuk Memastikan Keteralihan Temuan Penelitian Kualitatif. Jurnal Literasiologi, 11(2), 124–131. https://doi.org/doi.org/10.47783/literasiologi.v9i4

Yessi, Driana, E., & Ernawati. (2022). Tingkat Pemahaman dan Instrumen HOTS Buatan Guru IPA di SMP Tangerang Selatan Tahun Pelajaran 2019-2020. Jurnal Penelitian Dan Penilaian Pendidikan (JPPP), 7654(June), 15–28. https://doi.org/doi.org/10.22236/jppp.v3i1