ANALYSIS OF THE QUALITY OF SUMMATIVE ARABIC TEST ITEMS FOR GRADE V AT AT-TAQWA ISLAMIC ELEMENTARY SCHOOL BASED ON HALADYNA’S THEORY

Rani Asyiami* -  Universitas Pendidikan Indonesia, Indonesia
Asep Sopian -  Universitas Pendidikan Indonesia, Indonesia
Hikmah Maulani -  Universitas Pendidikan Indonesia, Indonesia

Supp. File(s): Research Instrument
The quality of test items plays an important role in ensuring the validity of learning assessments, particularly in language learning, which heavily depends on wording clarity and item construction. Previous research, however, has mostly relied on quantitative analyses and has only partially examined the quality of item wording and construction through qualitative approaches, particularly in Arabic-language assessments at the elementary school level. This study aims to analyse the quality of test items in the Arabic summative assessment of Grade V at SD IT At-Taqwa by using Haladyna’s item-writing guidelines. The research was qualitative in nature and employed directed content analysis. Comprised all multiple-choice items from the 2025 summative assessment, gathered through document analysis, and analysed using Miles and Huberman's interactive model. The results show that the test items are generally of good quality, particularly in language clarity, content relevance, and structural consistency. Some weaknesses were identified, however, such as a lack of contextual variation, repetitive item patterns, and distractors that are less effective than they could be. Additionally, some items still focus on lower-level thinking skills and do not sufficiently assess language proficiency. These findings underscore the need to improve the measurement of language ability, the quality of distractors, and contextual variation in a more holistic way

Supplement Files

Keywords : Test Item Quality; Summative Assessment; Arabic; Haladyna Guidelines

  1. Alfitri, Tulus Musthofa, and Harif Supriady. ‘Analysis of the Arabic Language Test Questions at the CELAD Institute from the Perspective of CEFR Standards’. Arabiyatuna: Jurnal Bahasa Arab 9, no. 2 (2025): 741–54. https://doi.org/10.29240/jba.v9i2.13801.
  2. Amadi, Noble, Wei-Chiang Lin, Noha Elsakka, and Melissa Baralt. ‘fNIRS Evidence for Enhanced Brain Activity during Task-Based Arabic Learning in Virtual Reality’. NeuroImage: Reports 6, no. 2 (2026): 100358. https://doi.org/10.1016/j.ynirp.2026.100358.
  3. Amiruddin, Nurlina, Imam Agus Basuki, and Titik Harsiati. ‘Analisis Instrumen Butir Soal Asesmen Menyimak pada Latihan Uji Kemahiran Berbahasa Indonesia’. ESTETIK : Jurnal Bahasa Indonesia 8, no. 2 (2025): 281–302. https://doi.org/10.29240/estetik.v8i2.13477.
  4. Brookhart, Susan M. ‘Appropriate Criteria: Key to Effective Rubrics’. Frontiers in Education 3, no. April (2018). https://doi.org/10.3389/feduc.2018.00022.
  5. Chalista, Ajeng, Guntur Cahaya Kesuma, and Muhammad Afif Amrulloh. ‘Developing Arabic Language Learning Assessment Tools Using the Competition Application in Secondary School’. ALSUNIYAT: Jurnal Penelitian Bahasa, Sastra, dan Budaya Arab 7, no. 2 (2024). https://doi.org/https://doi.org/10.17509/alsuniyat.v7i2.69424.
  6. Chotimah, Chotimah. ‘Implementasi Asesmen Diagnostik dalam Pembelajaran IPAS Kurikulum Merdeka pada Aspek Penilaian Berpikir Kritis Siswa’. Jurnal Didaktika Pendidikan Dasar 9, no. 1 (2025): 89–110. https://doi.org/10.26811/didaktika.v9i1.1678.
  7. Downing, Steven M. ‘The Effects of Violating Standard Item Writing Principles on Tests and Students: The Consequences of Using Flawed Test Items on Achievement Examinations in Medical Education’. Advances in Health Sciences Education 10, no. 2 (2005): 133–43. https://doi.org/10.1007/s10459-004-4019-5.
  8. Edmonds, Amanda, Jon Clenton, and Hosam Elmetaher. ‘Exploring the Construct Validity of Tests Used to Assess L2 Productive Vocabulary Knowledge’. System 108, no. 19 (2022): 102855. https://doi.org/10.1016/j.system.2022.102855.
  9. Ernawati, Ernawati, Rini Yaumi Habibah, Nur Syarifah, Firmansyah Firmansyah, and Has’ad Rahman Attamimi. ‘Item Analysis Test of Science, Indonesian Language, and Mathematics Using the Rasch Model in Elementary Schools’. Jurnal Penelitian dan Evaluasi Pendidikan 28, no. 2 (2024): 195–209. https://doi.org/10.21831/pep.v28i2.75448.
  10. Haladyna, Thomas M. Developing and Validating Multiple-Choice Test Items. 3rd edn. Routledge, 2004. https://doi.org/https://doi.org/10.4324/9780203825945.
  11. Haladyna, Thomas M., Steven M. Downing, and Michael C. Rodriguez. ‘A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment’. Applied Measurement in Education 15, no. 3 (2002): 309–33. https://doi.org/10.1207/S15324818AME1503_5.
  12. Haladyna, Thomas M., and Michael C. Rodriguez. DEVELOPING AND VALIDATING TEST. 1st edn. Routledge, 2013. https://doi.org/https://doi.org/10.4324/9780203850381.
  13. Harris, Deborah J., Catherine J. Welch, and Stephen B. Dunbar. ‘In the Beginning, There Was an Item…’. Educational Measurement: Issues and Practice 43, no. 4 (2024): 40–45. https://doi.org/10.1111/emip.12647.
  14. Hartini, Puji, Hari Setiadi, and Ernawati Ernawati. ‘Cognitive Domain Analysis (LOTS and HOTS) Assessment Instruments Made by Primary School Teachers’. Jurnal Penelitian dan Evaluasi Pendidikan 25, no. 1 (2021): 16–24. https://doi.org/10.21831/pep.v25i1.34411.
  15. Hassany, Mohammad, Peter Brusilovsky, Jaromir Savelka, et al. ‘Generating Effective Distractors for Introductory Programming Challenges : LLMs vs Humans’. LAK25: The 15th International Learning Analytics and Knowledge Conference (LAK 2025), March 03â•fi07, 2025, Dublin, Ireland 1, no. 1 (2025): 1–16. https://doi.org/https://doi.org/10.1145/3706468.3706529.
  16. İlhan, Mustafa, Neşe Guler, Gülşen Tasdelen Teker, and Ömer Ergenekon. ‘The Effects of Reverse Items on Psychometric Properties and Respondents’ Scale Scores According to Different Item Reversal Strategies’. International Journal of Assessment Tools in Education 11, no. 1 (2024): 20–38. https://doi.org/10.21449/ijate.1345549.
  17. Knoch, Ute, and Carol A. Chapelle. ‘Validation of Rating Processes within an Argument-Based Framework’. Language Testing 35, no. 4 (2018): 477–99. https://doi.org/10.1177/0265532217710049.
  18. Kritsotakis, George, and Eleni Morfidi. ‘Reading Comprehension and Linguistic Abilities of Children with and without Specific Learning Difficulties: Theoretical and Educational Implications’. Education Sciences 14, no. 8 (2024): 884. https://doi.org/10.3390/educsci14080884.
  19. Kwon, Suh Keong, and Guoxing Yu. ‘The Effect of Viewing Visual Cues in a Listening Comprehension Test on Second Language Learners ’ Test-Taking Process and Performance : An Eye-Tracking Study’. Language Testing, ahead of print, 2024. https://doi.org/10.1177/02655322241239356.
  20. Levy-Feldman, Irit. ‘The Role of Assessment in Improving Education and Promoting Educational Equity’. Education Sciences 15, no. 2 (2025): 224. https://doi.org/10.3390/educsci15020224.
  21. Maulani, Hikmah, Isop Syafei, and Nur Muthmainah. ‘Didactic Transposition in Reading Material : Linking Knowledge to Be Taught and Assessment for Learning’. Jurnal Kependidikan 11, no. 2 (2025): 588–99. https://doi.org/https://doi.org/10.33394/jk.v11i2.15375.
  22. Novan, Arsharil, and Putri Ulfa Kamalia. ‘Evaluating Test Item Quality: A Comprehensive Analysis of Economics Multiple-Choice Questions in Indonesian High Schools (Case Study at SMA Negeri 1 Gedangan)’. Asatiza: Jurnal Pendidikan 6, no. 3 (2025): 287–97. https://doi.org/10.46963/asatiza.v6i3.3168.
  23. Putri, Annora Pratama, and Joko Sayono. ‘Evaluation of Item Quality: Analysis of Difficulty Level and Distinction Power with Quantitative Methods’. Journal of Educational Sciences 10, no. 1 (2026): 317–30. https://doi.org/10.31258/jes.10.1.p.317-330.
  24. Rahman, Anwar, and Supriyanoor. ‘Analisis Butir Soal Ulangan Akhir Semester Ganjil Pembelajaran PKN Kelas 6 MI Ummul Qura Amuntai’. Al-Madrasah: Jurnal Ilmiah Pendidikan Madrasah Ibtidaiyah 10, no. 1 (2026): 395–412. https://doi.org/10.35931/am.v10i1.5594.
  25. Ramadhan, Wandri, Fildza Malahati, Kharisma Romadhon, and Syahrul Ramadhan. ‘Analisis Butir Soal Tipe Multiple Choice Questions dada Penilaian Harian Sekolah Dasar’. Tarbiyah Wa Ta’lim: Jurnal Penelitian Pendidikan dan Pembelajaran 10, no. 2 (2023): 93–105. https://doi.org/10.21093/twt.v10i2.6155.
  26. Reeves, Todd D., and Gili Marbach-Ad. ‘Contemporary Test Validity in Theory and Practice: A Primer for Discipline-Based Education Researchers’. CBE—Life Sciences Education 15, no. 1 (2016): rm1. https://doi.org/10.1187/cbe.15-08-0183.
  27. Rezigalla, Assad Ali, Ali Mohammed, Elhassan Seid, et al. ‘Item Analysis : The Impact of Distractor Efficiency on the Difficulty Index and Discrimination Power of Multiple-Choice Items’. BMC Medical Education, 2024, 1–7. https://doi.org/https://doi.org/10.1186/s12909-024-05433-y.
  28. Rush, Bonnie R., David C. Rankin, and Brad J. White. ‘The Impact of Item-Writing Flaws and Item Complexity on Examination Item Difficulty and Discrimination Value’. BMC Medical Education, 2016, 1–10. https://doi.org/10.1186/s12909-016-0773-3.
  29. Saputra, Hendra Dani, Wawan Purwanto, Dedi Setiawan, Donny Fernandez, and Rido Putra. ‘Hasil Belajar Mahasiswa: Analisis Butir Soal Tes’. Edukasi: Jurnal Pendidikan 20, no. 1 (2022): 15–27. https://doi.org/10.31571/edukasi.v20i1.3432.
  30. Sopian, Asep, Anwar Sanusi, and Rima Nurkomala. ‘Industrial Revolution 4 . 0 : A Case Study On Character Building For Arabic Teaching At Islamic Boarding School In Indonesia’. IJAZ ARABI: Journal of Arabic Learning 7, no. 3 (2024): 997–1013. https://doi.org/https://doi.org/10.18860/ijazarabi.v7i3.26291.
  31. Sullivan, Barry O., Micheline Chalhoub-deville, and Barry O. Sullivan. ‘Language Testing for Migrants : Co-Constructing Validation Language Testing for Migrants : Co-Constructing Validation’. Language Assessment Quarterly 18, no. 5 (2021): 547–57. https://doi.org/10.1080/15434303.2021.1986513.
  32. Syahriandi. ‘Kualitas Butir Soal Ujian Ditinjau Dari Segi Bahasa (Analisis Kualitatif Butir Soal)’. Visipena Journal 8, no. 1 (2017): 174–83. https://doi.org/10.46244/visipena.v8i1.386.
  33. Tang, Cheng, George Engelhard, Yinying Liu, and Jiawei Xiong. ‘A Dual-Model Framework for Writing Assessment: A Cross-Sectional Interpretive Machine Learning Analysis of Linguistic Features’. Data 11, no. 1 (2025): 2. https://doi.org/10.3390/data11010002.
  34. Tarmizi, Pebrian, Panut Setiono, Yuli Amaliyah, and Arief Agrian. ‘Analisis Butir Soal Pilihan Ganda Tema Sehat Itu Penting Kelas V SD Negeri 04 Kota Bengkulu’. ELSE (Elementary School Education Journal) : Jurnal Pendidikan dan Pembelajaran Sekolah Dasar 4, no. 2 (2021): 124. https://doi.org/10.30651/else.v4i2.7090.
  35. Wibowo, Enggar Pangesti. ‘Comprehensive Test Items Analysis Of Teacher-Made English Summative Assesment In Third Grade Primary School’. Journal of English Educational Study (JEES) 8, no. 1 (2025): 67–76. https://doi.org/10.31932/jees.v8i1.4241.

Open Access Copyright (c) 2026 Rani Asyiami, Asep Sopian, Hikmah Maulani
Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Thariqah Ilmiah: Jurnal Ilmu-Ilmu Kependidikan & Bahasa Arab

UNIVERSITAS ISLAM NEGERI SYEKH ALI HASAN AHMAD ADDARY PADANGSIDIMPUAN

ISSN Print : 2355-8717 ISSN Online : 2721-8406

Jalan T. Rizal Nurdin,KM 4,5 Sihitang, Padangsidimpuan Tenggara Kampus Utama Universitas Islam Negeri Syekh Ali Hasan Ahmad Addary Padangsidimpuan

 


View My Stats Counter


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.