Personal Fabricated-English Items’ Quality: Classical Test and Item Response Theories
Abstract
Item Analysis is used to determine the quality of test items, whether applicable or not applicable for the test takers’ ability assessment. Owing to that, our research attempts to measure the quality of personal fabricated English items for 8th grade students under the Classical Test Theory (CTT) and Item Response Theory (IRT) by Rasch models. We adopted reliability, item difficulty, discrimination power, and distractor effectivity, following to both theories. Overall, 30 items with multiple-choice format were handed out to 46 students. The items were analyzed quantitatively by deploying the Quest.exe application. The results showed that the items are reliable with 0.69 CTT and 1.0 IRT values, and the item difficulties are also varied: 12, 14, and 4 based on CTT categorizations and index easy, moderate, and difficult, while IRT demonstrated similar results. There is only 1 item inadequate to differentiate students’ ability, and this item required a revision; furthermore, 17 out of 30 items have effective distractors. This research is expected to contribute to Item analysis and Quest.exe demonstration for the same purposes.
Keywords
Full Text:
PDFReferences
Ashraf, Z. A., & Author, C. (2020). Classical and Modern Methods in Item Analysis of Test Tools Assistant Professor of Clinical Psychology, IMHANS, Kozhikode. International Journal of Research and Review (Ijrrjournal.Com), 7(5), 5.
Asrul, Ananda, R., & Rosinta. (2014). Evaluasi Pembajalaran. In Ciptapustaka Media.
Creswell, J. W. (2002). Educational Research. Planning, Conducting, and Evaluating Quantitative and Qualitative Research. Pearson Education Limited.
Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (4rd Ed). MA: Pearson.
Danuwijaya, A. A. (2018). Item Analysis of Reading Comprehension Test for Post-Graduate Students. English Review: Journal of English Education, 7(1), 29. https://doi.org/10.25134/erjee.v7i1.1493
Erfan, M., Maulyda, M. A., Hidayati, V. R., Astria, F. P., & Ratu, T. (2020). Tes Klasik Dan Model Rasch. Indonesian Journal of Educational Research and Review, 3(1), 11–19.
Fitrianawati, M. (2017). Peran Analisis Butir Soal Guna Meningkatkan Kualitas Butir Soal, Kompetensi Guru, dan Hasil Belajar Peserta Didik. Prosiding Seminar Nasional Pendidikan PGSD UMS & HDPGSDI Wilayah Jawa, 282–295. https://publikasiilmiah.ums.ac.id/handle/11617/9117
Goolamally, S. H. C. & N. (2019). Validation of a two-tier multiple choice (2tmc) diagnostic instrument on the mole concept and solution concentration: a rasch analysis. International Conference on Education, April, 227–237.
Hartati, N., & Yogi, H. P. S. (2019). Item Analysis for a Better Quality Test. English Language in Focus (ELIF), 2(1), 59. https://doi.org/10.24853/elif.2.1.59-70
Heppi Yuslita, et. a. (2016). Analisis Tingkat Kesukaran Soal dan Daya Pembeda Soal Mata Ppelajaran Sejarah Kelas XI Semester Ganjil di SMA Negeri 5 Banda Aceh Tahun Pelajaran 2015-2016. Jurnal Ilmiah Mahasisw Pendidikan Sejarah, 1(1), 131–138.
Jinyan Huang, Tiantian Shu, Yaxin Dong, D. Z. (2023). Constructing and Validating a Self-Assessment Scale for Chinese College English-Major Students’ Feedback Knowledge Repertoire in EFL Academic Writing: Item Response Theory and Factor Analysis Approaches. Assessing Writing, 56(100716). https://doi.org/https://doi.org/10.1016/j.asw.2023.100716
Karim, S. A., Sudiro, S., & Sakinah, S. (2021). Utilizing test items analysis to examine the level of difficulty and discriminating power in a teacher-made test. EduLite: Journal of English Education, Literature and Culture, 6(2), 256. https://doi.org/10.30659/e.6.2.256-269
Khairuddinalfath, L. U. F. &. (2019). Analisis Kesukaran Soal, Daya Pembeda, dan Fungsi Distraktor. Jurnal Komunikasi Dan Pendidikan Islam, 8(2), 37–64.
Law of the Republic of Indonesia Number 20. (2003). Act of the Republic of Indonesia on National Education System 1. System, 20, 1–58.
Mahmoodi-shahrebabaki, M. (2018). Assessment, Evaluation, and Testing: What are the Differences? February, 3–5. https://www.researchgate.net/publication/323218570_Assessment_Evaluation_and_Testing_What_are_the_Differences
Ningsih, N. A., & Widowati, W. (2021). Utilizing Test Item Analysis to Portray the Quality of English Final Test. English Teaching Journal : A Journal of English Literature, Language and Education, 9(2), 143. https://doi.org/10.25273/etj.v9i2.10867
Siri, A., & Freddano, M. (2011). The use of item analysis for the improvement of objective examinations. Procedia - Social and Behavioral Sciences, 29, 188–197. https://doi.org/10.1016/j.sbspro.2011.11.224
Suarga, S. (2019). Hakikat, Tujuan Dan Fungsi Evaluasi Dalam Pengembangan Pembelajaran. Inspiratif Pendidikan, 8(1), 327–338. https://doi.org/10.24252/ip.v8i1.7844
Suek, L. A. (2021). Item Analysis of an English Summative Test. PEJLaC: Pattimura Excellence Journal of Language and Culture, 1(1), 9–18. https://doi.org/10.30598/pejlac.v1.i1.pp9-18
Susdelina, E. a. (2018). Analisis Kualitas Instrumen Pengukuran Pemahaman Konsep Persamaan Kuadrat Melalui Teori Tes Klasik Dan Rasch Model. Jurnal Kiprah, 6(1), 41–48. https://doi.org/10.31629/kiprah.v6i1.574
DOI: https://doi.org/10.24952/ee.v12i2.12754
Refbacks
- There are currently no refbacks.
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
English Education: English Journal for Teaching and Learning
Tadris Bahasa Inggris Fakultas Tarbiyah dan Ilmu Keguruan
UIN Syekh Ali Hasan Ahmad Addary Padangsidimpuan
ISSN Print : 2338-8781 ISSN Online : 2579-4043
Jl. T. Rizal Nurdin Km. 4,5 Sihitang Padangsidimpuan Sumatra Utara 22733 Indonesia
Phone: 0634-22080 Fax: 0634-24022
Email: englishjournal@uinsyahada.ac.id