Assessing Psychometric Properties of Malaysian Secondary School Students’ Arabic Vocabulary Knowledge Inventory
DOI:
https://doi.org/10.7187/GJATSI052019-12Keywords:
Vocabulary knowledge, Validity, Reliability, Arabic Vocabulary Knowledge Inventory (PekkA), Rasch Measurement ModelAbstract
This study examines the use of psychometric properties to measure the Arabic vocabulary knowledge of Islamic secondary school students in Malaysia. An instrument was developed as a diagnostic test to measure various dimensions of Arabic vocabulary knowledge based on the Rasch Model. The study may give insight into the depth of Malaysian secondary school students’ understanding of Arabic language in word meaning. This paper also discusses the development of the Arabic Vocabulary Knowledge Inventory (PekkA). The instrument consisted of 57 items of vocabulary knowledge that focused on the aspects of meaning namely denotative meaning, semantic relationship, word formation, and word combination. 483 respondents were randomly selected from 39 Islamic secondary schools in Peninsular Malaysia. The study employed a crosssectional quantitative research design. The data was analyzed using the WINSTEP, a Rasch Measurement Model software to determine the validity and reliability of the instrument. The result of the study confirmed the psychometric requirement by Rasch model with good reliability and validity. In general, the results suggest that the instrument could be used as a reliable research instrument for evaluating the vocabulary knowledge among Arabic language learners in secondary school settings.
References
Abdul Razif Zaini & Mohd Zaki Abd. Rahman. (2015). Saiz Kosa Kata Bahasa Arab Dalam Kalangan Penuntut Jurusan Pengajian Islam dan Bahasa Arab. Jurnal Pengajian Islam, 8 (2): 225-238.
Alderson, J. C. (2005). Diagnosing Foreign Language Proficiency: The Interface Between Learning And Assesment. London: Continuum.
Al-Naqah, M. K. (1985). Ta`alim Al Lughah al`Arabiyyah Linnatiqina Biha. Saudi Arabia: Universiti Ummul Qura.
Al-Shuwairekh, S. (2001). Vocabulary Learning Strategies Used by AFL (Arabic as a Foreign Language) Learners in Saudi Arabia. Unpublished Ph.D. Thesis, University of Leeds.
Azrilah Abdul Aziz, Mohd Saidfudin Masodi & Azami Zaharim. (2013). Asas Model Pengukuran Rasch: Pembentukan Skala & Struktur Pengukuran. Bangi: PenerbitUniversiti Kebangsaan Malaysia.
Bachman, L. F. (1990). Fundamental Consideration in Language Testing. Oxford: Oxford University Press.
Balsamo, M., Giampaglia, G. & Saggino, A. (2014). Building A New Rasch-Based Self-Report Inventory of Depression. Neuropsychiatric Disease and Treatment, 10: 153–165. doi:10.2147/NDT.S53425
Bambang Sumintono & Wahyu Widhiarso. (2014). Aplikasi Model Rasch Untuk Penelitian Ilmu - Ilmu Sosial. (Edisi Revi.). Cimahi, Indonesia: Trim Komunikata PublishingHouse.
Bond, T. G. & Fox, C. M. (2015). Applying the Rasch Model: Fundamentals Measurement in the Human Sciences (3rd ed.). New York: Routledge.
Boone, W. J., Staver, J. R. & Yale, M. S. (2014). Rasch Analysis in the Human Sciences. Dordrecht: Springer.
Buckwalter, T. & Parkinson, D. (2011). A Frequency Dictionary of Arabic (1st ed.). London: Routledge.
Chapelle, C. A. (1994). Are C-tests Valid Measures for L2 Vocabulary Research?. Second Language Research, 10: 157-187.
Che Radiah Mezah & Norhayuza Mohammad. (2013). Kosa Kata Arab : Teori Dan Aplikasi. Serdang: Penerbit Universiti Putra Malaysia.
Conrad, K. J., Conrad, K. M., Dennis, M. L., Riley, B. B. & Funk, R. R. (2011). Validation of Crime and Violence Scale (CVS) to Rasch Measurement Model GAIN Methods Report 1.2. Evaluation Review. Chicago: IL.
Conrad, K. J., Conrad, K. M., Mazza, J., Riley, B. B., Stein, M. A. & Dennis, M. L. (2012). Dimensionality, Hierarchical Structure, Age Generalizability, and Criterion Validity of the GAIN’s Behavioral Complexity Scale. Psychological Assessment, 24 (4): 913-924.
Dörnyei, Z. (2003). Attitudes, Orientations, and Motivation in Language Learning: Advances In Theory, Research, and Applications. Language Learning, 53: 3-32. doi:10.1111/1467-9922.53222
Embretson, S. E. & Reise, S. P. (2000). Item Response Theory for Psychologists. Mahwah, New Jersey: Lawrence Erlbaum Associates.
Fischer, W. P. (2007). Rating Scale Instrument Quality Criteria. Rasch Measurement Transaction, 21 (1): 1095.
Gorin, J. S. & Embretson, S. E. (2008). Item Response Theory and Rasch Models. In D. McKay (Ed.), Handbook of Research Methods in Abnormal and Clinical Psychology (pp. 271-292). Thousand Oaks, California: SAGE Publications Inc.
Haastrup, K. & Henriksen, B. (2000). Vocabulary Acquisition: Acquiring Depth Of Knowledge Through Network Building. International Journal of Applied Linguistics, 10: 221-240.
Harun Baharudin, Zawawi Ismail, Adelina Asmawi & Normala Baharuddin. (2014). TAV of Arabic Language Measurement. Mediterranean Journal of Social Sciences, 5(20): 2402-2409. doi: 10.5901/mjss.2014.v5n20p2402
Henriksen, B. (1999). Three Dimensions of Vocabulary Development. Studies In Second Language Acquisition, 21: 303-317.
Linacre, J. M. (1994). Sample Size And Item Calibration (Or Person Measure) Stability. Rasch Measurement Transactions, 7 (4): 328.
____________. (2003). Dimensionality: Contrast and Variances. Retrieved June 1st, 2018, from http://www.winstep.com/winman/principalcomponents.html
____________. (2006). A User’s Guide to Winsteps Ministeps: Rasch-Model Computer Programs. Chicago, IL: Electronic Publication.
____________. (2009). FACETS Computer Programs Version 3.66.1. Chicago: MESA Press.
Linacre, J. M. & Wright, B. D. (1994). Reasonable Mean Square Fit Values. Rasch Measurement Transactions, 8 (3):370. Retrieved June 1st, 2018, from http://www.rasch.org/rmt/rmt83.html
____________. (2007). A User’s Guide toWINSTEPS Ministeps Rasch Model Computer Programs. Chicago: MESA Press.
____________. (2012). A User’s Guide to WINSTEPS Ministeps Rasch Model Computer Programs. Chicago: MESA Press.
Lord, F. M., & Novick, M. R. (1968). Statistical Theories of Mental Test Scores. Reading, MA: Addison-Wesley.
Malaysia Ministry of Education. (2006). Almanhaj al-dirasi lil-lughah al-A’rabiah: al manhaj al-mutakamil lil-madaris al-thanawiyah. Putrajaya: Bahagian Pendidikan Islam dan Moral.
McCreary, L. L., Conrad, K. M., Conrad, K. J., Scot, C. K., Funk, R. R. & Dennis, M. L. (2013). Using the Rasch Measurement Model in Psychometric Analysis of the Family Effectiveness Measure. Nursing Research, 62(3): 149-159. doi:10.1097/NNR.0b013e31828eafe6
Milton, J. (2009). Measuring Second Language Vocabulary Acquisition. Bristol: Multilingual Matters.
Nation, I. S. P. (2001). Learning Vocabulary in Another Language. Cambridge: Cambridge University Press.
Qian, D. D. (2002). Investigating The Relationship Between Vocabulary Knowledge and Academic Reading Performances: An Assessment Perspective. Language Learning, 52(3): 513-536. doi:10.1111/1467-9922.00193
Qian, D. D. & Schedl, M. (2004). Evaluation of an In-Depth Vocabulary Knowledge Measure for Assessing Reading Performance. Language Testing, 21 (1): 28-52.
Schmitt, N. (2000). Vocabulary in Language Teaching. Cambridge: Cambridge University Press.
Siti Rahayah Ariffin. (2008). Inovasi Dalam Pengukuran dan Penilaian Pendidikan. Bangi: Fakulti Pendidikan, Universiti Kebangsaan Malaysia.
Smith, E.V., Conrad, K. M., Chang, K. & Piazza, J. (2002). An Introduction to Rasch Measurement for Scale Development and Person Assessment. Journal of Nursing Measurement, 10 (3): 189-206.
Tha`imah, R.A. 1989. Taalim al arabian li ghairi an natiqin biha: Manahijuhu wa asalibuhu. Rabat: Mansyurat ISESCO.
Wesche, M. & T. S. Paribakht. (1996). Assessing Second Language Vocabulary Knowledge: Depth vs Breadth. Canadian Modern Language Review, 53: 13-39.
Wright, B. D. & Masters, G. N. (2002). Number of person or item strata. Rasch Measurement Transaction, 66: 888.
ZM Maskor, H Baharudin, MA Lubis, NK Yusuf. (2016). Teaching and Learning Arabic Vocabulary: From a Teacher’s Experiences, Creative Education, 7(03):482-490. doi: 10.4236/ce.2016.73049
ZM Maskor, H Baharudin, MA Lubis. (2018). Measurement Validity And Reliability Of The Productive Vocabulary Knowledge Instrument For Arabic Learners In Malaysian Secondary Schools, Advanced Science Letter, 24(5): 3423-3426. doi: https://doi.org/10.1166/asl.2018.11-40
GJAT provides immediate open access to its content on the principle that making research freely available to the public supports a greater global exchange of knowledge.
