The argument-based validation of a large-scale high-stakes vocabulary test

Authors

Elaheh Rafatbakhsh, Shiraz UniversityFollow
Alireza Ahmadi, Shiraz UniversityFollow

DOI

https://doi.org/10.7275/pare.1322

Abstract

The purpose of this study was to investigate the validity of the vocabulary subsection of a high-stakes university entrance exam for PhD programs using the argument-based approach. All the three different versions of the test administered in a period of five years and the responses of 12500 test-takers were studied. The study focused on four inferences of domain definition, evaluation, generalization and explanation mainly using corpus linguistics, the Rash measurement model and factor analysis. The results indicated substantial threats to the validity of the test in terms of vocabulary choice, item difficulty, item discrimination, construct representation, and reliability.

Recommended Citation

Rafatbakhsh, Elaheh and Ahmadi, Alireza (2022) "The argument-based validation of a large-scale high-stakes vocabulary test," Practical Assessment, Research, and Evaluation: Vol. 27, Article 28.
DOI: https://doi.org/10.7275/pare.1322
Available at: https://scholarworks.umass.edu/pare/vol27/iss1/28