Item Overexposure in Computerized Classification Tests Using Sequential Item Selection
DOI
https://doi.org/10.7275/nr1c-yv82
Abstract
Computerized classification tests (CCTs) often use sequential item selection which administers items according to maximizing psychometric information at a cut point demarcating passing and failing scores. This paper illustrates why this method of item selection leads to the overexposure of a significant number of items, and the performances of three different methods for controlling maximum item exposure rates in CCTs are compared. Specifically, the Sympson-Hetter, restricted, and item eligibility methods are examined in two studies realistically simulating different types of CCTs and are evaluated based upon criteria including classification accuracy, the number of items exceeding the desired maximum exposure rate, and test overlap. The pros and cons of each method are discussed from a practical perspective. Accessed 5,558 times on https://pareonline.net from June 06, 2012 to December 31, 2019. For downloads from January 1, 2020 forward, please click on the PlumX Metrics link to the right.
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Recommended Citation
Huebner, Alan
(2019)
"Item Overexposure in Computerized Classification Tests Using Sequential Item Selection,"
Practical Assessment, Research, and Evaluation: Vol. 17, Article 12.
DOI: https://doi.org/10.7275/nr1c-yv82
Available at:
https://scholarworks.umass.edu/pare/vol17/iss1/12