Determining Item Screening Criteria Using Cost-Benefit Analysis

Authors

Bozhidar M. Bashkov
Jerome C. Clauser

DOI

https://doi.org/10.7275/xsqm-8839

Abstract

Successful testing programs rely on high-quality test items to produce reliable scores and defensible exams. However, determining what statistical screening criteria are most appropriate to support these goals can be daunting. This study describes and demonstrates cost-benefit analysis as an empirical approach to determining appropriate screening criteria for a given testing program and purpose. Using a certification exam’s item pool and simulation we illustrate how to examine a wide range of screening criteria and reach an acceptable balance between the number of items screened out (cost) and pass/fail classification accuracy (benefit). Accessed 699 times on https://pareonline.net from April 09, 2019 to December 31, 2019. For downloads from January 1, 2020 forward, please click on the PlumX Metrics link to the right.

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.

Recommended Citation

Bashkov, Bozhidar M. and Clauser, Jerome C. (2019) "Determining Item Screening Criteria Using Cost-Benefit Analysis," Practical Assessment, Research, and Evaluation: Vol. 24, Article 2.
DOI: https://doi.org/10.7275/xsqm-8839
Available at: https://scholarworks.umass.edu/pare/vol24/iss1/2