Practical Issues in Estimating Classification Accuracy and Consistency with R Package cacIRT
DOI
https://doi.org/10.7275/43vm-p442
Abstract
There are two main lines of research in estimating classification accuracy (CA) and classification consistency (CC) under Item Response Theory (IRT). The R package cacIRT provides computer implementations of both approaches in an accessible and unified framework. Even with available implementations, there remains decisions a researcher faces when choosing and applying the best approach for the situation. This paper identifies and discusses the practical issues that researchers may face when estimating CA and CC. To exemplify the analytic decisions, both approaches are applied to a common dataset with discussion. In addition to generalizable guidance, the demonstration provides R code for the cacIRT package. Accessed 4,495 times on https://pareonline.net from August 28, 2015 to December 31, 2019. For downloads from January 1, 2020 forward, please click on the PlumX Metrics link to the right.
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Recommended Citation
Lathrop, Quinn
(2019)
"Practical Issues in Estimating Classification Accuracy and Consistency with R Package cacIRT,"
Practical Assessment, Research, and Evaluation: Vol. 20, Article 18.
DOI: https://doi.org/10.7275/43vm-p442
Available at:
https://scholarworks.umass.edu/pare/vol20/iss1/18