Macro- and Micro-Validation: Beyond the ‘Five Sources’ Framework for Classifying Validation Evidence and Analysis
DOI
https://doi.org/10.7275/f75k-1y75
Abstract
This paper argues that the dominant framework for conceptualizing validation evidence and analysis – the 'five sources'framework from the 1999 Standards – is seriously limited. Its limitation raises a significant barrier to understanding the nature of comprehensive validation, and this presents a significant threat to effective validation practice. Motivated by a belief that 'validity by design' ought to be substantiated through 'validation of design' this paper demonstrates the importance of adopting a broader conceptual framework. It introduces a new framework, based upon the metaphor of different validation lenses through which to scrutinize assessment procedures at differing levels of detail, with micro-validation lenses at one end of a continuum and macro-validation lenses at the other. The evolution of validation theory can be seen as a very gradual, if somewhat reluctant, acknowledgement of the importance of micro-validation. This paper recommends micro-validation as the natural foundation for any comprehensive validation program. Accessed 4,156 times on https://pareonline.net from December 07, 2016 to December 31, 2019. For downloads from January 1, 2020 forward, please click on the PlumX Metrics link to the right.
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Recommended Citation
Newton, Paul E.
(2019)
"Macro- and Micro-Validation: Beyond the ‘Five Sources’ Framework for Classifying Validation Evidence and Analysis,"
Practical Assessment, Research, and Evaluation: Vol. 21, Article 12.
DOI: https://doi.org/10.7275/f75k-1y75
Available at:
https://scholarworks.umass.edu/pare/vol21/iss1/12