Measuring Student Reading Comprehension Performance: Considerations of Accuracy, Equity, and Engagement by Embedding Comprehension Items within Reading Passages
Reading comprehension is measured differently between classroom and more formal approaches to assessment. Traditional reading comprehension assessments often prompt students to read a multi-paragraph passage prior to displaying a set of questions that are related to the passage; however, this approach is not utilized during classroom practices. The study suggests that assessments may inadvertently measure extraneous constructs (e.g., working memory, attention, language, reading ability) by prompting students to answer items at the conclusion of the reading passage. The current study evaluates the effect of asking items throughout the passage (i.e., embedding items) to achieve a more precise measure of reading comprehension by removing barriers for students to demonstrate their understanding. Results showed a significant impact of embedding comprehension items within reading passages on the measurement of student achievement in comparison to answering items at the end of the passage. This may be a more valid approach to measurement of reading comprehension resulting in improved student reading comprehension scores. This approach also has the potential to become a more equitable measurement of reading comprehension by removing barriers to measurement, particularly for marginalized groups (e.g., students with disabilities, memory-load difficulties, English language learners, test anxiety).
Guerreiro, Meg; Barker, Elizabeth; and Johnson, Janice
"Measuring Student Reading Comprehension Performance: Considerations of Accuracy, Equity, and Engagement by Embedding Comprehension Items within Reading Passages,"
Practical Assessment, Research, and Evaluation: Vol. 27, Article 11.
Available at: https://scholarworks.umass.edu/pare/vol27/iss1/11