Off-campus UMass Amherst users: To download dissertations, please use the following link to log into our proxy server with your UMass Amherst user name and password.

Non-UMass Amherst users, please click the view more button below to purchase a copy of this dissertation from Proquest.

(Some titles may also be available free of charge in our Open Access Dissertation Collection, so please check there first.)

Score reporting in teacher certification testing: A review, design, and interview/focus group study

Heather S Klesch, University of Massachusetts Amherst

Abstract

The reporting of scores on educational tests is at times misunderstood, misinterpreted, and potentially confusing to examinees and other stakeholders who may need to interpret test scores. In reporting test results to examinees, there is a need for clarity in the message communicated. As pressure rises for students to demonstrate performance at a certain level, the communication of scores to the public needs to be examined. Although public school student testing often is placed in the spotlight, this study examines score reporting in teacher certification, which may not have the same complexities of student test score reporting, but does have the equally critical need to effectively communicate scoring information. The purpose of this study was to create multiple teacher certification examinee score reports based on findings in the literature on educational test score reporting, as well as marketing and design principles, and to conduct interviews and focus groups to gather feedback on the comprehension and preferences in interpreting the designed score reports and results. Different approaches for reporting test scores were used to design the score reporting materials for a hypothetical teacher certification testing examinee who had not passed. Educators and educational testing professionals were convened and interviewed to review the score reports and offer feedback, suggestions and discussion. The findings are covered in great detail. Using the findings, a final model score report was designed, which was then reviewed with doctoral students in educational measurement. Through this process, some clear patterns and differences arose. Overall, there was a desire on the educator and doctoral student end to provide as much information as possible, where supported by sound measurement principles. The reporting of raw performance information, as well as accommodating comprehension styles by providing performance information in contextual, statistical and visual ways were requested. Upon addressing these requests, two areas that may not have full clarity and direction remained: The process of converting raw score performance to a scaled score (participants wanted more information on this process), and information provided that could address candidate weak areas, directing examinees to materials that could improve their studies, understanding, and examination performance.

Subject Area

Educational tests & measurements|Educational evaluation

Recommended Citation

Klesch, Heather S, "Score reporting in teacher certification testing: A review, design, and interview/focus group study" (2010). Doctoral Dissertations Available from Proquest. AAI3409610.
https://scholarworks.umass.edu/dissertations/AAI3409610

Share

COinS