Score Reporting Research And Applications

Description

Score reporting research is no longer limited to the psychometric properties of scores and subscores. Today, it encompasses design and evaluation for particular audiences, appropriate use of assessment outcomes, the utility and cognitive affordances of graphical representations, interactive report systems, and more. By studying how audiences understand the intended messages conveyed by score reports, researchers and industry professionals can develop more effective mechanisms for interpreting and using assessment data. Score Reporting Research and Applications brings together experts who design and evaluate score reports in both K-12 and higher education contexts and who conduct foundational research in related areas. The first section covers foundational validity issues in the use and interpretation of test scores; design principles drawn from related areas including cognitive science, human-computer interaction, and data visualization; and research on presenting specific types of assessment information to various audiences. The second section presents real-world applications of score report design and evaluation and of the presentation of assessment information. Across ten chapters, this volume offers a comprehensive overview of new techniques and possibilities in score reporting. Cover......Page 1 Title......Page 4 Copyright......Page 5 Contents......Page 6 Contributors......Page 8 Foreword......Page 15 Acknowledgments......Page 17 Introduction: Why Is Score Reporting Relevant?......Page 18 Part I: Foundational Work......Page 24 1. Validity Aspects of Score Reporting......Page 26 2. Advances in Cognitive Science and Information Visualization......Page 36 3. Subscores: When to Communicate Them, What Are Their Alternatives, and Some Recommendations......Page 52 4. Reporting Student Growth: Challenges and Opportunities......Page 67 5. Communicating Measurement Error Information to Teachers and Parents......Page 80 Part II: Practical Applications......Page 92 6. Score Reporting Issues for Licensure, Certification, and Admissions Programs......Page 94 7. Score Reports for Large-scale Testing Programs: Managing the Design Process......Page 108 8. Effective Reporting for Formative Assessment: The asTTle Case Example......Page 124 9. Applying Learning Analytics to Support Instruction......Page 143 10. Evaluating Students’ Interpretation of Feedback in Interactive Dashboards......Page 162 Index......Page 177