Evaluation in Action: Interviews with Expert Evaluators

Description

Evaluation in Action:Interviews With Expert Evaluatorsis the first book to go behind the scenes of real evaluations to explore the issues faced--and the decisions made--by notable evaluators in the field. Drawing from the popular "Exemplars" section in theAmerican Journal of Evaluation (AJE),the book's twelve interviews with evaluators illustrate a variety of evaluation practices in different settings and include commentary and analysis on what the interviews teach about evaluation practice. Praise for Evaluation in Action "Evaluation in Action: Interviews With Expert Evaluatorsis a "must" read for those who want to know how evaluations really take place." --Marvin C. Alkin,Universityof California, Los Angeles "This book offers a rare opportunity to glimpse the assumptions, values, logic, and reasoning behind evaluator choices. It models the reflection required of good practice. The interviews are accessible and engaging, like being invited to a conversation over coffee--a tribute to the power of storytelling. They drew me in and made me want to join the discussion and ask even more questions. The section on cultural competence in evaluation is a particularly significant contribution to the knowledge base of our field. --Karen Kirkhart,SyracuseUniversity, former President of American Evaluation Association "This book is unique in the breadth of evaluation types and settings covered and the interview format provides a personal, in-depth picture of the evaluator's thinking. I'm excited about using it with my students." --Katye M. Perry,OklahomaState University, former Chair of the Topical Interest Group on Teaching of Evaluation This book fills a major gap in evaluation literature. In addition to the cases, the introductory chapter is a masterful distillation of key issues in evaluation, while the last two chapters provide a concise analysis of the interaction of evaluation theory and practice. --Leslie Cooksy,Universityof Delaware "A fresh and insightful glimpse into the deliberations and choices made by practicing evaluators. The questions asked of the evaluators are right on target and give students of evaluation, whether they are in the classroom or on the job, solid guidance on navigating around the dilemmas that arise when dealing with stakeholders and with sticky ethical challenges. This text fills a need in training evaluators not met by current textboooks." --Kathryn E. Newcomer,GeorgeWashington University Title Page......Page 3 Copyright......Page 4 Contents......Page 6 Dedication......Page 10 Preface......Page 11 1. Evaluation and Its Practice: Some Key Considerations and Choices......Page 14 Beyond Definitions: Important Distinctions About Evaluation......Page 15 References......Page 23 PART I: Traditional Evaluations: Evaluations With the Primary Purpose of Judging Merit and Worth......Page 25 2. The Evaluation of GAIN: AWelfare-to-Work Program in California: An Interview With James A. Riccio......Page 27 Summary of the GAIN Evaluation......Page 29 Dialogue With James A. Riccio......Page 32 References......Page 41 3. Evaluation of the Natural Resources Leadership Program, 1995 Through 1998: An InterviewWith Jennifer C. Greene......Page 43 Summary of the Evaluation......Page 45 Dialogue With Jennifer Greene......Page 48 References......Page 59 4. The Evaluation of the Ft. Bragg and Stark County Systems of Care for Children and Adolescents: An Interview With Len Bickman......Page 61 Summary of the Ft. Bragg and Stark County Evaluations......Page 62 Dialogue With Len Bickman......Page 64 Discussion Questions......Page 75 References......Page 76 PART II: Evaluations With a Focus on Description......Page 78 5. The Evaluation of the Stanford Teacher Education Program (STEP): An Interview With David Fetterman......Page 81 Summary of the STEP Evaluation......Page 82 Dialogue With David Fetterman......Page 85 Discussion Questions......Page 102 References......Page 103 6. The Evaluation of the Homeless Families Program: An Interview With Debra J. Rog......Page 104 A Summary of the Evaluation of the Homeless Families Program......Page 106 Dialogue With Debra J. Rog......Page 109 Discussion Questions......Page 121 References......Page 122 7. The Council for School Performance: Performance Reports for Georgia Schools: An Interview With Gary T. Henry......Page 124 A Summary of the Performance Reports for Georgia Schools......Page 126 Dialogue With Gary T. Henry......Page 128 Discussion Questions......Page 137 References......Page 138 PART III: Evaluations With an Emphasis on Program Planning and Organizational Development......Page 139 8. Evaluation of the Special Education Program at the Anoka-Hennepin School District: An Interview With Jean A. King......Page 142 Summary of the Evaluation of the Special Education Program at the Anoka-Hennepin School District #11......Page 143 Dialogue With Jean A. King......Page 145 Reference......Page 160 9. Evaluation of theWork and Health Initiative With a Focus onWinning New Jobs: An Interview With Stewart I. Donaldson......Page 162 Summary of the Evaluation of the Work and Health Initiative......Page 164 Dialogue With Stewart Donaldson......Page 170 References......Page 188 10. Developing an Evaluation System for the Corporate Education Development and Training (CEDT) Department at Sandia National Laboratories: An Interview With Hallie Preskill......Page 190 Summary of the Development of an Evaluation System for the Corporate Education Development and Training (CEDT) Department at Sandia National Laboratories......Page 192 Dialogue With Hallie Preskill......Page 194 References......Page 203 11. Evaluation of the Colorado Healthy Communities Initiative: An Interview With Ross Conner......Page 205 Summary of the Evaluation of the Colorado Healthy Communities Initiative......Page 207 Dialogue With Ross Conner......Page 212 Discussion Questions......Page 222 References......Page 223 PART IV: Evaluations Concerning Cultural Competence......Page 224 12. Evaluation of the FunWith Books Program: An Interview With Katrina Bledsoe......Page 227 Summary of the Evaluation of the Fun With Books Program......Page 228 Dialogue With Katrina Bledsoe......Page 231 Discussion Questions......Page 243 References......Page 244 13. Evaluation of Godfrey’s Children Center in Tanzania: An Interview With AllanWallis and Victor Dukay......Page 246 Summary of the Evaluation of Godfrey’s Children Center......Page 248 Dialogue With Victor Dukay and Allan Wallis......Page 251 Discussion Questions......Page 264 References......Page 265 PART V: Analysis, Interpretations, and Conclusions......Page 266 14. Exemplars’ Choices:What Do These Cases Tell Us About Practice?......Page 267 Choices Concerning One’s Role in an Evaluation......Page 268 Choices Concerning the Issues or Questions the Evaluation Will Address......Page 273 Choices Concerning Interactions With and Involvement of Stakeholders......Page 276 Choices in Methodology......Page 279 Choices Concerning Use and Dissemination of Results......Page 286 Lessons Learned for the Practice of Evaluation......Page 288 References......Page 291 The Call for Research on Evaluation......Page 292 Exemplar Interview Comparative Analysis: Insights Regarding Conceptual Notions of Evaluation Practice......Page 293 Evaluation Methods......Page 306 Evaluation Use......Page 312 Concluding Thoughts and Limitations of the Analysis......Page 315 References......Page 317 Appendix: Other Categories for the Interviews......Page 320 Index......Page 322 About the Authors......Page 342