Methods of the Policy Process

Description

The increasingly global study of policy processes faces challenges with scholars applying theories in radically different national and cultural contexts. Questions frequently arise about how to conduct policy process research comparatively and among this global community of scholars. Methods of the Policy Process is the first book to remedy this situation, not by establishing an orthodoxy or imposing upon the policy process community a rigid way of conducting research but, instead, by allowing the leading researchers in the different theoretical traditions a space to share the means by which they put their research into action. This edited volume serves as a companion volume and supplemental guide to the well-established Theories of the Policy Process, 4th Edition. Methods of the Policy Process acknowledges that growth and advancement in the study of the policy process is dependent not merely on conceptual and theoretical development, but also on developing and systematizing better methodological approaches to measurement and analysis. To maximize student engagement with the material, each chapter follows a similar framework: introduction of a given theory of the policy process, application of that theory (including best practices for research design, conceptualization, major data sources, data collection, and methodological approaches), critical assessment, future directions, and often online resources (including datasets, survey instruments, and interview and coding protocols). While the structure and focus of each chapter varies slightly according to the theoretical tradition being discussed, each chapter's central aim is to prepare readers to confidently undertake common methodological strategies themselves. Methods of the Policy Process is especially beneficial to people new to the field, including students enrolled in policy process courses, as well as those without access to formal training. For scholars experienced in applying theories, this edited volume is a helpful reference to clarify best practices in research methods. Cover Endorsement Half Title Title Page Copyright Page Table of Contents Figures Tables Contributors 1 The Design of Policy Process Research Introduction Why This Book and Why Now? The Approaches and Data Science How Does This Book Relate to the Theories Book? Methods in the Context of Theory Research Programs and Culture Roadmap for Reasoning Research Questions and Scope Research Design as Comparison Measurement Choosing Indicators and Measures Validity and Reliability Tools of Analysis Descriptive Versus Causal Inference Dependence and Endogeneity Visualizing Data Up Ahead Notes References 2 How to Conduct a Multiple Streams Study Introduction From Theory to Application: Steps to a Solid MSF Analysis Develop Your Research Question(s) Specify MSF Hypotheses Operationalization Issues The Problem Stream The Policy Stream The Political Stream Policy Window Policy Entrepreneurs and Coupling Choose the Method That Best Matches Your Research Interest Qualitative MSF Research Quantitative MSF Research The Way Forward to Empirically Sound MSF Studies References Annex A: MSF Case Study Protocol Template Annex B: Sample Interview Questions for Designs Over Time and Single Issue/Sector – Past 3 The Code and Craft of Punctuated Equilibrium Introduction Chapter Roadmap Four Persistent Themes Text-as-Data Comparability Across Time and Space Collaboration With Machines Attention to Distributions of Change The Measurement System Conceptual Logic How to Compile a Data Set Descriptive Inference Describing Empirical Distributions Recipe for Comparison Examples of the Distributional Approach Agenda Composition and Diversity Theory Development and Testing Feedback, Positive and Negative Institutional Friction Issue Complexity The Politics of Search Future Directions Methodological Approaches Data and Classification References 4 Methods for Applying Policy Feedback Theory Introduction Conceptualizing and Designing Policy Feedback Research Unit of Analysis Resource and Interpretive Effects Contextual Effects Insights On Conceptualizing Policy Feedback Challenges Conducting Policy Feedback Research Capturing Causal Effects Data Limitations Scope and Perspective Strategies for Empirical Analysis Historical Analysis Interviews and Ethnography Quantitative Analysis Experiments and Quasi-Experiments Multiple Methods Future Directions for Policy Feedback Methods Notes References 5 Advocacy Coalition Framework: Advice On Applications and Methods Introduction Conceptual Overview Cross-cutting Concepts Policy Subsystem Topical Scope Geographic Scope Policy Actors Belief Systems A Hierarchical Model of Beliefs Three Meta-Theoretical Key Concepts Advocacy Coalitions Shared Beliefs Coordination Coalition Resources and Strategies Research Foci and Challenges in the Study of Coalitions Policy Change Type of Public Policy and Policy Venue Minor–Major Policy Change Research Foci and Challenges in the Study of Policy Change Learning Processes of Learning Outcomes of Learning Research Foci and the Challenges of Learning Research in ACF Conclusion Notes References 6 Conducting Narrative Policy Framework Research: From Theory to Methods Introduction Deciding If the NPF Is the Right Framework for Your Research Crafting NPF Research Question(s) Determining Level of Analysis: Micro, Meso, Or Macro Articulating NPF Hypotheses and Expectations Specifying Your Model: Operationalizing NPF Concepts The Policy Narrative Policy Narrative Form Setting Characters Plot Moral of the Story Policy Narrative Content Beliefs and Strategies Narrativity: Form + Content Research Designs Experimental Designs Nonexperimental Designs Research Methods Survey Methods Content Analysis The Codebook Census vs. Sample Unit of Coding Analysis Human vs. Automated Coding Use Independent Human Coders Reliability Testing Coding Visual Narratives Interviews and Focus Groups Policy Narrative Data Micro-Level Narrative Data Meso-Level Narrative Data Macro-Level Narrative Data Analyzing Narrative Data What Analytic Technique to Use? Descriptive Statistics Relational Statistics, Differences of Means, and Predictive Tools Network Analysis Big Data Analytics? Future NPF Research Notes References Appendix A Appendix B 7 Innovation and Diffusion: Connecting Theory and Method Introduction Common Quantitative Approaches Assessing the Impact of Diffusion Mechanisms Assessing the Impact of Diffusion Vectors Overlooked Forms of Interdependence Moving Forward Notes References 8 Methods for Analyzing Social Dilemmas and Institutional Arrangements Within the Institutional Analysis and Development ... Introduction Methods Case Studies Lab and Field Experiments ABM Network Analysis Methods Summary Moving Institutional Analysis Forward Conclusion References 9 Methodological Approaches to the Ecology of Games Framework Introduction Key Concepts in the EGF Key Considerations in Research Design Selecting the System Identifying System Components and Boundaries Longitudinal Analysis Data Collection and Measurement Collecting Data for Qualitative Analysis Participant Observation Key Informant Interviews Document and Archival Analysis Collecting Data for Quantitative Analysis Surveys Natural Language Processing: Text as Data Data Analysis Methods Qualitative Methods Case Study Analysis Coding and Analysis of Interviews Quantitative Methods Generalized Linear Models Addressing Interdependence Through Clustered Standard Errors Addressing Interdependence Through Multilevel Modeling Network Analysis Governance Networks Multilevel Networks Exponential Random Graph Models (ERGMs) Agent-Based and Computational Models Conclusions: Future Directions in Ecology of Games Research References 10 The Evaluation and Advancement of Policy Process Research Introduction Summarizing Methods Across the Theories Scientific Principles for Contributing Knowledge to Policy Process Research How Can We Better Our Science? Bring Ourselves Into Our Research and Our Art Into Our Science Notes References Index