Meta–Analysis for Public Management and Policy

Meta-Analysis for Public Management and Policy is a groundbreaking book that includes a proven set of tools for making sense of mountains of sometimes inconsistent conclusions from original research. The tools of meta-analysis can help to improve scholarship, ensure more accurate tests of theories, provide clearer and more authoritative advice for policy and management, and ultimately contribute to the wider knowledge base of public management and policy and the social sciences more broadly. This important resource contains an in-depth explanation of the six-stage process for conducting a meta-analysis which consists of Scoping, Literature Search, Data Coding, Calculating and Combining Effect Sizes, Explaining Differences in Effect Sizes Across Original Studies, and Identifying Areas for Further Research. The text includes detailed explanations of the statistical approaches to meta-analysis that have been found to be most useful to researchers and practitioners in public management and policy, and offers four original meta-analyses of school vouchers, performance measurement, public housing decentralization, and public service motivation. These original studies (conducted by the author and his team) offer step-by-step templates for how to conduct a meta-analysis while also contributing original research on important issues in public management and policy. Meta-Analysis for Public Management and Policy is the hands-on resource that can help students and professionals improve the quality and the relevance of research in public management and policy.

Figures, Tables, and Exhibit ix Preface xv The Authors xxi Introducing: Meta–Analysis for Public Management and Policy 1 Evan J. Ringquist and Mary R. Anderson Introducing Meta–Analysis 4 The Institutionalization of Meta–Analysis 5 A Role for Meta–Analysis in Public Management and Policy 9 Meta–Analysis: Understanding the Basics 17 Adapting Meta–Analysis for Public Management and Policy 31 Conclusion 34 PART ONE: TECHNIQUES OF META–ANALYSIS 37 1 Conceptualizing Research and Gathering Studies 39 Evan J. Ringquist Conceptualizing a Meta–Analysis 40 Conducting a Literature Search in Meta–Analysis 50 Conclusion 66 2 Turning Studies into Data 68 Evan J. Ringquist What to Code 70 The Process of Coding 85 Conclusion 97 3 Calculating and Combining Effect Sizes 102 Evan J. Ringquist Calculating Effect Sizes 103 Fixed Effects and Random Effects Meta–Analysis 118 Combining Effect Sizes 124 Conclusion 137 4 Meta–Regression Analysis 141 Evan J. Ringquist Historical Development of Meta–Regression 142 Designing a Meta–Regression 144 Fixed Effects Meta–Regression 151 Random EffectsMeta–Regression 171 Conclusion 189 5 Advanced Meta–Regression for Public Management and Policy 191 Evan J. Ringquist Clustered Robust Estimation in Meta–Regression 193 Alternatives for Addressing Dependence in Meta–Regression 207 Conclusion 229 6 PublicationBias 231 Evan J. Ringquist Sources and Consequences of Publication Bias 232 Identifying Publication Bias 238 Remedying and Preventing Publication Bias 253 Conclusion 266 7 Meta–Analysis in Economics 268 Evan J. Ringquist The FAT–MST–PET–MRA Approach to Meta–Regression 269 Assessing the FAT as a Test for Publication Bias 272 Identifying “True” Effects Using the MST 291 Estimating the Magnitude of “True” Effects Using the PET 292 Conclusion 307 PART TWO: META–ANALYSIS IN PUBLIC MANAGEMENT AND POLICY RESEARCH 309 8 Evaluating the Effectiveness of Educational Vouchers 311 Mary R. Anderson, Tatyana Guzman and Evan J. Ringquist School Choice and Educational Vouchers 312 The Effectiveness of Educational Vouchers 318 Designing a Meta–Analysis of Voucher Effects 324 Searching the Literature 331 Data Analysis: Synthesis 335 Meta–Regression Analysis 339 Conclusion 348 Studies Coded for Meta–Analysis 349 9 Performance Management in the Public Sector 352 Ed Gerrish and Po–Ju Wu Origin of Performance Management 354 Performance Management in the Literature 359 Literature Search 368 Data Analysis: Synthesis 372 Meta–Analytic Regression Analysis 379 Conclusion 390 Studies Coded for Meta–Analysis 393 Addendum: StratifiedMeta–Regression of Compstat and Compstat–Like Programs 394 10 The Effects of Federal Poverty Deconcentration Efforts on Economic Self–Sufficiency and Problematic Behaviors 398 Joe Bolinger and Lanlan Xu History of Poverty Deconcentration Programs in the United States 399 Theoretical Foundations of Poverty Deconcentration Policies 402 Impacts of Poverty Deconcentration Policies on Individual Economic and Behavioral Life Outcomes 408 Literature Search 413 Analysis 416 Meta–Regression Analysis 426 Conclusion 436 Studies Coded for Meta–Analysis 439 11 The Relationship Between Public Service Motivation and Performance 442 David C. Warren and Li–Ting Chen The Importance of a Possible PSM–Performance Relationship 443 Theoretical Foundations of the PSM–Performance Relationship 444 Framing the Meta–Analysis of the PSM–Performance Relationship 447 Data Analysis 455 Meta–Regression Analysis 462 Conclusion 468 Studies Coded for Meta–Analysis 473 Conclusion: Meta–Analysis and the Future of Research in Public Management and Policy 475 Mary R. Anderson and Evan J. Ringquist Why Meta–Analysis? 478 Why Meta–Analysis Now? 480 Meta–Analysis for Public Management and Policy: An Adaptation 481 A World of Possibilities: The Future of Meta–Analysis in Public Management and Policy 484 Appendix: Coding Sheets 487 A1: School Vouchers 488 A2: Performance Management 494 A3: Public Housing 502 A4: Public Service Motivation 508 References 514 Name Index 543 Subject Index 549

Evan J. Ringquist is professor and director of the Ph.D. programs in Public Affairs and Public Policy in the School of Public and Environmental Affairs at Indiana University.