"This book offers an accessible introduction to the topic of impact evaluation and its practice in development. It provides practical guidelines for designing and implementing impact evaluations, along with a nontechnical overview of impact evaluation methods .. The approach to impact evaluation in this book is largely intuitive. We have tried to minimize technical notation. The methods are drawn directly from applied research in the social sciences and share many commonalities with research methods used in the natural sciences. In this sense, impact evaluation brings the empirical research tools widely used in economics and other social sciences together with the operational and political economy realities of policy implementation and development practice. Our approach to impact evaluation is also pragmatic: we think that the most appropriate methods should be identified to fit the operational context, and not the other way around. This is best achieved at the outset of a program, through the design of prospective impact evaluations that are built into project implementation. We argue that gaining consensus among key stakeholders and identifying an evaluation design that fits the political believe that impact evaluations should be candid about their limitations and caveats. Finally, we strongly encourage policy makers and program managers to consider impact evaluations as part of a well-developed theory of change that clearly sets out the causal pathways by which a program works to produce outputs and influence final outcomes, and we encourage them to combine impact evaluations with monitoring and complementary evaluation approaches to gain a full picture of results." (Preface)
Contents
I. INTRODUCTION TO IMPACT EVALUATION
1 Why Evaluate? 3
2 Preparing for an Evaluation, 31
II. HOW TO EVALUATE
3 Causal Inference and Counterfactuals, 47
4 Randomized Assignment, 63
5 Instrumental Variables, 89
6 Regression Discontinuity Design, 113
7 Difference-in-Differences, 129
8 Matching, 143
9 Addressing Methodological Challenges, 159
10 Evaluating Multifaceted Programs, 175
III. HOW TO IMPLEMENT AN IMPACT EVALUATION
11 Choosing an Impact Evaluation Method, 187
12 Managing an Impact Evaluation, 201
13 The Ethics and Science of Impact Evaluation, 231
14 Disseminating Results and Achieving Policy Impact, 247
IV. HOW TO GET DATA FOR AN IMPACT EVALUATION
15 Choosing a Sample, 261
16 Finding Adequate Sources of Data, 291
17 Conclusion, 319
Checklist: Core Elements of a Well-Designed Impact Evaluation, 320
Checklist: Tips to Mitigate Common Risks in Conducting an Impact Evaluation, 320