"This first guidance note, Introduction to Impact Evaluation, provides an overview of impact evaluation, explaining how impact evaluation differs from – and complements – other types of evaluation, why impact evaluation should be done, when and by whom. It describes different methods, approaches and designs that can be used for the different aspects of impact evaluation: clarifying values for the evaluation, developing a theory of how the intervention is understood to work, measuring or describing impacts and other important variables, explaining why impacts have occurred, synthesizing results, and reporting and supporting use. The note discusses what is considered good impact evaluation – evaluation that achieves a balance between the competing imperatives of being useful, rigorous, ethical and practical – and how to achieve this. Footnotes throughout the document contain references for further reading in specific areas." (Introduction, p.1)
Contents
1 What Do We Mean by “Impact Evaluation”? 2
2 Why Should We Do Impact Evaluation? 3
3 What Questions Does Impact Evaluation Seek to Answer? 3
4 Who Should Conduct Impact Evaluation? 3
5 How Should We Choose Methods for Impact Evaluation? 5
6 Clarifying Values for an Impact Evaluation, 5
7 Developing a Theory or Model of How the Intervention is Supposed to Work, 6
8 Measuring or Describing Impacts (and other Important Variables), 8
9 Explaining to What Extent Observed Results Have Been Produced by the Intervention, 9
10 Synthesizing Evidence, 12
11 Reporting Findings and Supporting Use, 13
12 When Should an Impact Evaluation Be Done? 13
13 What Is Needed for Quality Impact Evaluation? 14
14 Common Challenges in Impact Evaluation in Development, 15
Summary, 17