"The aim of this paper is to provide guidance on the evaluation of complex interventions in international development. Our contribution to the literature is threefold. First, unlike other reviews on the same subject, our focus is exclusively directed to evaluations of development interventions. Seco
...
nd, we identify methods that are new or little used in the evaluation literature. Third, we map methods to project types with the aim of identifying methods that are useful to the evaluation of particular projects.
We start by making a distinction between complex interventions and complex systems. While much recent research has been devoted to understanding how interventions can be implemented and understood in complex systems, our interest rests primarily with the goal of understanding and evaluating complex interventions. We therefore abstract from complexities arising from the interaction between interventions and complex systems. In our framework, complex interventions can be implemented in simple as well as in complex systems, but the latter are not the primary focus of our paper. Removing the consideration of interactions between interventions and complex systems reduces the scope of our review, but helps focus attention on a manageable number of issues and methods.
We define complex interventions as interventions characterised by multiple components, multiple stakeholders, or multiple target populations, or interventions incorporating multiple processes of behavioural change. These interventions cannot be represented by single-intervention or single-outcome models, and present several challenges to evaluation. Occasionally, or purposely, these interventions give rise to emergent outcomes such as non-linear effects, tipping points, and multiple equilibria. The presence of emergent outcomes of this type adds additional difficulties to evaluation because existing methods are ill-equipped to detect and estimate non-linear impacts of interventions." (Inroduction)
more
"Research has potential to improve the lives of the world’s vulnerable people – if it is appropriately referred to in decision-making processes. While there is a significant industry of activity each year to communicate research findings, little systematic research has tested or compared the eff
...
ectiveness of such efforts. One popular research communication tool is the policy brief. In this article we draw on findings from a recent study on how a policy brief works; concluding that a policy brief does not have a linear effect on its readers. Instead, a reader can take a number of alternative routes from belief to action, some of which could subvert the intended outcome of the policy brief in question. We reflect also on the question of what makes for an effective policy brief; concluding that policy briefs that give personality and form to the researcher behind the written word may invoke a deeper relationship between the reader and the author, and affect a greater inclination in the reader to share the message with someone else – that is, they pass the hot potato. The study itself was a first of its kind and contributes to our understanding about the effectiveness of research communication, as well as how to evaluate research communication effectiveness." (Abstract)
more