"This paper presents comparative learning from the evaluation of six international development initiatives that applied various forms of Process Tracing. While these initiatives span across diverse contexts and pursued different aims, they are connected by a common thread: all six case studies centr
...
e around efforts to influence others - often decision makers and those in power - around aspects such as practices of consultation and inclusion; public policy; and resource allocation. The paper is organized in the following manner. We first explain Process Tracing and review common definitions. Secondly, we consider the potential value added of an explicitly Bayesian approach to Process Tracing. Next, we discuss the six cases where Process Tracing was applied, noting similarities and differences. Then, we explore key practical learning emerging from the cases and insights from the use of different forms of Process Tracing across different programming contexts. These reflections are organized under four meta-themes of participation, Theory of Change, methodological decisions, and mitigating bias. Finally, we present our key recommendations, ending with practical tips, targeted at practitioners and evaluators interested in applying Process Tracing, especially for initiatives falling under the ‘influencing’ umbrella." (Introduction)
more
"This guide is meant to serve as a practical resource for funders who want to understand where to start. Informed by feedback from our network, it represents a synthesis of the past seven years of work we’ve done in the impact space, and includes examples of successful media impact evaluation, too
...
ls and frameworks for assessment, and the challenges of defining and measuring impact in a rapidly-shifting media landscape. Our years of research have led us to four key insights: 1. There are many different frameworks for measuring media impact for different areas of practice. 2. Funders should be mindful of power dynamics, and thoughtful in determining appropriate impact strategies with their grantees. 3. Digital analytics tools provide a wealth of useful data, but grantees require financial and logistical support in implementing them. 4. There are opportunities for funders to collaborate with each other to share best practices and increase collective impact." (Executive summary)
more
"This text provides a solid foundation in program evaluation, covering the main components of evaluating agencies and their programs, how best to address those components, and the procedures to follow when conducting evaluations. Different models and approaches are paired with practical techniques,
...
such as how to plan an interview to collect qualitative data and how to use statistical analyses to report results. In every chapter, case studies provide real world examples of evaluations broken down into the main elements of program evaluation: the needs that led to the program, the implementation of program plans, the people connected to the program, unexpected side effects, the role of evaluators in improving programs, the results, and the factors behind the results. In addition, the story of one of the evaluators involved in each case study is presented to show the human side of evaluation." (Publisher description)
more
"Risky sexual behaviors are associated with the transmission of sexually transmitted infections (STIs) and unwanted pregnancies, both major health concerns for youth worldwide.This review studies the effectiveness of narrated mass media programs in promoting safer sexual practices among youth in dev
...
eloped and developing countries." (Abstract)
more
"Managing Outcomes is its generous contribution to our community, building on over ten years of experience with Outcome Mapping (OM). AGEH have taken the tools and principles of Outcome Mapping and adapted them to their institutional context, using the elements that work best for them, and offering
...
a number of different tools to complement the original OM tools. While AGEH have developed this approach for their own projects and those of their partner organisations, Managing Outcomes offers an opportunity for learning and discussion for the Outcome Mapping Learning Community. In particular, Managing Outcomes includes a section on situation analysis which helps lay a clear foundation for project planning and it provides a detailed guide for monitoring, reflection and self-evaluation. Through these additions, AGEH has distilled many practices and innovations in planning, monitoring and evaluation that have arisen since Outcome Mapping was first developed." (Foreword, page iv)
more
"This guide is about more than just tools and resources, it’s about building community. As with the process of evaluation, we saw an opportunity to learn about how impact happens and to track how films are catalysing social change. That’s the impetus behind the case studies that make up our Impa
...
ct Library. We believe that sharing stories of change is inspiring and empowering. This guide is an opportunity for us to learn from each other, to pass on knowledge and equip others in the field." (Chapter 6.7: Wrapping Up)
more
"The 3+5 framework consists of three core RBM principles plus five supporting principles. Each principle has an associated set of standards that capture the essential elements of RBM for generating and using results information. The primary focus of the 3+5 framework is to enhance the availability o
...
f results information and to manage adaptively through continuous learning. The 3+5 framework helps UNFPA and its partners to assess their status in terms of results-based management and to identify areas for improvement. The RBM standards are assessed on a four-point scale that is intended to provide a rating of the extent to which the RBM standard has been met." (Page 2)
more
"Evaluation: A Systematic Approach is the best-selling comprehensive introduction to the field of program evaluation, covering the range of evaluation research activities used in appraising the design, implementation, effectiveness, and efficiency of social programs. Evaluation domains are presented
...
in a coherent framework that not only explores each, but recognizes their interrelationships, their role in improving social programs and the outcomes they are designed to affect, and their embeddedness in social and political context. Relied on as the “gold standard” by professors, students, and practitioners for 40 years, the new Eighth Edition includes a new practical chapter on planning an evaluation, entirely new examples throughout, and a major re-organization of the book’s content to better serve the needs of program evaluation courses." (Publisher description)
more
"El objetivo de esta guía va más allá de presentar herramientas y recursos, pretende crear comunidad. Igual que sucede con el proceso de evaluación, vimos una oportunidad para aprender cómo se produce el impacto y hacer un seguimiento de cómo las películas están catalizando el cambio social.
...
De aquí nacen los casos prácticos que forman nuestra Biblioteca del Impacto. Creemos que compartir historias de cambio nos inspira y empodera. Esta guía es una oportunidad para aprender los unos de los otros, para compartir conocimiento y ayudar a otros que trabajan en el mismo ámbito." (5.7: Para terminar)
more
"Nós oferecemos ideias e abordagens para que você não tenha que lidar com um obstáculo que alguém já ultrapassou e, com isso, concentrar-se nos desafios próprios de seu projeto. Disponibilizamos todas as nossas colaborações, conversas, acordos e desentendimentos com equipes de filmagem incr
...
ivelmente inteligentes, financiadores e parceiros de todo o mundo. Nesta introdução, nós oferecemos fundamentos práticos e teóricos para que as coisas aconteçam. Pense, por um momento, em como a arte inspira mudança. Conheça vários estudos de caso em profundidade, apresentados em todo o guia. Nós podemos te mostrar mais, mais a fundo, tudo em nossa Biblioteca. Nós recomendamos que se conheça o máximo possível - particularmente sobre filmes e campanhas similares ao seu trabalho." (Introdução)
more
"Beginning in 2002, working closely with co-evaluators and commissioners of evaluations, the author developed Outcome Harvesting to enable evaluators, grant makers, and managers to identify, formulate, verify, and make sense of changes that interventions have influenced in a broad range of cuttingâ
...
€“edge innovation and development projects and programs around the world. Over these years, he led Outcome Harvesting evaluative exercises involving almost 500 non-governmental organizations, networks, government agencies, funding agencies, community-based organizations, research institutes and university programs. In over fifty evaluations, with forty co-evaluators he has harvested thousands of outcomes on six continents. Outcome Harvesting has proven useful in evaluations of a great diversity of initiatives: human rights advocacy, political, economic and environmental advocacy, arts and culture, health systems, information and communication technology, conflict and peace, water and sanitation, taxonomy for development, violence against women, rural development, organic agriculture, participatory democracy, waste management, public sector reform, good governance, eLearning, social accountability, and business competition, amongst others. In this book, the author explains the steps of Outcome Harvesting and how to customize them according to the nine underlying principles. He shares his experience and gives practical advice on how to work with Outcome Harvesting and remain true to its essential features." (Back cover)
more
"Process-tracing in social science is a method for studying causal mechanisms linking causes with outcomes. This enables the researcher to make strong inferences about how a cause (or set of causes) contributes to producing an outcome. In this extensively revised and updated edition, Derek Beach and
...
Rasmus Brun Pedersen introduce a refined definition of process-tracing, differentiating it into four distinct variants and explaining the applications and limitations of each. The authors develop the underlying logic of process-tracing, including how one should understand causal mechanisms and how Bayesian logic enables strong within-case inferences. They provide instructions for identifying the variant of process-tracing most appropriate for the research question at hand and a set of guidelines for each stage of the research process." (Publisher description)
more
"An impact grid is a tool that helps stakeholders involved in a development intervention to analyse multiple changes by mapping those changes onto a grid. A typical grid charts the extent of change alongside the degree of contribution of the intervention. Impact grids can be used for many different
...
purposes. They are only normally used after enough time has elapsed for changes to emerge." (Introduction)
more
"The Most Significant Change (MSC) technique is a form of participatory monitoring and evaluation. It involves the collection and selection of stories of change, produced by programme or project stakeholders. MSC can be used in projects and programmes where it is not possible to precisely predict de
...
sired changes beforehand, and is therefore difficult to set pre-defined indicators of change." (Introduction)
more
"In a Randomised Control Trial (RCT) different units are randomly assigned to separate groups. One group receives a development intervention and the other does not. Changes in the two groups over time are then compared to accurately measure the effect of the intervention. RCTs have been much debated
...
over the past 10 years. Some see them as the ‘gold standard’ for impact assessment." (Introduction)
more