"As we move forward in deepening our collective understanding of how AI is reshaping our societies, and what policy models are required to best manage its effects in service of human and planetary wellbeing, information is needed on the global state of implementation of the UNESCO principles and the
...
barriers countries are facing in protecting people from risks to human rights and democratic freedoms AI may bring. This is the premise for the new Global Index on Responsible AI (Global Index)." (Page 2)
more
"The fifth edition of the AI Index Report includes data from a broad set of academic, private, and nonprofit organizations as well as more self-collected data and original analysis than any previous editions, including an expanded technical performance chapter, a new survey of robotics researchers a
...
round the world, data on global AI legislation records in 25 countries, and a new chapter with an in-depth analysis of technical AI ethics metrics." (Introduction, page 2)
more
"This book is written to provide detailed, rigorous guidance on how to conduct impact evaluations of government and nongovernment programs and projects. It covers all the leading quantitative impact evaluation methods, explaining the assumptions required for them to provide unbiased estimates and th
...
e data required to implement them. It also provides many examples of how these methods have been applied in developing economies. The book’s contents are based on lectures given by the authors, and their collaborators, as part of a two-week intensive course conducted in China, Peru, South Africa, and Uganda between 2012 and 2017. The courses in China, South Africa, and Uganda were administered and supported by the Centers for Learning on Evaluation and Results (CLEAR) Initiative, a multidonor partnership program for evaluation capacity development with its secretariat at the World Bank and centers located in universities in different parts of the world; in 2020, the program and centers became part of the Global Evaluation Initiative. The presentation of the material in this book is at a high technical level. It assumes that the reader is very comfortable with algebra and has an intermediate knowledge of statistical theory. It is essentially a graduate-level textbook for use in economics, public policy, or related academic programs, although it may also be useful for a course designed for advanced undergraduate students." (Preface)
more
"This guidance is useful for ICRC teams in the field managing different evaluation types that cover various interventions. Importantly, it is not an evaluation manual. Nor is it the only source to draw on when planning and managing an evaluation. It should be used in conjunction with other ICRC poli
...
cies, standards and guidance on which the evaluation relies. In this document, we use the term “evaluation” as a catch-all term to refer to evaluations, impact evaluations, evaluative reviews and learning workshops. Evaluations are determined by a level of objectivity and/or independence and are conducted according to clear lines of inquiry and a methodological approach (see section 3). Specifically, when we refer to an evaluation, we understand it as follows: The systematic and objective assessment of an ongoing or completed project, programme or policy, its design, implementation and results. The aim is to determine the relevance and fulfilment of objectives, developmental efficiency, effectiveness, impact and sustainability. An evaluation should provide information that is credible and useful, enabling the incorporation of lessons learnt into the decision-making process of both recipients and donors. Likewise, we use the term “intervention” to refer to the subject of the evaluation, including all the various types of work or efforts that may be evaluated (such as a project, programme, strategy, thematic area, or other activity or action). This document will also prove useful for those guiding design, strategic planning and results management at the start of the intervention. A good evaluation relies on effective monitoring, evaluation and learning systems within the intervention cycle. Gaining clarity on what success looks like at the design phase of an intervention helps to make the intervention assessable." (Page 3)
more
"This publication is based on the experiences collected over the course of 30 months while implementing participatory evaluation practices in the European funded research project CoAct. This citizen social science project's primary goal was to address social concerns such as youth employment, mental
...
healthcare, environmental justice and gender equality in the context of local citizen social science initiatives [...] With this Whitepaper, we want to raise awareness for participatory approaches towards evaluation and impact assessment in citizen social science. The six co-evaluation principles that form the core of this paper are intended to guide the participatory approach to project evaluation and to sharpen the focus for impact assessment. While these principles have been developed in the context of citizen social science activities, we believe in their wider applicability for citizen science in other domains and participatory research in general." (Introduction, page 7)
more
"This note aims to support DT Global staff and partners to: understand DT Global's adaptive management framework; assess if and what level of adaptive management is required for a program; the difference between adaptive management and good program management; and initial steps to apply adaptive man
...
agement principles and practice. Adaptive management is a response to rising critiques since the early 2000s to traditional pre-determined development programming, arguing that too often simple solutions have been applied unsuccessfully to complex problems. DT Global considers adaptive management in practice as four essential elements operating together: flexibility, responsiveness, purposive learning and an empowering culture." (Page 1)
more
"Social and behavior change (SBC) is a key component of effective multi-sectoral nutrition activities. High-quality evaluations of SBC components are essential to identifying what went well, what could have been done differently, and how to improve future program design. The tools included here acco
...
mpany Evaluating Social and Behavior Change Components of Nutrition Activities: A Design Guide for USAID Staff and Measuring Social and Behavior Change in Nutrition Programs: A Guide for Evaluators. They provide additional support on topics such as how to develop an evaluation statement of work (SOW) and how to determine the most appropriate respondent(s) for a given activity. The table below provides an overview of each tool." (Introduction, page 1)
more
"While social media offer an unprecedented opportunity for orchestrating large-scale communication campaigns, it is often difficult to track audience responses on various digital platforms over time and to ascertain if their engagement is aligned with the original intention. In this article, we shar
...
e a promising solution—the purposive embedding and tracking of unique content elements as “markers” using text analytics techniques. Four markers were introduced in an Indian melodramatic television serial, Main Kuch Bhi Kar Sakti Hoon (I, A Woman, Can Achieve Anything), which was part of a larger transmedia edutainment initiative in India to promote sanitation, family planning, and gender equality. These markers served as anchors for audience engagement with the originally intended messaging embedded in the narratives as well as for program monitoring and evaluation. We applied various web-based tools to systematically track marker-related engagement on Facebook, Twitter, and YouTube across eight months. We also conducted semantic network analysis to better understand how marker-related social media comments evolved over time. Our investigation of using markers for digital engagement and narrative exchange in MKBKSH makes an important and timely methodological contribution to the scholarship and praxis of social and behavior change communication." (Abstract)
more
"This glossary provides conceptual clarity on common terms used in results based management, monitoring and evaluation. This 2nd Edition includes new terms, as well as updates and improvements to the original Glossary published in 2002. It is intended to support thoughtful approaches to results-base
...
d management, monitoring and evaluation, which in turn support better progress on sustainable development through learning and accountability." (Page 1)
more
"Training can take different forms. It can be carried out as a one-off exercise, or can be combined with other types of support, such as coaching or mentoring. The most well-known model for monitoring and evaluating training is the Kirkpatrick model, developed in the 1950s. A number of other models
...
are also used by CSOs. Most of these are variants of the Kirkpatrick model." (Introduction)
more
"Changes arising from capacity strengthening work can sometimes be measured directly. A range of tools and methodologies can also be used to help assess capacity change. Most of these were not designed specifically with capacity strengthening in mind, but can easily be adapted for the purpose. CSOs
...
engaged in capacity strengthening work often use multiple M&E tools and methodologies in combination." (Introduction)
more
"The aim of this paper is to provide guidance on the evaluation of complex interventions in international development. Our contribution to the literature is threefold. First, unlike other reviews on the same subject, our focus is exclusively directed to evaluations of development interventions. Seco
...
nd, we identify methods that are new or little used in the evaluation literature. Third, we map methods to project types with the aim of identifying methods that are useful to the evaluation of particular projects.
We start by making a distinction between complex interventions and complex systems. While much recent research has been devoted to understanding how interventions can be implemented and understood in complex systems, our interest rests primarily with the goal of understanding and evaluating complex interventions. We therefore abstract from complexities arising from the interaction between interventions and complex systems. In our framework, complex interventions can be implemented in simple as well as in complex systems, but the latter are not the primary focus of our paper. Removing the consideration of interactions between interventions and complex systems reduces the scope of our review, but helps focus attention on a manageable number of issues and methods.
We define complex interventions as interventions characterised by multiple components, multiple stakeholders, or multiple target populations, or interventions incorporating multiple processes of behavioural change. These interventions cannot be represented by single-intervention or single-outcome models, and present several challenges to evaluation. Occasionally, or purposely, these interventions give rise to emergent outcomes such as non-linear effects, tipping points, and multiple equilibria. The presence of emergent outcomes of this type adds additional difficulties to evaluation because existing methods are ill-equipped to detect and estimate non-linear impacts of interventions." (Inroduction)
more
"To mark 20 years of Outcome Mapping, this paper explores the core principles and concepts that are foundational to using the approach. It also presents a set of guiding practices to support transformative change.
Three principles inherent in Outcome Mapping: 1. Social, policy & systems changes depe
...
nd on changes in human behaviour; 2. People contribute to their own wellbeing; 3. Sustained improvements in people’s lives or environments depend on relationships.
Four core concepts necessary for effective use of Outcome Mapping: 1. Outcomes understood as changes in behaviour; 2. Spheres of influence; 3. Contributions to outcomes, not attribution; 4. Setting actor-centred boundaries.
Five guiding practices for using Outcome Mapping to support transformational change: 1. Facilitate inclusive & equity-focused participatory change processes; 2. Be accountable to learning at individual, team and organisational levels; 3. Grow a complex adaptive system view, & embrace uncertainty & experimentation; 4. Commit to iterative, collective sense-making with inductive & data driven reasoning; 5. Lead from context & combine Outcome Mapping with other approaches as needed." (Summary, page 2)
more