Toolbox Evaluation & Impact Assessment

Evaluation & Impact Assessment

TOOLBOX

Evaluation & Impact Assessment

Filter

553

Sort by:

Direction:

Download (0)

Digital Literacy Key Performance Indicators for Sustainable Development

Danica Radovanovic, Christine Holst, Sarbani Banerjee Belur, Ritu Srivastava, Georges Vivien Houngbonon et al.

Social Inclusion, volume 8, issue 2 (2020), pp. 151-167

"The concept of digital literacy has been defined in numerous ways over the last two decades to incorporate rapid technological changes, its versatility, and to bridge the global digital divide. Most approaches have been technology-centric with an inherent assumption of cultural and political neutra ... more

Download (0)

Managing Outcomes: A Practitioner's Manual for Analysis, Planning, Monitoring and Self-Evaluation Based on Outcome Mapping

Christian Kuijstermans et al.

Cologne: AGIAMONDO (2020), vi, 114 pp.

"Outcome Mapping was developed 20 years ago by the International Development Research Centre and for many in the development sector it has become a staple in planning, monitoring and evaluation toolkits. Countless organisations across the world have applied and adapted Outcome Mapping for their own ... more

Download (0)

Wozu Non-Profit-Journalismus? Ein Report zu gemeinnützigem Journalismus – mit Wirkungslogiken, Qualitätskriterien und Tipps für Förder*innen
Key Guidance

Charlotte Buttkus, Igor Ryabinin, Florian Hinze

Berlin: PHINEO gemeinnützige AG (2020), 63 pp.

"Der Report „Wozu Non-Profit-Journalismus?“ macht sich für eine dritte Säule im Mediensystem stark: Der gemeinnützige Journalismus hält der Krise Antworten entgegen und leistet als Ergänzung zum öffentlich-rechtlichen und privaten Verlagsjournalismus einen Beitrag zur Medienvielfalt. Er is ... more

External Link (9)

Participatory M&E

Alison Napier, Nigel Simister, Nandita Jain

INTRAC (2020), 7 pp.

"Participatory M&E is about engaging different stakeholders, especially targeted beneficiaries, in monitoring and evaluation processes. It is done to generate better M&E information and/or to empower stakeholders. It is facilitated through two main approaches. The first is a set of tools and methods ... more

Download (0)

Evaluation Management

Andrea Queiroz de Souza, Leila Broich

Bonn: Deutsche Welthungerhilfe (2020), 51 pp.

Download (0)

Manuel Gestion de l'Évaluation

Bonn: Deutsche Welthungerhilfe (2020), 51 pp.

External Link (9)

Google Scholar (8)

WorldCat (8)

RealWorld Evaluation: Working Under Budget, Time, Data, and Political Constraints
Key Guidance

Top Insights

Michael Bamberger, Linda Mabry

Los Angeles et al.: Sage, 3rd ed. (2020), xliv, 524 pp.

"Addresses the challenges of conducting program evaluations in real-world contexts where evaluators and their clients face budget and time constraints. The book is organized around the authors’ seven-step model that has been tested in workshops and practice environments to help the evaluation impl ... more

External Link (7)

M&E Tools for Advocacy Work

Nigel Simister, Jenny Ross

INTRAC (2020), 7 pp.

"Many different tools and methodologies can be used to support advocacy work. Some are designed specifically for monitoring and evaluation (M&E) purposes. Others are designed to support the planning and management of advocacy interventions, but can be used or adapted for M&E purposes. CSOs often emp ... more

External Link (6)

Assessing the quality of developmental evaluations at UNFPA

New York: UNFPA (2020), [80 pp.]

"The purpose of this guidance is to clarify the concept of quality in developmental evaluations managed by UNFPA. It is intended to increase the understanding of UNFPA evaluation staff, external evaluation consultants, and those contracted to carry out quality assessment of UNFPA developmental evalu ... more

Download (0)

Communication for Development: An Evaluation Framework in Action
Top Insights

Jessica Noske-Turner (ed.)

Rugby: Practical Action Publishing (2020), xiii, 124 pp.

"This book presents five cases that reflect on the experiences of using practices consistent with the 'Evaluating C4D framework' [published by June Lennie and Jo Tacchi in 2013]. Case studies are important to help move from a set of ideal principles to an understanding of how the framework may be op ... more

Download (0)

Process Tracing as a Practical Evaluation Method: Comparative Learning from Six Evaluations

Alix Wadeson, Bernardo Monzani, Tom Aston

[authors] (2020), 31 pp.

"This paper presents comparative learning from the evaluation of six international development initiatives that applied various forms of Process Tracing. While these initiatives span across diverse contexts and pursued different aims, they are connected by a common thread: all six case studies centr ... more

External Link (10)

Approaches for Diverse, Equitable, and Inclusive Evaluation

Bellwether Education Partners (2020), 5 pp.

Download (0)

Decoding Media Impact: Insights, Advice and Recommendations

Katie Donnelly

Philadelphia, Penns.: Media Impact Funders (2020), 31 pp.

"This guide is meant to serve as a practical resource for funders who want to understand where to start. Informed by feedback from our network, it represents a synthesis of the past seven years of work we’ve done in the impact space, and includes examples of successful media impact evaluation, too ... more

Download (0)

How to Perform Impact Assessments: Key Steps for Assessing Communication Interventions

James Dennison

International Centre for Migration Policy Development (ICMPD);EUROMED Migration (2020), 29 pp.

"This report brings together disparate terminology, findings and recommendations from the private and public sectors and academia to synthesise a set of five general steps for practitioners when performing impact assessments. Impact assessment (IA) compares a variable of interest after an interventi ... on (e.g. a communication campaign) to what it would it be if that intervention had never happened. Accompanying each of the five steps are examples of how migration communicators can assess the impact of campaigns to, first, change attitudes and, second, change behaviour. Step 1: Set objectives for the intervention that define what the desired effect is. Ideally, this should (1) meet the SMART criteria of specific, measurable, attainable, relevant and timebound; (2) focus on ultimate outcomes, rather than only outputs; (3) avoid a number of common mistakes in setting objectives and (4) carefully consider what the—as specific as possible— target audience is. Step 2: Identify a measure of the impact(s) that the intervention has as its objective. These should be (1) clearly defined and unambiguous; (2) externally valid (they act reliably if used for other interventions) and (3) internally valid (they measure what they claim to measure). There already exist long-lists of measures (also known as indicators) to choose from. Step 3: Estimate what would have happened had there been no intervention, known as a ‘counterfactual’. Ideally, but not necessarily, this requires performing a pre-intervention measurement, also known as baseline assessment. However, this is not always possible. This should not dissuade practitioners but instead assumptions of any IA, as discussed below, should be made openly. A long list of methods for measurement, including sampling considerations, are provided. Step 4: Perform the intervention. This may involve separating a randomised sample into a treatment group(s)—that receives the intervention(s)—and a control group—that does not. If this is not feasible, other forms of counterfactual are possible that ‘construct’ a control group. This section also overviews: (1) types of communication campaigns; (2) the MINDSPACE checklist of behavioural influences for interventions; (3) key recommendations on persuasive interventions from ICMPD’s previous work; (4) recommendations on campaigns deterring irregular migration. Step 5: Post-intervention measurement and analysis: (1) those receiving the intervention should be measured post-intervention (ideally, as well as, either a genuine or constructed control group); (2) the impact must be calculated: usually the difference in the variable of interest pre- and post-intervention and/or between the treatment and control group; (3) theoretical consideration of why and what aspect of the campaign caused an impact; are the findings likely to be universalizable?; (4) creation (and, in some cases, incorporation) of recommendations based on combination of impact and theoretical considerations." (Executive summary) more

Download (0)

A Valuing Impact Toolkit for ICT Investment

NEF Consulting;Digital Impact Alliance (dial) (2020), 124 pp.

"ICT4D projects are known for having social, economic, and environmental impacts that are difficult to capture. Investments in digital infrastructure and innovation often have high up-front costs with largely medium-to-long-term benefits, not quick, short-term outcomes desired by policy makers. The ... more

Download (0)

Sida's Evaluation Handbook: Guidelines and Manual for Conducting Evaluations at Sida

Stockholm: Swedish International Development Cooperation Agency (Sida) (2020), 41 pp.

External Link (11)

Countering Violent Extremism in Nigeria: Using a Text-Message Survey to Assess Radio Programs

James V. Marrone, Todd C. Helmus, Elizabeth Bodine-Baron, Christopher Santucci

RAND Corporation (2020), 32 pp.

"Using a randomized encouragement design, we assigned 2,064 people to listen to either 'Ina Mafita' or to a control program (professional soccer matches) each week over the course of two months. Recruitment and engagement were conducted remotely via short message service (short message system [SMS] ... more

Download (0)

A Toolkit for Monitoring and Evaluation of Gender-Based Violence Programming in Restricted Environments

Women's Refugee Commission (2020), 210 pp.

Download (0)

CEDIL Guidelines on Impact Evaluation that are Sensitive to Disability

Centre of Excellence for Development Impact and Learning (CEDIL) (2020), 5 pp.

"These are simple recommendations on the inclusion of data on disability for researchers conducting evidence syntheses and primary studies." (Page 1)

Download (0)

Using Big Data for Evaluating Development Outcomes: A Systematic Map

Francis Rathinam, Sayak Khatua, Zeba Siddiqui, Manya Malik, Pallavi Duggal, Samantha Watson, Xavier Vollenweider

Centre of Excellence for Development Impact and Learning (CEDIL) (2020), vi, 104 pp.

"Spatially and temporally relevant ‘big data’ that does not require data collection in the field has the potential to provide insights into people’s economic, social, behavioural and political lives, and hence could be used in measuring key development outcomes. Big data consists of humangener ... more

Wozu Non-Profit-Journalismus? Ein Report zu gemeinnützigem Journalismus – mit Wirkungslogiken, Qualitätskriterien und Tipps für Förder*innen Key Guidance

RealWorld Evaluation: Working Under Budget, Time, Data, and Political Constraints Key Guidance Top Insights

Communication for Development: An Evaluation Framework in Action Top Insights

Wozu Non-Profit-Journalismus? Ein Report zu gemeinnützigem Journalismus – mit Wirkungslogiken, Qualitätskriterien und Tipps für Förder*innen
Key Guidance

RealWorld Evaluation: Working Under Budget, Time, Data, and Political Constraints
Key Guidance

Top Insights

Communication for Development: An Evaluation Framework in Action
Top Insights