"This pragmatic evaluator's companion from leaders in the field provides essential guidance for designing, implementing, and managing exemplary evaluations using established and emerging methods, designs, and analyses. With contributions from skilled experts, the Handbook has a unique focus on the c
...
ompetencies identified by the American Evaluation Association as critical for evaluators. Balancing rigor with practical, mentor-style guidance, chapters build the reader's skills for tailoring studies creatively to address specific evaluation situations and contexts; optimizing communication and collaborative decision making; and centering equity and justice. This insiders guide is replete with detailed examples, real-world scenarios, and other helpful features, including chapter overviews and an end-of-book glossary." (Publisher description)
more
"loved for its conversational style and reliable advice, this text is now in a revised and updated third edition, reflecting key developments in evaluation. It includes expanded coverage of equity and social justice issues, values and cost analysis, visualizing qualitative data with software, and mo
...
re. Twenty-six concise chapters, or “sessions,” give students, applied researchers, and program administrators a solid foundation for conducting or using evaluations. Covering both quantitative and qualitative methods, the book emphasizes fostering evaluation use. It shows how to build collaborative relationships with users; formulate answerable evaluation questions; deal with contingencies that might alter the traditional sequence of an evaluation; and collect, analyze, and report data. Student-friendly features throughout the sessions include titles written as questions, bulleted recaps, “Thinking Ahead” and “Next Steps” pointers, cautionary notes, and annotated suggestions for further reading. An in-depth case study provides the basis for end-of-session practice exercises." (Publisher description)
more
"In this Handbook, Reinhard Stockmann and other esteemed experts in the field provide a systematic and comprehensive exploration into the planning, process, implementation and utilisation of evaluations. Covering the process and individual steps of evaluation in detail, in chronological order and in
...
terms of practical application, this Handbook identifies the characteristics and standards that distinguish a professionally and competently conducted evaluation. The first chapters define the differing concepts of monitoring and quality management before exploring the organisational implementation of evaluations and how evaluations are embedded within their social and political contexts. The Handbook then lays out which evaluation designs, quantitative and qualitative data collection, management, measurement and analysis methods can be used, and under which conditions. It concludes with a summary of the forms of reporting to ensure that evaluation results are used optimally." (Publisher description)
more
"Sections of the book engage in critical reflection on what peacebuilding effectiveness is and who gets to decide, provide practical examples and case studies of the successes and failures of assessing peacebuilding work, and support innovative strategies and tools to move the field forward. Chapter
...
s reflect a variety of perspectives on peacebuilding effectiveness and methods—quantitative, qualitative, and participatory—to evaluate peacebuilding efforts, with particular attention to approaches that center those local to the peacebuilding process. Practitioners and policymakers alike will find useful arguments and approaches for evaluating peacebuilding activities and making the case for funding such efforts." (Publisher description)
more
"The Fifth Edition of the bestselling 'Utilization-Focused Evaluation' provides expert, detailed advice on conducting evaluations that promote effective use of the findings. Chock full of useful pedagogy, this book presents Michael Quinn Patton's distinctive opinions based on more than forty years o
...
f experience, and also the expertise of new co-author Charmagne E. Campbell-Patton. The authors begin by describing the essence of utilization-focused evaluation, and then outline 10 operating principles. They conclude with chapters focused on how evaluation can be used to promote a more thoughtful, equitable, and sustainable world." (Publisher description)
more
"Ziel dieses Buches ist es, kompakt und nutzerfreundlich Grundkenntnisse für die Planung, Durchführung und Anwendung von Evaluationen zu vermitteln. Hierfür greift es auf die inhaltlichen Konzepte und Unterlagen zahlreicher Kurse zur Evaluation im In- und Ausland zurück. Das Buch richtet sich an
...
Interessierte, die erst über wenige Kenntnisse im Bereich der Evaluation verfügen und sich weiterbilden möchten. Es dient sowohl Personen, die Evaluationen selbst durchführen als auch Entscheidungsträgern, die Evaluationen in Auftrag geben, aber auch denjenigen, die evaluiert werden. Alle Beteiligten an einer Evaluation sollten wissen, welche Charakteristika und Standards eine professionell und kompetent durchgeführte Evaluation auszeichnen. Die zweite Auflage wurde vollständig überarbeitet und um ein Kapitel zum Monitoring und einen Einblick in den politischen Kontext erweitert." (Verlagsbeschreibung)
more
"This book is written to provide detailed, rigorous guidance on how to conduct impact evaluations of government and nongovernment programs and projects. It covers all the leading quantitative impact evaluation methods, explaining the assumptions required for them to provide unbiased estimates and th
...
e data required to implement them. It also provides many examples of how these methods have been applied in developing economies. The book’s contents are based on lectures given by the authors, and their collaborators, as part of a two-week intensive course conducted in China, Peru, South Africa, and Uganda between 2012 and 2017. The courses in China, South Africa, and Uganda were administered and supported by the Centers for Learning on Evaluation and Results (CLEAR) Initiative, a multidonor partnership program for evaluation capacity development with its secretariat at the World Bank and centers located in universities in different parts of the world; in 2020, the program and centers became part of the Global Evaluation Initiative. The presentation of the material in this book is at a high technical level. It assumes that the reader is very comfortable with algebra and has an intermediate knowledge of statistical theory. It is essentially a graduate-level textbook for use in economics, public policy, or related academic programs, although it may also be useful for a course designed for advanced undergraduate students." (Preface)
more
"While social media offer an unprecedented opportunity for orchestrating large-scale communication campaigns, it is often difficult to track audience responses on various digital platforms over time and to ascertain if their engagement is aligned with the original intention. In this article, we shar
...
e a promising solution—the purposive embedding and tracking of unique content elements as “markers” using text analytics techniques. Four markers were introduced in an Indian melodramatic television serial, Main Kuch Bhi Kar Sakti Hoon (I, A Woman, Can Achieve Anything), which was part of a larger transmedia edutainment initiative in India to promote sanitation, family planning, and gender equality. These markers served as anchors for audience engagement with the originally intended messaging embedded in the narratives as well as for program monitoring and evaluation. We applied various web-based tools to systematically track marker-related engagement on Facebook, Twitter, and YouTube across eight months. We also conducted semantic network analysis to better understand how marker-related social media comments evolved over time. Our investigation of using markers for digital engagement and narrative exchange in MKBKSH makes an important and timely methodological contribution to the scholarship and praxis of social and behavior change communication." (Abstract)
more
"The Learning Power of Listening guide is intended for those who wish to coordinate, participate in, or support the use of SenseMaker—a complexity-aware, narrative-based method—in conducting assessments, monitoring progress, and carrying out evaluations or research. The guide can be used for per
...
sonal reference or for training others involved in a SenseMaker process. The experiences on which the guide is based, as well as the examples used, focus mainly on development programs, and particularly on efforts that focus on poverty reduction, social justice, peacebuilding, resilience, behavioral change, and restoring and protecting natural resources. They come from organizations and programs that have used SenseMaker over the last decade. The guide starts with considerations for judging the suitability of the method, followed by descriptions of the four phases of any SenseMaker process. Besides detailed guidance on preparing for and implementing a SenseMaker process, examples, and advice are offered for each phase. Despite its practical focus, this is not a do-it-yourself guide: there is no shortcut to learning SenseMaker. Mastering its practice requires deep, hands-on involvement in at least one to two processes from start to finish. Guidance from an experienced SenseMaker practitioner is also recommended. The guide summarizes practices that have evolved in international development, providing practical tips and examples of context-specific adaptations." (About this guide, page 9)
more
"This glossary provides conceptual clarity on common terms used in results based management, monitoring and evaluation. This 2nd Edition includes new terms, as well as updates and improvements to the original Glossary published in 2002. It is intended to support thoughtful approaches to results-base
...
d management, monitoring and evaluation, which in turn support better progress on sustainable development through learning and accountability." (Page 1)
more
"Advantages and disadvantages of remote evaluations: Advantages: environmentally friendly and applicable in case of travel restrictions; a cost-effective and more efficient implementation is possible; reduction of the project staff's workload; flexibility in scheduling the data collection, interview
...
s, group discussions; integration of interviewees from different locations; online connection with interviewees facilitates second contact; flexible employment of interpreters; making use of digital tools. Disadavantages: making it difficult to develop a common understanding within the team of evaluators; lack of observations (e. g. equipment in laboratories, interviewees in the working environment); poorer contact quality with interviewees; risk that the momentum of the evaluation is lost and impressions disappear; less informal communication with interviewees and project team; strong focus on facts and more difficult consideration of the emotional level; more difficult assessment of the accuracy of recommendations; dependence on technology." (Background, page 4)
more
"Network results can be divided into different categories, such as network vibrancy, network connectivity and network effects. Monitoring and evaluation tools and methods need to be chosen to assess each of these areas separately, depending on the need. Network surveys and social network analysis ar
...
e two of the most common methods used to monitor and evaluate networks." (Introduction)
more
"In this guide I am going to walk you through a few methods you can use to evaluate a website. The specific method(s) you choose will depend a lot on your evaluation goals. And ultimately, you will probably want to mix these methods. But website evaluation doesn’t need to be overly complex. Our go
...
al here is to use the web to actually accomplish something. An evaluation is going to help us see if we are on the right track, and specifically, how we might be able to improve our website or digital strategy." (Author)
more
"This paper presents comparative learning from the evaluation of six international development initiatives that applied various forms of Process Tracing. While these initiatives span across diverse contexts and pursued different aims, they are connected by a common thread: all six case studies centr
...
e around efforts to influence others - often decision makers and those in power - around aspects such as practices of consultation and inclusion; public policy; and resource allocation. The paper is organized in the following manner. We first explain Process Tracing and review common definitions. Secondly, we consider the potential value added of an explicitly Bayesian approach to Process Tracing. Next, we discuss the six cases where Process Tracing was applied, noting similarities and differences. Then, we explore key practical learning emerging from the cases and insights from the use of different forms of Process Tracing across different programming contexts. These reflections are organized under four meta-themes of participation, Theory of Change, methodological decisions, and mitigating bias. Finally, we present our key recommendations, ending with practical tips, targeted at practitioners and evaluators interested in applying Process Tracing, especially for initiatives falling under the ‘influencing’ umbrella." (Introduction)
more
"Spatially and temporally relevant ‘big data’ that does not require data collection in the field has the potential to provide insights into people’s economic, social, behavioural and political lives, and hence could be used in measuring key development outcomes. Big data consists of humangener
...
ated data including online searches, social media, citizen reporting or crowdsourced data, process-mediated data such as mobile phone call record details (CRD), commercial transactions data and machine-generated data from satellites, sensors or drones. The primary value of big data is that it is possible to measure outcomes that could not previously be measured using household surveys at the required temporal and spatial scale. The potential of big data to answer causal attribution, however, is still not widely understood, especially in low- and middle-income countries (L&MICs). The report is based on a map of the studies using big data and its objective is to discuss methodological, ethical and practical constraints relating to the use of big data. The systematic map includes impact evaluations (IEs) that use big data to evaluate development outcomes, systematic reviews (SRs) of big data IEs and other measurement studies that innovatively use big data to measure and validate any development outcomes. This study also explores the sectoral and geographical spread of big data's use in international development. This map includes studies written in English and published between 2005 and 2019, regardless of the target country's income level or population's status. We provide detailed breakdowns on the map for different country income classifications, fragile contexts and population characteristics. From the initial list of 17,393 studies we arrived at a final list of 437 studies, which included 48 IEs, 381 measurement studies and 8 SRs." (Executive summary)
more
"Addresses the challenges of conducting program evaluations in real-world contexts where evaluators and their clients face budget and time constraints. The book is organized around the authors’ seven-step model that has been tested in workshops and practice environments to help the evaluation impl
...
ementers and managers make the best choices when faced with real world constraints. The Third Edition includes a new chapter on gender equality and women’s empowerment and discussion of digital technology and data science." (Publisher description)
more
"Author Bagele Chilisa updates her groundbreaking textbook to give a new generation of scholars a crucial foundation in indigenous methods, methodologies, and epistemologies. Addressing the increasing emphasis in the classroom and in the field to sensitize researchers and students to diverse perspec
...
tives - especially those of women, minority groups, former colonized societies, indigenous people, historically oppressed communities, and people with disabilities, the second edition of Indigenous Research Methodologies situates research in a larger, historical, cultural, and global context to make visible the specific methodologies that are commensurate with the transformative paradigm of social science research." (Publisher description)
more
"CSOs sometimes need to summarise or aggregate information across multiple interventions. This can be a difficult and challenging task, especially for large non-governmental organisations (NGOs) working in many different countries and/or sectors. Summarisation and aggregation can be achieved through
...
a variety of methods. However, all come with associated costs." (Introduction)
more