"Mixed methods research found that including entertaining and relatable characters and storylines in the Life in Lulu radio drama engaged listeners and helped them to apply lessons from the programme to resolve conflicts peacefully in their own households and communities." (Page 1)
"This book demonstrates how the authors used radio and mobile technologies to improve educational outcomes for over 20,000 displaced and out-of-school children in northeast Nigeria at the height of the Boko Haram insurgency. Interactive Radio Instruction (IRI) programs typically interact with a func
...
tional classroom teacher. However, the transactional radio the instruction strategy presented provides high-quality, safe, and sensitive education in war-torn societies, where there are no schools or teachers. Summarizing the research and lessons learned from a USAID-funded Technology Enhanced Learning for All (TELA) project in Boko Haram-ravaged northeast Nigeria, the book describes in detail an education-in-emergency strategy based on a "whole of community" approach, with radio and mobile tablets at its core." (Publisher description)
more
"Overall, this evaluation has shown that over the last biennia UNESCO has made significant achievements through its work in MIL and is holding the lead in this constantly evolving field that has gained increasing importance at the forefront of global and national agendas. It also revealed that MIL o
...
ffers increasingly interdisciplinary opportunities for the Organization and strategic decisions are needed as to the level of priority and adequacy of resources required for optimally positioning this strand of work to contribute to the achievement of Agenda 2030 through a wide range of topics. Among other, work on data privacy and big data, media and freedom of expression areas, a focus on PVE and a boost towards the disinformation, life-long learning and artificial intelligence approaches, as well as an enhanced focus on disadvantaged groups and a more consistent approach to advancing gender equality will allow UNESCO to remain at the forefront and to keep and expand its intellectual and foresight role in the area of MIL." (Abstract)
more
"This paper presents comparative learning from the evaluation of six international development initiatives that applied various forms of Process Tracing. While these initiatives span across diverse contexts and pursued different aims, they are connected by a common thread: all six case studies centr
...
e around efforts to influence others - often decision makers and those in power - around aspects such as practices of consultation and inclusion; public policy; and resource allocation. The paper is organized in the following manner. We first explain Process Tracing and review common definitions. Secondly, we consider the potential value added of an explicitly Bayesian approach to Process Tracing. Next, we discuss the six cases where Process Tracing was applied, noting similarities and differences. Then, we explore key practical learning emerging from the cases and insights from the use of different forms of Process Tracing across different programming contexts. These reflections are organized under four meta-themes of participation, Theory of Change, methodological decisions, and mitigating bias. Finally, we present our key recommendations, ending with practical tips, targeted at practitioners and evaluators interested in applying Process Tracing, especially for initiatives falling under the ‘influencing’ umbrella." (Introduction)
more
"Justice4Her is a cross-sector, multi-stakeholder project of RNW Media and Qianqian Law Firm that seeks to strengthen the rule of law and reduce gender-based violence (GBV) towards women migrant workers in China. The project launched in 2016 and targets women migrant workers in Beijing, Shanghai and
...
Guangdong Province and was scaled further with co-funding from the European Commission in 2018. Justice4Her provides legal support through a digital interactive platform and disseminates information on GBV to millions through online channels (social media platforms, blogs, email, WeChat groups) and integrates this online work with offline activities. The project has increased mainstream media coverage in China of how GBV affects young women migrants and carried out viral online campaigns to raise public awareness and to challenge tolerance and acceptance of GBV. While advocating for the improvement of anti-domestic violence laws in China, Justice4Her provides pro bono legal aid to victims of GBV in partnership with Beijing Qianqian law firm, a local law firm, both in the form of consultations via mail and support in bringing their cases to court and representing them. The project has also trained pro bono lawyers to better represent victims, media professionals to encourage more gender sensitive reporting on cases of GBV and NGOs on how conduct successful anti-GBV media campaigns and effectively counter negative stereotypes and shift public discourse from a victim blaming narrative to a survivor narrative." (Introduction)
more
"The Theories of Change for both Citizens’ Voice [a programme focusing on social cohesion and inclusive governance] and the SRHR programme (which includes Love Matters [delivering information and media on love, sex and relationships to 18-30-year-olds]) contain a key assumption that through provid
...
ing reliable information on our digital platforms, young people gain new knowledge and understanding on topics that matter to them. For Citizens’ Voice, the assumption is that by accessing pluralistic information and engaging in dialogue with people with other backgrounds and perspectives, young people are aware of different viewpoints, accept and respect diversity, challenge restrictive norms and participate in society. For Love Matters, it relates to providing evidence-based and pleasure-positive SRHR information that helps people to make informed decisions in their personal lives. To investigate whether this assumption holds true for both programmes, a dedicated survey question was included in the surveys of platform users conducted as part of the Next Generation Mid-Term Review (MTR) evaluation conducted by external researchers in 2019. This open question asked users whether they could give an example of a change they had experienced through engaging with the platform. The answers and examples given by users have been analysed by the PMEL team to answer the main research question: To what extent do returning users experience a change in knowledge, attitude or behaviour as a result of engaging with the platform?" (Introduction)
more
"mNutrition is a global initiative supported by FCDO, managed by GSMA, and implemented by in-country MNOs and third party providers to use mobile technology, that sought to improve the health and nutritional status of children and adults in the developing world. The potential to utilise mobile techn
...
ology to change attitudes, knowledge, behaviours, and practices around health and agriculture for improved nutritional status has been recognised for some time, but to date there have been no rigorous evaluations of m-services at scale. A consortium of researchers from Gamos, IDS, and IFPRI were contracted to conduct a rigorous mixed-methods evaluation to estimate the impact of mNutrition on children and adults, and to understand how the context and the components of the mNutrition intervention shape its impact. In Tanzania, the service, Wazazi Nipendeni, focused on the provision of nutrition and health information and services to vulnerable pregnant women and caregivers of children under the age of five on their mobile phones, with the goal of improving nutrition outcomes and behaviours for mothers and young children." (https://opendocs.ids.ac.uk)
more
"This progress report presents the main findings and achievements of a self-evaluation exercise conducted by the responsible UNESCO project officers at Headquarters and in the relevant Field Offices." (Page 3)
"The Hewlett Foundation’s decision to add a focus on disinformation to its 2017 US Democracy strategy was motivated by a desire to figure out how best to encourage social media platforms to reduce polarization exacerbated by disinformation.1 The foundation invested in two major efforts to support
...
this ambition: a multi-funder partnership with Facebook to create data access for independent researchers to study the impact of social media on democracy and elections; and a grant making portfolio conceived to build an academic field to deepen the understanding of disinformation and identify policy solutions that mitigate its spread and impact on society . We found compelling the suggestion that disinformation is better considered a topic than a coherent field, and that multi-disciplinarity brings richness in framing, methods, and applications. Among Hewlett grantees, scholars self-identify as members of different fields that carry with them important epistemological and philosophical differences. We found evidence that there are perceived gaps between researchers, platforms, journalists, policy makers, civil society and others that obstruct the development of policy solutions. The missing competency among many academics to translate research findings for use, and of the need for tighter connections between scholars and decision makers were additional insights we gained about important gaps in the current landscape. During the two-year grantmaking period, the disinformation portfolio invested in varied policy and academic institutions and supported a diverse group of principal investigators. This is in contrast to the perceptions we heard about the foundation’s lack of a diverse grantee portfolio and approach. We learned from key informants and secondary research that there is an inextricable link between disinformation, racial and social equity and justice. A stronger communication strategy about the foundation team’s approach to diversity, equity and inclusion is warranted, as is a deliberate effort to showcase the work of all their grantees and their distinct perspectives. The foundation’s significant role in creating momentum for this body of work was widely noted, as was the need for continued leadership and support." (Executive summary, page 2-3)
more
"Overall, one finding stands out: the international community has repeatedly overestimated its own capacity and the capacity of its Afghan partners to bring about rapid social change. What has worked best are modest, locally embedded projects with immediate, tangible benefits. What has rarely worked
...
are complex projects aimed at building capacity and changing behaviour. More specifically, interventions in basic health and education, and in improving basic livelihoods, led to results. Interventions in building capacity for the administration, or in sectors such as the rule of law or gender, rarely worked. In reading these 148 reports, one also realizes that the international aid community is often not good at learning. Monitoring and evaluation systems are weak, and have hardly improved since 2002. Back in the early 2000s, many donors pointed out that, in order to achieve meaningful and sustainable development, more time was necessary. Fifteen years later, few sustainable results have been achieved, but many donors continue to suggest that better results will still require more time. Few donors appear to have changed their fundamental strategic approach, despite the fact that their own evaluations strongly suggest that many aid programs are neither e cient nor e ective in the Afghan context. In all fairness, the Afghan context is an incredibly challenging one, as these 148 reports vividly remind us on almost every page. The situation on the ground was and still is characterized by a lack of basic security; Afghan partners in government and in civil society lack basic capacities; many entrenched political actors have little interest in real reforms. Despite these challenging conditions, there was since the early days of the international engagement in Afghanistan tremendous political pressure on development actors to rush in and to provide quick results. An additional layer of complexity was added by the fact that the international engagement was from the beginning both a civilian and a military intervention, and planners in headquarters as well as practitioners on the ground had to learn how to cope with the task of civil-military cooperation. Under such circumstances, designing e ective aid programs is a herculean task." (Introduction, page 8)
more
"Taking into account the actual situation in the region, the support that VIKES provides for independent journalism is more urgent than ever. Journalists in the region are facing unprecedented challenges, from declining revenues, a broken business model and a new form of censorship, threats to journ
...
alists’ safety and misinformation campaigns. In these conditions, the work that VIKES has been doing in the region has been relevant and successful. It has promoted the right of civil society to information and the right of media to freedom of expression. Activities that were planned in the programme document on the defense of fundamental rights to exercise free speech and democracy were implemented, and positive results were achieved. All the partner organizations have strengthened the exercise of democracy through digital media and investigative journalism, promoting citizen participation in public policies and improving the open-access and right to information. Networking and cooperation between independent media, journalists and CSOs are more reliable than ever in the region, and a new concept of collaborative journalism was introduced with positive results. VIKES supported media and independent journalists in producing high-quality information and investigative stories, supporting them to attract wider audiences. Training in business development, marketing and effective management was organised by the programme, and the financial sustainability of partners was improved. Even so, the independent media in the region is still dependent on external funding and will be, until the political situation in the region will improve. To be more effective and to improve the effectiveness of the Regional Independent Media Support Programme in the future, VIKES should increase the number of the partners and independent media representatives (also those currently exiled) to receive support from the programme. The main problem of independent public media remains the lack of financing and security. In a meeting with independent journalists in Nicaragua, where the government has threatened to continue to imprison journalists and publicly insults media professionals, they underlined the importance of solidarity networks among international organizations and press associations. According to them, VIKES has done bold work, and its efforts have supported the professionals who remain to practice “survival journalism” and need all the backing to continue to inform the population." (Executive summary, page 7-8)
more
"South Sudan is one the largest recipients of official development assistance. Given the complexity of the operational environment, there is a need to learn from the lessons gained to-date. This article seeks to enable better-informed decision making based on a synthesis from humanitarian and develo
...
pment evaluation reports, which offer insight for engagement in other fragile and conflict-affected states. Experimental methods were utilised to identify evaluation reports. The synthesis finds that projects would be better designed if they allocated time and resources to obtain additional information, integrated systems thinking to account for the broader context, and engaged with the gendered nature of activities and impacts. Implementation can be strengthened if seasonality is taken into account, if modalities are more flexible, and if a greater degree of communication and collaboration between partners develops. Sustainability and long-term impact require that there is a higher degree of alignment with the government, longer-term commitments in programming, a recognition of trade-offs, and a clear vision and strategy for transitioning capacities and responsibilities to national actors. While actors in South Sudan have been slow to act on lessons learned to-date, the lessons drawn from evaluation reports in South Sudan offer direction for new ways forward, many of which have been concurrently learned by a diverse set of donors and organisations." (Abstract)
more
"The aim of this paper is to analyse participatory video as a participatory action research method through the lenses of the capability approach. In order to do this, we used a participatory video experience that took place in the municipality of Quart de Poblet (Valencia, Spain) from February to Ma
...
rch 2014. The participants were 11 young people between 16 and 24 years of age, severely affected by the economic crisis that has hit Spain in recent years. To develop our analysis, we introduced the participatory video as a technique and a process within the participatory action research methods. Then, we analysed the participatory process to verify the extent to which it had contributed to expanding the capabilities and agency of the participants. The evidence revealed a significant expansion of the awareness capability and, in some cases, of the capability for voice. In contrast, the capability to aspire and the agency of the participants were not expanded, due to contextual factors and the limitations of the process itself." (Abstract)
more
"In the formative evaluation, church data from the retrospective baseline showed that after being exposed to the “What’s Your Story?” methodology by Heartlines, 42% of respondents had engaged in further intentional storytelling with others. In comparison to this, in the summative evaluation, a
...
full 80% of respondents reported that they had engaged in further storytelling processes with others. This increased likelihood of someone adopting the WYS approach amongst respondents that were introduced to WYS in the period after the formative evaluation can, in part, be explained by the issue of ‘dosage.’ That is, the level of exposure that the respondent had to WYS at the point of being introduced to it. In the formative evaluation, 56% of respondents had medium to high dosage. In the summative evaluation, however, this had increased to 84%. These findings provide evidence that the greater the exposure to WYS when it is introduced to participants, the greater the likelihood that it will be taken up as a methodology that participants then introduce to others. This finding also suggests that Heartlines took on board the recommendation in the formative report to support higher dosage options. Workplace data were only collected once, during the formative evaluation of WYS in churches. Of these workplace respondents, 48,5% reported that they had gone on to adopt the WYS approach and the issue of ‘dosage’ was also an important factor in determining who chose to adopt the WYS methodology. Once individuals have adopted the WYS methodology, the evidence suggests that the vast majority repeat the methodology more than once and that those who are exposed to it cascade it even further into their homes, neighbourhoods, workplaces and communities. The findings also give strong evidence for positive changes as a result of being exposed to WYS. These are found at the level of the individual, within churches, workplaces or other organisations, and beyond these organisations into the wider community." (Executive summary)
more
"DW Akademie’s project in Colombia supports initiatives that promote the inclusion of diverse experiences in the country’s historical memory, focusing in particular on the local effects of the peace process. In general, these initiatives are aimed at giving Colombians, mainly victims and people
...
in post-conflict areas, access to human rights-related information. To this end, the project works with different implementing partners and approaches: Consejo de Redacción (CdR) to develop training and journalistic consultancy services in regions affected by armed conflict; the community radio station Vokaribe to strengthen the community media sector on the Atlantic coast; the University of Antioquia (UdeA) in Medellín, to support the establishment of an academic centre for journalism and historical memory, as well as the training of local media and victims of conflict to report on sensitive human rights issues; the Consejo Regional Indígena del Cauca (CRIC) based in the department of Cauca to promote the creation of a media centre aimed at increasing media diversity and, in particular, the participation of indigenous minorities in public discourse; and FLIP, the Foundation for Press Freedom in Bogotá. The project was evaluated along the five OECD/DAC evaluation criteria (relevance, effectiveness, efficiency, impact and sustainability). For each criterion, the DW Akademie scoring system was applied. In addition, according to DW Akademie policy, three digital questions were included. Gender was assessed as a cross-cutting topic." (Background)
more
"This study evaluates the implementation of the Alliance to better protect minors online (‘the Alliance’). Officially launched in 2017, the Alliance is a multi-stakeholder platform through which companies make a series of commitments to address emerging risks that minors face online. The initiat
...
ive focuses on protection from harmful content, conduct and contact, and seeks to identify possible areas within these three categories that would benefit from a coordinated approach from companies and other stakeholders to overcome them. In general, the evaluation finds that the Alliance is an original, relevant means to protect minors online. There is however unrealised potential to foresee, discuss and forge common solutions across different stakeholder types, including on new and emerging threats to the safety of minors online." (Executive summary, page 5)
more