"This paper suggests that the problem of impact evaluation of media assistance is understood to be more than a simple issue of methods, and outlines three underlying tensions and challenges that stifle implementation of effective practices in media assistance evaluation. First, there are serious con
...
ceptual ambiguities that affect evaluation design. Second, bureaucratic systems and imperatives often drive evaluation practices, which reduces their utility and richness. Third, the search for the ultimate method or toolkit of methods for media assistance evaluation tends to overlook the complex epistemological and political undercurrents in the evaluation discipline, which can lead to methods being used without consideration of the ontological implications. Only if these contextual factors are known and understood can effective evaluations be designed that meets all stakeholders’ needs." (Abstract)
more
"Through a systematic review of the literature, this article summarizes and evaluates evidence for the effectiveness of mass media interventions for child survival. To be included, studies had to describe a mass media intervention; address a child survival health topic; present quantitative data fro
...
m a low- or middle-income country; use an evaluation design that compared outcomes using pre- and postintervention data, treatment versus comparison groups, or postintervention data across levels of exposure; and report a behavioral or health outcome. The 111 campaign evaluations that met the inclusion criteria included 15 diarrheal disease, 8 immunization, 2 malaria, 14 nutrition, 1 preventing mother-to-child transmission of HIV, 4 respiratory disease, and 67 reproductive health interventions. These evaluations were then sorted into weak (n=33), moderate (n=32), and stronger evaluations (n=46) on the basis of the sampling method, the evaluation design, and efforts to address threats to inference of mass media effects. The moderate and stronger evaluations provide evidence that mass media-centric campaigns can positively impact a wide range of child survival health behaviors." (Abstract)
more
"This report is the cluster evaluation of 12 UNDEF-supported projects related to the media. It concerns projects that either focused on media capacity building or included a significant element of work with the media. The projects were implemented between 2007 and 2011; they lasted between 12 and 24
...
months. The total budget of the 12 projects was US$3.519m (including evaluation costs of US$20,000 to 25,000 per project). Eleven of the projects covered individual countries – six projects in Africa (two of which in Sierra Leone), four in Asia, one in Europe – and one was global. National civil society organizations (CSOs) implemented four of the projects, while international non-governmental organizations (NGOs) or their local affiliates implemented the other eight." (Executive summary)
more
"The African Farm Radio Research Initiative (AFRRI) was a 42-month action research project implemented by Farm Radio International (FRI) in partnership with World University Service of Canada (WUSC), and with the support of the Bill & Melinda Gates Foundation. An estimated 40 million farmers in five
...
different countries were served by the AFRRI partnership with 25 radio stations. Farmers engaged in the design and development of farm radio programming were almost 50 per cent more likely to take up agricultural practices deemed to improve their food security than passive listeners. Those in what AFRRI deemed "active listening communities" (ALCs) were 10 times more likely to adopt the practice than those farmers who had no access to the farm radio programs. Farmers demonstrated increased knowledge of agriculture innovations as a result of listening to AFRRI radio programs, with up to 96% of some radio listeners scoring at least 60% on a follow-up knowledge quiz about the promoted farm practices [.] Farmers participate in selecting the focus – or topic – of the radio campaign, choose the time of broadcast, and are intimately engaged in the ongoing development of the farm radio programming over a set number of weeks; including as central agents of the knowledge-sharing process. Lively and entertaining formats are designed to attract listeners. [.] This report presents and discusses the key findings from an in-depth evaluation of 15 round-two Participatory Radio Campaigns (PRCs) – three PRCs in each of the five countries involved in AFRRI. AFRRI examined a mix of radio stations – community, associative, commercial, and state. Tools used for this evaluation included 4,500 household surveys (300 per radio station) in 90 communities, farm visits and field measurements, key informant interviews, and collection of secondary data (from other sources, such as national agricultural extension services)." (Executive summary, page 5)
more
"A pesar de que las inversiones externas en proyectos de medios han aumentado – con excepción de América Latina – hacen falta estudios que analicen el impacto de estas inversiones. A veces se han publicado evaluaciones de proyectos individuales, pero se careció de estudios que analizaran el c
...
onjunto de la cooperación internacional a medios de comunicación. Recientemente tres meta-evaluaciones – es decir: evaluaciones que no se limitan a una experiencia, sino comparan y resumen los resultados de varias – hicieron el esfuerzo de llenar este vacío. Quiero brevemente presentar algunos de los resultados de estos estudios [African Media Development Initiative AMDI 2006; “Apoyo a medios en los Balcanes 1996-2006”; “Empoderando medios independientes: esfuerzos de EE.UU. para fomentar noticias libres y independientes en el mundo”, 2008)." (Página 181-182)
more
"Evaluation data gathered between 1975 and 2000 demonstrated that Interactive Radio Instruction (IRI) had improved learning outcomes in conventional classrooms by between 10% and 20% when compared with control classrooms not using IRI. These programs often had relatively well-funded evaluation compo
...
nents, often taught a single subject, and focused almost entirely on improving quality. This study focuses on the use of IRI in more taxing circumstances and the outcomes it achieved as well as children learning in conventional school settings. It looks at the use of radio to teach children who are not in school, who are affected by conflict, who are orphans, who live in countries where most social systems have broken down or never existed – the poorest, least supported and most remote learners to whom access to education has traditionally been denied. It also looks at IRI operating in systems of huge scale, such as the 20+ million learners in India. The projects documented in this study were largely carried out since 2000 (although reference is made to earlier projects also) and addressed early childhood education, mathematics and language instruction and teacher training. They were not research projects, and their circumstances challenged data collection and student testing. Nevertheless, the data demonstrate that these IRI programs have had a positive impact on learning outcomes and on the behavior of teachers. Interactive Radio Instruction (IRI) delivers daily 30-minute radio broadcasts that promote active learning and are designed to improve educational quality and teaching practices in schools and to deliver a complete basic education to learners not in school. This paper uses student assessment data collected on recent EDC IRI projects to determine the impact of IRI on student achievement and to highlight general patterns that emerged from the review. In all, 15 projects provided 37 records (grade-year combinations e.g. grade 1 in 2007) containing student learning data which served as the basis of this report." (Executive summary)
more
"This study reviews and analyses what has already been documented on the links between radio-based communication strategies and rural development outcomes, particularly with regards to smallholder farming and food security outcomes. The report explores best radio practices, including issues related
...
to optimal formats, schedules, production qualities, and station management, based on 17 case studies from India, the Philippines, Tanzania, Mali, Malawi, Mozambique, Ghana, and South Africa. The key findings include: testimonials and jingles facilitate the best recall and comprehension of messages (Philippines); radio forums strengthen rural decision-making structures (Tanzania); radio programmes created by communities attract high listenership (Malawi); and farm radio is more effective when linked with new information and communication technologies (Ghana). The research also identified some knowledge gaps: the lack of evaluation as an integrated element in radio campaign planning; the need to conduct regular audience surveys; the limited use of non-participatory effectiveness studies and the limited scope of evaluations focusing on the impact of just one or two programmes." (CAMECO Update 5-2008)
more
"There is very little undestanding of the role that communicartion processes play in the numerous starnds of post-conflict reconstruction, including peacebuilding, governance, and long-term development. This paper addressess this gap by distilling lessons learned from the media and communication str
...
ategies of different donors. It takes as its primary case study the Office of Transition Initiatives at the U.S. Agency for International Development, which has long track record of media and communication work in post-conflict environments. In doing so, it seeks to present a new model for understanding and working with communication in post-conflict and fragile environments." (Foreword)
more
"From 1995 to 2005, the international community provided significant support to media in the Western Balkans. Based on a meta-analysis of 37 project reports and interviews with a broad range of media experts, this study finds that direct support to independent media was a key factor in helping the c
...
itizens of several Balkan countries to rid themselves of authoritarian regimes. At the same time, the publication states that often journalism training - the greatest share of media support - has had few lasting effects. Support for legislative and regulatory reform has been efficient and effective, but the new media legislation has not been sufficiently well implemented. The overall conclusion (page 36): 'Media assistance in the Balkans proved itself an effective way to promote democracy by removing barriers to the enjoyment of fundamental rights to information and expression as protected by international law, and without intervening in political choices themselves. When media support was perceived as being primarily driven by political objectives, it was in danger of being like the problem it sought to alleviate and obscuring the concept of independent media." (CAMECO Update 1-2008)
more
"This paper discussed the possibility to improve public communication campaign theory, by making use of data obtained through mass media health communication campaign evaluations. The idea of an ‘engineering’ approach to campaign design, where theory and scientific findings are systematically us
...
ed and adopted for practical problems, plays an important role in the discussion [...] In the third part, a sample of 33 evaluation reports for mass media health communication campaigns was analyzed. 32 of these reports have not been published in an scientific journal. The evaluations were conducted in 22 different countries. The analysis of the reports focused on the campaign goals, evaluation outcome measures, research design and methods, and on questions of validity. The findings suggest that theory is not widely and consequently used to inform health mass communication campaigns or their evaluations – with notable exceptions. While there is a large number of outcomes measured, they seem to be taken out of theoretical context. Neither the campaign goals nor the evaluation measures reflect the large number of possible communication strategies that the various communication or behavior-change models and theories imply. Unintended campaign effects were mostly ignored. In very few cases the campaign designers or evaluators make use of an effects model or program logic model. This is one of the areas where I see the possibility of an important improvement. The methodology of campaign evaluation is relatively homogenous across the 33 cases in regards to data collection method. Standardized questionnaires are the dominating data collection instrument. Non-reactive observation or tracking methods are very rare. A surprising two thirds of the evaluations did not use multivariate analysis, and the reliance on self-reports raises questions of reliability." (Summary, page 120-121)
more
"The perspective that informs this important book is that every evaluation of a capacity development effort should itself contribute to the capacity development effort and ultimately to the organization’s performance. This is a revolutionary idea in evaluation. With the idea have come the question
...
s: Can it be done? And, if it is done, what will be the consequences? This book elucidates and deepens the idea, shows it can be done, and examines the consequences, both intended and unintended, of engaging in capacity development evaluation." (Foreword)
more