We often talk about the importance of knowing the impact of our work, but how is impact measured in practice? What are the ten basic things about impact evaluation that a UNICEF officer should know?
If these questions caught your eye, then you might be interested in viewing some or all of the eight impact evaluation webinars, organized by the Office of Research – Innocenti, and presented by evaluation experts from RMIT University, BetterEvaluation and the International Initiative for Impact Evaluation (3ie) throughout 2015.
The first webinar is introductory in nature and provides an overview of impact evaluation and cover topics such as what to include in a ToR, how to select and manage an evaluation team, and the key steps that must be planned for in an impact evaluation. Anyone interested in the basics of impact evaluation is encouraged to view this recording.
Listen to the Q&A
What is impact evaluation? Are we talking just about randomised trials or something more?
How can you manage the politics when there are significantly huge negative impacts and you can attribute them to a program you are involved in, or when the findings are not palatable to management?
We can’t always have an impact evaluation per se, but at the same time “impact” is one of the OECD DAC evaluation criteria. How can we strengthen the “impact” part of any evaluation we have?
When and how can we assess the feasibility of doing an impact evaluation? Is it possible to have a real impact evaluation or are there constraints and should we be realistic and conduct an evaluation assessing OECD/DAC “Impact” criteria?
Do you have any suggested solutions to address an issue where the program will be re-targeted between the mid- and end-line evaluations?
Can impact evaluation designs be used to evaluate upstream policy work (e.g. how UNICEF’s work contributes to changes in government policy and the impact this has on children)? What needs to be the focus when evaluating impact for a particular policy as opposed to programmes?
Tracking policy implementation and system change is challenging for a small team so what should the focus of the evaluation be?
About this webinar series
Throughout 2015, BetterEvaluation partnered with the UNICEF Office of Research – Innocenti to develop eight impact evaluation webinars for UNICEF staff. The objective was to provide an interactive capacity-building experience, customized to focus on UNICEF’s work and the unique circumstances of conducting impact evaluations of programs and policies in international development. The webinars were based on the Impact Evaluation Series – a user-friendly package of 13 methodological briefs and four animated videos – and presented by the briefs' authors. This page provides links not only to the eight webinars, but also to the practical questions and their answers which followed each webinar presentation.
The findings, interpretations and opinions expressed in the webinars are those of the presenters and do not necessarily reflect the policies or views of the United Nations Children’s Fund (UNICEF). The presenters are independent impact evaluation experts who were commissioned by UNICEF to prepare the webinars and use their own knowledge and judgement on key issues and to provide advice. The questions and comments reflected in the Q & A materials are based on those submitted by UNICEF staff as part of this capacity-building initiative. They do not necessarily reflect the policies or views of UNICEF.
The webinars were commissioned by UNICEF and UNICEF is entitled to all intellectual property and other proprietary rights which bear a direct relation to the contract under which this work was produced. The materials on this page are subject to a Creative Commons license CC BY-NC (Attribution-NonCommercial) and may be used and reproduced in line with the conditions of this licence.
View all eight webinars in this series:
- Overview of Impact Evaluation - Presented by Patricia Rogers
- Overview: Data Collection and Analysis Methods in Impact Evaluation - Presented by Patricia Rogers
- Theory of Change - Presented by Patricia Rogers
- Overview: Strategies for causal attribution - Presented by Patricia Rogers
- Participatory Approaches in Impact Evaluation - Presented by Irene Guijt
- Randomized Controlled Trials (RCTs) - Presented by Howard White
- Comparative Case Studies - Presented by Delwyn Goodrick
- Quasi-experimental design and methods - Presented by Howard White