There has been some interesting discussions on the XCeval listserve that are relevant for BetterEvaluation that we thought we'd share with you.
The initial question was asking for qualitative impact evaluation options and tools for conducting rigorous IE. There were several responses which I'll summarise:
Two papers were shared:
- The Qualitative Option of Impact Analysis by Lawrence Mohr (abstract only)
- Additionality: a useful way to construct the counterfactual qualitatively? by Julie Hind
There was a call for more rigorous use of the term 'rigorous', reminding us of the dictionary definition of rigorous and suggesting that it's better to be approximately right than precisely wrong.
A recent collection of qualitative options put together by 3ie was shared. This included:
- Contribution analysis: http://www.inteval-group.org/IMG/pdf/ILAC_Contribution_Analysis-2.pdf
- Realist Evaluation: http://www.communitymatters.com.au/RE_chapter.pdf
- General Elimination Methodology: http://survey.ate.wmich.edu/jmde/index.php/jmde_1/article/view/160/186
- Qualitative Comparative Analysis (QCA): http://eprints.ncrm.ac.uk/250/1/What_is_QCA.pdf
- Success Case Option (SCM): http://aetcnec.ucsf.edu/evaluation/Brinkerhoff.impactassess1.pdf
- Outcome Mapping: http://www.cgiar-ilac.org/files/publications/briefs/ILAC_Brief07_mapping..., http://www.outcomemapping.ca/
- MAPP Option for Impact Assessment of Programmes and Projects: www.ngo-ideas.net/mediaCache/MAPP/
- Most Significant Change (MSC): http://www.mande.co.uk/docs/MSCGuide.pdf
Since this is a topic close to BE's heart, it would be good to hear if anyone else has ideas to contribute to the discussion. Perhaps it could result in a blog post on the BE site.
Specifically, it would be good to know if you have any other qualitative options to add to the list above. Post them here if you do.