Home / posts / Blog / Clearing the Fog

Clearing the Fog

May 4, 2016 | Blog

Development actors facing pressure to provide more rigorous assessments of their impact on policy and practice need new methods to deliver them.

There is now a broad consensus that the traditional counterfactual analysis leading to the assessment of the net effect of an intervention is incapable of capturing the complexity of factors at play in any particular policy change.

We suggest that evaluations focus instead on establishing whether a clearly-defined process of change has taken place, and improve the validity and credibility of qualitative impact statements.

IIED research in Uganda shows that the methods of process tracing and Bayesian updating facilitate a dialogue between theory and evidence that allows us to assess our degree of confidence in ‘contribution claims’ in a transparent and replicable way.

Full article from CECAN’s Barbara Befani

CECAN Webinar – The benefits and challenges of conducting research with impact ‘built in’: reflections and findings from an evaluation of Electronic Monitoring with the Ministry of Justice, with Ian Brunton-Smith. 23 Jun, 1 - 2pm BST. Includes live Q&A! Register free: www.cecan.ac.uk/events/cecan...

[image or embed]

— CECAN (@cecan.bsky.social) April 9, 2025 at 12:22 PM

*New Resource* - 'Guidance on using large language models to extract cause-and-effect pairs from texts for systems mapping', written by Jordan White and Pete Barbrook-Johnson. See: www.cecan.ac.uk/resources/to...

[image or embed]

— CECAN (@cecan.bsky.social) April 3, 2025 at 2:53 PM
Share This