CECAN would like to thank Adam Stiles from BEIS, Charles Michaelis from SDS and Mary Anderson from CAG Consultants, for an engaging seminar on their experiences of using process tracing in realist evaluations.
The team delivered a presentation on a pilot scheme they have been working on, to encourage demand side response (DSR) to participate in the capacity market for electricity, using process tracing.
CECAN's Barbara Befani has peer reviewed this work and was involved in the scheme through her work on bayesian updating.
The seminar was filmed and can be viewed below via our Youtube channel.
CECAN were pleased to host a webinar with Dr Martin Reynolds from the Open University on 24th July. Martin presented his work on developmental evaluation, which endeavours to reconfigure evaluation practice away from merely serving purposes of external accountability of policy towards making evaluation integral to the dualistic practice of policy making and policy implementation.
A framework of developmental evaluation was introduced based on a simple heuristic founded on three principles from a tradition of systems thinking in practice – understanding inter-relationships, engaging with multiple perspectives, and reflecting on boundary judgements. Two case stories of developmental evaluation were used to illustrate the workings of the heuristic towards making policy and making policy work.
If you were unable to join the webinar, you can watch/listen to the session via our Youtube channel below. Martin has also kindly made his slides available for download here.
On 11th July nearly 200 delegates attended CECAN’s annual conference in the elegant and central London venue of One Birdcage Walk. Just across the road is HM Treasury, so as we enjoyed our tea and lunch, we were able to peer through the windows of the UK government policy-making machine and ponder how it is addressing the complexities of the policy and evaluation challenges now facing the UK, and also how it might benefit from the rich and insightful discussions taking place at the conference.
The Challenges of Complexity for Government
On April 25, BEIS and CECAN held a workshop bringing together members of the CECAN team with analysis and policy leads in BEIS, responsible for the £505million Energy Innovation Programme (EIP).
The workshop explored options for the development of an evaluation strategy for the programme; it is the first activity in the ongoing support CECAN will offer in this key policy area.
The programme is made of many projects with diverse aims and contexts, and has key objectives around energy innovation, meaning there are many evaluation challenges.
Brian Castellani, CECAN Fellow, recently ran a workshop at Warwick University along with Pete Barbrook-Johnson.
They met with Tim Sunderland of Natural England and what Brian describes as a group of great people from DEFRA and Natural England!
The purpose of the workshop was to continue to design the COMPLEX-IT software to make it better for policy evaluation and to help the participants think better about their policy evaluation from a complex systems perspective, including what types of databases and methods would be necessary to do so, such as agent-based modelling, systems mapping and case-based modelling.
It was noted that case based modelling and COMPLEX-IT may be particularly useful in natural capital efforts.
To find out more about the COMPLEX-IT toolkit please visit Brian’s blog.
CECAN Fellow Joanna Boehnert has recently published a poster associated with her funded fellowship project entitled, "The Visual Representation of Complexity."
The poster provides a definition, examples, and a simple diagram to visualise a range of complexity concepts.
Sustainability practitioners have long relied on images to display relationships in complex adaptive systems on various scales and across different domains.
These images facilitate communication, learning, collaboration and evaluation as they contribute to shared understanding of systemic processes.
Joanna's research has addressed the need for images that are widely understood across different fields and sectors for researchers, policy makers, design practitioners, and evaluators with varying degrees of familiarity with the complexity sciences.
Joanna worked with the CECAN team in design workshops to help them clarify and illustrate their definitions of some key characteristics of complex systems.