CECAN Webinar: Making Policy and Making Policy Work with Developmental Evaluation

Dr Martin Reynolds


CECAN were pleased to host a webinar with Dr Martin Reynolds from the Open University on 24th July. Martin presented his work on developmental evaluation, which endeavours to reconfigure evaluation practice away from merely serving purposes of external accountability of policy towards making evaluation integral to the dualistic practice of policy making and policy implementation. 

A framework of developmental evaluation was introduced based on a simple heuristic founded on three principles from a tradition of systems thinking in practice – understanding inter-relationships, engaging with multiple perspectives, and reflecting on boundary judgements. Two case stories of developmental evaluation were used to illustrate the workings of the heuristic towards making policy and making policy work.

If you were unable to join the webinar, you can watch/listen to the session via our Youtube channel below. Martin has also kindly made his slides available for download here.


Policy Evaluation for a Complex World

Policy Evaluation for a Complex World


On 11th July nearly 200 delegates attended CECAN’s annual conference in the elegant and central London venue of One Birdcage Walk. Just across the road is HM Treasury, so as we enjoyed our tea and lunch, we were able to peer through the windows of the UK government policy-making machine and ponder how it is addressing the complexities of the policy and evaluation challenges now facing the UK, and also how it might benefit from the rich and insightful discussions taking place at the conference.

The Challenges of Complexity for Government

Evaluating the Energy Innovation Programme: CECAN Supporting BEIS Strategy.

Energy Innovation


On April 25, BEIS and CECAN held a workshop bringing together members of the CECAN team with analysis and policy leads in BEIS, responsible for the £505million Energy Innovation Programme (EIP).

The workshop explored options for the development of an evaluation strategy for the programme; it is the first activity in the ongoing support CECAN will offer in this key policy area.

The programme is made of many projects with diverse aims and contexts, and has key objectives around energy innovation, meaning there are many evaluation challenges.

Workshop on Case Based Modelling

Case Based Modelling


Brian Castellani, CECAN Fellow, recently ran a workshop at Warwick University along with Pete Barbrook-Johnson.

They met with Tim Sunderland of Natural England and what Brian describes as a group of great people from DEFRA and Natural England! 

The purpose of the workshop was to continue to design the COMPLEX-IT software to make it better for policy evaluation and to help the participants think better about their policy evaluation from a complex systems perspective, including what types of databases and methods would be necessary to do so, such as agent-based modelling, systems mapping and case-based modelling.

It was noted that case based modelling and COMPLEX-IT may be particularly useful in natural capital efforts.

To find out more about the COMPLEX-IT toolkit please visit Brian’s blog.


The Visual Representation of Complexity

The visual representation of complexity


CECAN Fellow Joanna Boehnert has recently published a poster associated with her funded fellowship project entitled, "The Visual Representation of Complexity."

The poster provides a definition, examples, and a simple diagram to visualise a range of complexity concepts.

Sustainability practitioners have long relied on images to display relationships in complex adaptive systems on various scales and across different domains.

These images facilitate communication, learning, collaboration and evaluation as they contribute to shared understanding of systemic processes.

Joanna's research has addressed the need for images that are widely understood across different fields and sectors for researchers, policy makers, design practitioners, and evaluators with varying degrees of familiarity with the complexity sciences. 

Joanna worked with the CECAN team in design workshops to help them clarify and illustrate their definitions of some key characteristics of complex systems.

CECAN Hosts Systems Mapping Workshop at BEIS.

CECAN Hosts Systems Mapping Workshop at BEIS


CECAN recently ran a systems mapping workshop at BEIS with a range of stakeholders from industry and government, looking at biogas and biomethane production and usage, as part of our case study on the Renewable Heat Incentive (RHI).

Pete Barbrook-Johnson, Alex Penn and Anna Kaxira helped  to develop a systems map of the biogas and biomethane production/use system. They are now working on verifying and refining the map. The final map and an associated report to BEIS will be used to: (i) inform theory and data collection in the ongoing evaluation of reformed RHI, and (ii) inform future policy planning in relevant policy areas.


Systems Mapping