CECAN Case Study: Enforcement on Waste Crime - Environment Agency
Scrum Master: Amy Proctor, Newcastle University
CECAN team members have been providing expert advice and guidance to members of the Environment Agency’s Evidence, Assessment and Evaluation team as they seek to understand the effectiveness of their waste crime enforcement activity and develop their evaluation in this area.
A scoping workshop held in November 2016 between the EA and CECAN evaluation practitioners Helen Wilkinson and Dione Hills highlighted QCA as one approach which could enable the EA to carry out a systematic assessment of the effectiveness of their interventions across a range of cases to understand critical success factors.
This led to a second workshop in April 2017 between the EA and CECAN experts in QCA David Byrne and Barbara Befani to develop an evaluation framework and practical methodology using QCA.
CECAN Rural Development Programme for England – DEFRA
On 19th July CECAN held the first of two joint and linked workshops with DEFRA. The purpose of the first workshop was to develop a more complexity-sensitive understanding and approach to the evaluation of the current Rural Development Programme for England (RDPE).
RDPE is a major policy instrument funded out of Pillar 2 of the Common Agricultural Policy, which seeks to promote environmentally sensitive land management, community development and rural business growth.
Workshop 1 incorporated the testing of the Evaluation Assessment Tool developed by Dr Barbara Befani and BOND - the first time it has been used in a nexus policy setting. The Tool helped policy makers and evaluators to better understand the appropriateness of various complexity-sensitive evaluation methods in relation to specific evaluation questions reflecting the complex nature of the policy.
CECAN PhD Researcher, Anna Kaxira, from the Policy Studies Institute at the University of Westminster, recently attend the CIED Summer School.
The Centre on Innovation and Energy Demand (CIED)’s first ever Summer School on Accelerating Innovation to Reduce Energy Demand took place from 10-12 July 2017 at the University of Sussex, Brighton.
The Summer School provided 28 doctoral, postdoc and early career researchers with a unique opportunity to hear from leading thinkers in the fields of innovation and energy demand, to take part in collaborative learning and participatory activities, and to meet other research students and early career researchers from around the world. Anna presented the CECAN project at length which prompted a great deal of interest from attendees.
CECAN partner Professor Liz Varga of Cranfield University, recently attended the M2D 2017 Annual Conference on Decision Making Under Uncertainty. Through her talk, " The ability of models to predict the effects of policy decisions" Liz spoke at length about the CECAN project to a varied and engaged audience.
We are pleased to introduce a new member of the CECAN team. Joanna Boehnert joins us as a CECAN Fellow
CECAN Fellowship: The Visual Representation of Complex Systems: A Typology of Visual Codes for Systemic Relations
This fellowship responds to a CECAN call for proposals on the visual representation of key features of complex systems. The practice-based research project will use systems oriented design and knowledge visualisation approaches to enable the identification, classification and design of visual codes to represent complexity.
CECAN hosted a seminar at BEIS on 11th July, with Helen Wilkinson of Risk Solutions and Harry Walton of the Environment Agency talking about the use of dependency modelling to support evaluation in complex environments.
In particular the focus was on the work that Risk Solutions and the EA have been doing together on understanding and quantifying the value of flood risk management activities.
The ‘theory of change’ evaluation strategy (described in the Magenta book) was developed to help tackle evaluation of complex multi-level, multi-intervention initiatives.
Elements of theory of change mapping are now widely used to both plan and evaluate new initiatives. However, the approach has been criticized for being too ‘linear’ to effectively reflect the complexity inherent in many programmes or situations.
Dependency modelling provides one way of meeting this challenge.
Risk Solutions worked with the Environment Agency to develop and quantify a dependency model to evaluate the contribution of the different types of flood risk management activity the Environment Agency engage in on the achievement of outcomes.