Evaluating the framework’s impact

Evaluation is crucial to implementing a public health approach.

It allows us to understand the impact of activity, including any unintended consequences so we can learn how to improve programmes and activity and build on what works.

Wales Without Violence Evaluability Assessment

In 2024, DECIPHer at Cardiff University were commission by the Wales Violence Prevention Unit, including the Public Health Wales Violence Prevention Team, to conduct an evaluability assessment of the Wales Without Violence Framework. The aim of this assessment was to understand whether the Framework was ready for a full evaluation and, if so, the types of questions an evaluation would be able to answer.

Evaluability assessments can be a useful and cost-effective way to prepare programmes or activities for evaluation by identifying key stakeholders to take part in the evaluation and establishing what needs to be in place or improved within the programme or activity to support measurement for evaluation.

The assessment explored what data is available to support evaluation, engaged stakeholders to learn how they are using the Framework, and sought to understand what effect the development and implementation of the Framework is having to date.

Key findings

Through interviews with stakeholders and the programme team, as well as an exploration of sources associated with the Framework, (e.g. reports, webinars) the assessment found:

• The Framework was described by some stakeholders as a useful resource that could serve as a foundation for practice, offering a strategic direction of travel for violence prevention work in Wales.
• The Framework was considered suitable for work with all populations of young people including those considered at risk or most vulnerable to violence.
• There are uncertainties regarding the delivery mechanisms and mechanisms of change for the Framework felt both by stakeholders and the research team, with further clarification needed regarding what is required to bring about change. Uncertainties also exist regarding the definition and application of the concepts, principles and strategies in the Framework.
• Stakeholders highlighted the challenges associated with evidencing change and impactrelated to the Framework and Frameworks in general.
• Longer-term funding and buy-in from policy and government are essential, and the research team should ensure the Framework can align to legislative and other statutory requirements.

More generally, well established existing partnership structures and agencies’ willingness to engage in partnerships supports the aims of the Framework. However, there are challenges to implementation too, including an unpredictable and unstable political and financial climate and limited staff capacity.

Learn more

Violence Prevention Evaluation Toolkit

In collaboration with Liverpool John Moores University (LJMU) Public Health Institute (PHI), the Public Health Wales Violence Prevention Team has developed an evaluation toolkit which includes information and resources for evaluating violence prevention programmes and activity.

The toolkit is for intervention service providers and programme leads in Wales and wider, to support our partners in properly evaluating their services to ensure they are having the greatest impact possible.

Download the Evaluation Checklist here (Word)