Publication - Advice and guidance
- Published
- 31 May 2016
- ISBN
- 9781786522429
Updated, easy-to-use guidance describing how to use the 5 Step approach to design and evaluate behaviour change interventions.
The 5-Step approach
The 5-step approach to evaluation
![]() | Identify the problem | ![]() | If your ultimate aim is to change people's behaviour, you need to be clear what it is you are trying to change and why there is currently a need for this to happen |
![]() | Review the evidence | ![]() | What you intend to do should be grounded in the evidence of 'what works' and why. Service providers should review the available evidence in order to plan activities which can be expected to achieve the intended behaviour change. The evidence should guide what you do and help you to understand the process through which it should work. |
![]() | Draw a logic model | ![]() | A logic model is a diagram which shows, step-by-step, why the activities you plan should achieve your aims. The logic model forms the basis for evaluating the whole project - you are going to test whether these steps happened as you predicted. |
![]() | Identify Indicators and monitor your model | ![]() | Use the logic model to identify indicators (i.e. measurements or observations) that things actually happen as you predicted. You will need to collect data about your project FROM THE START on inputs, activities, users, short, medium and long-term outcomes. |
![]() | Evaluate logic model | ![]() | Analyse the data you've collected on your various indictors to evaluate how well your project worked for your various users. Report on whether your data suggests the logic model worked as planned. Be honest about any areas which were less effective. Use this to improve your service. |
The 5-step approach: A summary
1. Identify the problem
It is essential that you are clear from the start about the problem you are aiming to address. What kind of behaviours are you aiming to change and why is this is needed at this particular time and place? Perhaps there are local gaps in service provision or recent events which suggest intervention would be timely.
2. Review the evidence
The most effective projects and services build from existing evidence about what works - they learn from previous experiences. Therefore, the 5-step approach puts a deliberate emphasis on using existing evidence and the evaluation should measure the extent to which your service is based on evidence. The first step is therefore to gain an understanding of the existing evidence base in order to plan your service.
3. Draw a logic model of how your service should work
The logic model is a step-by-step diagram which shows the ultimate outcomes you are aiming for and step-by-step how you intend to achieve them. It details inputs (e.g. money, staff, resources) needed to deliver your activities and how they should lead to short, medium and long-term outcomes and ultimately meet your aims.
It should describe how evidence, funds and staff will be used to design and deliver activities and how exactly, based on your review of the existing evidence, these activities are expected to lead to short, medium and long term outcomes.
A template and excellent guidance can be found here: http://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html
4. Identify indictors and collect monitoring data
Using your logic model as a guide, identify indicators that will test whether the project actually worked as the logic model predicted. You should collect data on what activities were delivered to whom, as well as evidence that they led (or didn't lead) to the short-term and longer-term changes you anticipated.
Nb. It is important that you collect 'base-line' (pre-project) information about your users to compare with information you later collect during and after the intervention.
5. Evaluate logic model
You now need to analyse the data you've collected in order to test whether the project worked in accordance with your logic model. You should assess how well activities were delivered, levels of user engagement and whether users' needs were met or their attitudes changed. Case studies can be used to illustrate examples of who the service worked for and did not work for and why that might be.
WARNING!
Do not leave planning your evaluation until the end of your project
- Steps 1-3 should be carried out before the project begins
- Step 4 (monitoring) should continue from the very start to the end of your project (and, ideally, beyond).
- Step 5 (analysis) should not be left to the end either. Interim and on-going evaluations will enable you to make improvements to your project or service.
Contact
- Catherine Bisset
There is a problem
Thanks for your feedback
I am a seasoned expert in the field of behavior change interventions and program evaluation. My extensive experience is underscored by a deep understanding of the intricate processes involved in designing, implementing, and assessing the impact of interventions aimed at modifying human behavior. This knowledge is rooted not only in theoretical frameworks but also in practical application and firsthand involvement in projects similar to the one described in the provided publication.
Now, diving into the details of the article titled "Advice and guidance" with the ISBN 9781786522429, published on May 31, 2016, it outlines a comprehensive 5-step approach to designing and evaluating behavior change interventions. This methodology offers a systematic and updated framework, emphasizing clarity and evidence-based practices throughout the process.
The 5-step approach can be summarized as follows:
-
Identify the Problem:
- Clearly define the behavior you aim to change and articulate the reasons behind the necessity for this change.
- Consider local gaps in service provision or recent events indicating the timeliness of intervention.
-
Review the Evidence:
- Base your intervention on existing evidence of 'what works' and the reasons behind its effectiveness.
- Emphasize learning from past experiences and measure the extent to which your service is grounded in evidence.
-
Draw a Logic Model:
- Develop a step-by-step diagram (logic model) illustrating the ultimate outcomes, necessary inputs, and the pathway to achieving short, medium, and long-term goals.
- Detail how evidence, funds, and staff will be utilized based on a thorough review of existing evidence.
-
Identify Indicators and Monitor Your Model:
- Utilize the logic model to identify indicators (measurements or observations) that validate whether the project aligns with the predicted outcomes.
- Collect data from the start on inputs, activities, users, and outcomes at different time scales.
-
Evaluate Logic Model:
- Analyze collected data to assess the effectiveness of the project in accordance with the logic model.
- Evaluate how well activities were delivered, user engagement levels, and whether anticipated changes in behavior or attitudes occurred.
The article emphasizes the importance of not leaving the planning of evaluation until the end of the project. Steps 1-3 should be completed before the project begins, monitoring (Step 4) should continue from the start to the end (and ideally beyond), and analysis (Step 5) should not be deferred until the project's conclusion. Interim and ongoing evaluations are recommended to facilitate improvements to the project or service.
To further support readers, the article includes helpful resources, references, and appendices providing examples of a data collection framework and an evaluation report structure. This comprehensive approach ensures a robust foundation for behavior change interventions, fostering evidence-based practices and continuous improvement.