This section will help you develop your own approach to measuring wellbeing. From essential planning, to the types of questions you can ask for the aspects you want to measure.
Julie knows from previous projects that it can be hard to get data from people after they have left the project, so she decides that she will implement her survey when new people start and finish activities to try and increase the amount of data she has for analysis.
She also knows that being a young person can be tough, and she doesn’t want to cause any distress to members of the youth club about their social networks. She gets in touch with a local youth organisation to speak to practitioners about how to embed safeguarding in the design of the survey, including guidance on questions and signposting for support if needed.
She decides to create both paper and electronic versions of the survey, so that they can be answered by participants in a way that feels comfortable to them. Both versions will be entered into the electronic version of the survey that only she and one other member of staff can access, and the paper versions disposed of in the confidential waste.
Finally, she creates an information sheet to describe what the questionnaires are, why the data is being collected, how it will be stored and what will happen to the results. Doing this helps her to make sure that participants can give informed consent before they take the survey.
There are a few things you need to do before you start measuring wellbeing:
Decide which groups you need to compare and just ask the right questions for them.
The specifics you want to measure and what to ask
Measuring wellbeing can help you improve what you do. Good data tells you what you’ve achieved and why. So you can find out what to do more or less of to make an even bigger difference in the future.
The questions you ask depend on why you want to measure wellbeing and what you want to measure specifically. For example, you might want to find out:
What you want to know will not only influence your questions but how you collect and analyse the data.
Here are a few prompts about what to measure and why it could be helpful.
|What to measure||Why measure it||What it means for your questions and survey design|
|The wellbeing of people when they join your activity (this is your baseline)||It might help you:|
• understand if you’re ‘targeting’ in the way you intended
• get a bigger picture of the people who use your service and how the changes your activity is making fit into their lives.
|To compare your new starters with others around the UK, you need consistent questions. Like those by the Office of National Statistics (ONS) or the Warwick-Edinburgh Mental Well-being Scale (WEMWBS) (see Section 5).
To understand different aspects of people’s lives, you can ask domain-specific questions, for example about their relationships or work. You can compare the answers with the national results as well (see Section 9).
Using open questions will mean people can answer in their own words.
|Whether people’s wellbeing has improved since they started your activity||It might help you understand your full impact – how the way people feel or function has changed (‘soft’ outcomes) even if there’s been no ‘hard’ outcome, like getting a job.||You’ll need to ask your wellbeing questions before and after your activity, in exactly the same way. This is to make sure you can compare the answers and get reliable results.|
|How different people improve their wellbeing in different ways. For example, see Sam and Lou’s journeys in section 2)||It might help you tailor your services or activities better. For example, you might find the impact you have differs between people |
• in different age groups
• from different backgrounds
• with a lower wellbeing to start with.
|You’ll need to include questions on demographics (for example, age gender and ethnicity). See Section 8 for some options.|
|How your impact on wellbeing changes if you run the same activities in different ways or settings.||It might help you have a bigger impact on wellbeing. If you find people benefitted more from an activity in a certain location or with specific support, you know what you can do to get better results.||You’ll need to use questions about context or be able to split your responses into different groups. For example, by asking things like ‘did you work with a mentor?’ or ‘did you only use the online tools?’ you’ll be able to see which mechanisms are more effective.|
|Why changes in wellbeing have taken place and / or what changes are related to any improvement in wellbeing (for example better social connection or more confidence)||It can help you:|
• understand the most important factors for this group
• tailor your activities to improve their wellbeing even more.
You may be able to achieve the same impact in a different way, if you explore these ‘intermediate changes’ – the smaller changes that help people increase their wellbeing even more later on or meet the aims of a specific project.
|You’ll need to include questions about the intermediate changes you think are important. For example, changes in social relations or confidence. Have a look at Section 5 and Section 6 for some pointers.
Using open questions can help you understand what’s changed and some of the unexpected reasons why.
|The difference between your group and the local or national picture||You can use this to understand if your services are effective compared to similar organisations in other areas.|
If people using your services have lower than average wellbeing, you might be able to use this to make a case for more funding.
|You will need to ask consistent questions (like the ONS, WEMWBS or social capital questions in Section 5) so you can compare the answers reliably to national figures.|
NCVO Knowhow Nonprofit has all sorts of advice, support and resources to help you plan, do and use your impact evaluation. You’ll also find a range of resources at Inspiring Impact – including datasets, diagnostic tools, and data visualization apps.
The Arts Observation scale (ArtsObs)
You can use this tool to find out how performing arts activities affect wellbeing in healthcare settings. It’s a way to watch for people’s moods and reactions, and measure the effect the activity has on their wellbeing on a set scale.
The ‘Measuring Wellbeing Creatively’ project
This project is funded through a UCL Grand Challenges: Human Wellbeing Award, and works with people who have communication difficulties because of a brain injury or stroke. It explores how different colours and sensations can help them express feelings and emotions, which may help to measure their wellbeing.
Before and after
To understand changes in wellbeing, you need to know how people felt before your activity and what would have happened if they didn’t. So ask the same questions before and after the activity so you can compare their answers.
Sometimes you won’t be able to do a survey at the start of the activity (for example if it’s a long-running activity, and or a casual drop-in). In this case, you can ask people later how they feel things have changed for them during your activity. If you go down this route you may get less accurate or more biased answers than with a before and after survey – and you may not have a robust baseline to compare the answers to. However, this is still a good method if you can’t do before and after surveys.
Follow-up later on
It can be useful to follow up a few months or even a year after a programme to see how long the improvements last.
If you’re doing a face-to-face survey, it’s important to pick the right person to ask the questions. They need to:
If you can, ask relevant experts to help – who understand your group and follow your safeguarding procedures.
Be sensitive to your audience
There may be some wellbeing questions that are not suitable for your audience. For example, for people who have just become involved with your organisation or come to you in a crisis. So use your judgement. You could start with open questions, so they can answer how they like. Or wait until you have a comfortable relationship before you ask anything.
Don’t include lots of questions if it makes the survey so long that people will give up or you won’t have time to analyse all the answers.
Use the Survey builder in section 8
It will help you create the questions you need for your survey. And NCVO Knowhow Non Profit has lots of extra information if you need more guidance about doing a questionnaire.
Choose carefully: The questions we recommend in Section 5 are based on the latest thinking in wellbeing research and evaluation. But you don’t have to include them all – just what’s useful for your organisation.
Use demographic questions if you want to compare the wellbeing of groups of people with different characteristics. You can identify things like gender, age and ethnicity. In Section 8, we’ve included some from UK government surveys
Think about the data
Section 5 will help you structure your thinking and decide:
Then you can start to get creative, and think about the different ways to ask your questions.
Choose your format
Think about your audience and chose the best format for them. For example, you can try:
Make your survey clear
Your questions need to be simple and easy to understand for everyone. But some groups may need extra guidance:
When to ask wellbeing questions
Some people’s answers can be influenced by questions from earlier in the survey. So try to ask wellbeing questions as early as you can, ideally just after some demographic questions to ease people into it. That way you’re likely to get more accurate answers.
Repeat your survey: remember, to measure the difference in wellbeing between the start and end of your programme, do your survey in exactly the same way before and after – right down to the order of the questions.
How to get reliable answers
If you’re after a true picture of how people are doing and what part you played, make sure people can be honest with you.
If people have worked with you before, they may be invested in your work and tell you what they think you want to hear, rather than giving real feedback. You can encourage people to be honest about their experiences if:
Avoid bias: just asking questions can influence how people feel and what they do. Some changes in wellbeing may even be down to you asking the questions, rather than your activity. You can address this, and other types of bias, with larger-scale evaluations. For example, Randomised Control Trials.
Get informed consent
This means you need to tell people what you want to use their answers for and get their permission before you start your survey.
Follow the Data Protection Act
It’s important nobody can identify the people who took part in your survey from your results. So you need to handle everyone’s personal information in line with the Data Protection Act. Find out more at NCVO Knowhow Nonprofit