Co-op Insurance talked about usability testing with people who are visually impaired last week on the Digital blog.
Improving and influencing better accessibility where we can is important. This post describes how we prepared for the sessions. We hope it encourages more product teams to test with people with a range of access needs.
1. Charities can help you recruit
We’d found it challenging and time-consuming to find participants who are visually impaired through recruitment agencies so UX designer Paul Braddock made direct contact with the Royal National Institute of Blind People (RNIB). Although it took a while to get approval for our post which asked for participants on the RNIB’s social media page, the number of respondents was worth it. Charities and specialist organisations that have a vested interest in – and access to – a group of people you’re trying to find seem to be very willing to collaborate.
2. Ask participants to bring their own device
Observing someone using your product or service on their own device gives a more accurate indication of how they would interact with it outside a research session.
When we asked our participants to bring their own tech, we learnt a lot about the additional software they used too. For example, one participant brought their laptop and showed us Dolphin Supernova – a magnifier and screen reader they use to zoom in on a page, read it aloud, and replace colours that are difficult for them to differentiate between. They told us they “can’t function without it”. But, if we hadn’t asked them to bring their own device, we would most likely have asked them to use one of our Macs which Dolphin Supernova isn’t compatible with. In that situation, we’d have missed out on seeing our service in a realistic context.
3. Send digital consent forms
We sent out digital consent forms through Consent Kit before the sessions so that participants could take their time reading them with their assisted technology and understanding what they were signing up for. We knew that paper forms would likely be more time-consuming and less preferable. We also couldn’t anticipate what problems there may be with talking through and then signing digitally in the sessions so it felt important to sort out consent beforehand.
4. Talk about travel arrangements
If you ask visually impaired participants to get to a venue, find out how they plan to get there and whether they’d like you to meet them off public transport. Paul met one of our participants at Manchester Victoria station. She’d never been to Manchester on her own before and told us she found big cities a bit overwhelming. They navigated the short walk to Federation House together and the chat on the way worked as an extra warm up to the session.
5. Allow for extra time
Factor in extra time for practicalities like travelling, accessing the building and keep in mind that participants might not instantly feel comfortable in an unfamiliar venue so your introduction may take a little longer while you help them to relax.
A participant’s personal device may take longer to load or update than you’d expect too. One of the participants we met had specialist screen reader equipment that took a little while to set up on their mobile phone. Around half way through the session, they felt that because they were using the zoom so much, it would be easier for them to switch to a desktop device – they said this is what they would have done at home. Changing over and setting up again also took a little extra time. Seeing this sort of thing is really insightful though, so scheduling extra time means you won’t be tempted to feel like it’s an inconvenience.
6. Go off script – you might learn more
Sometimes the thing you’re testing just won’t meet a participant’s accessibility needs and as demoralising as that is, it’s better to see those problems early. So, as with any usability testing, be prepared to change direction if a participant is struggling with a task because you’re still likely to learn a lot.
We often found that participants used the service in ways we hadn’t anticipated so if an accessibility issue came up it made sense to discuss straight away, learn from it, and then move back to the script. For example, one of the participants we spoke to zoomed into pages by default. A lot of what we discussed in the session wasn’t in our discussion guide, but we were still getting useful insights.
Testing with people with other types of access issues
So far, we’ve only run sessions with people who are visually impaired. Of course, there are many more types of vulnerable user and testing with a range of needs is important. This is a good start though.
If you’ve tested your product or service with people who are visually or hearing impaired, or have a motor or cognitive disability, we’d like to find out what considerations you had before running your sessions. Share it in a comment below or tweet @CoopDigital. We’ll keep it in mind.
Lead user researcher