What we considered before researching with people who are visually impaired

Co-op Insurance talked about usability testing with people who are visually impaired last week on the Digital blog.   

Improving and influencing better accessibility where we can is important. This post describes how we prepared for the sessions. We hope it encourages more product teams to test with people with a range of access needs.  

1. Charities can help you recruit

We’d found it challenging and time-consuming to find participants who are visually impaired through recruitment agencies so UX designer Paul Braddock made direct contact with the Royal National Institute of Blind People (RNIB). Although it took a while to get approval for our post which asked for participants on the RNIB’s social media page, the number of respondents was worth it. Charities and specialist organisations that have a vested interest in – and access to – a group of people you’re trying to find seem to be very willing to collaborate.  

 2. Ask participants to bring their own device 

Observing someone using your product or service on their own device gives a more accurate indication of how they would interact with it outside a research session.  

When we asked our participants to bring their own tech, we learnt a lot about the additional software they used too. For example, one participant brought their laptop and showed us Dolphin Supernova – a magnifier and screen reader they use to zoom in on a page, read it aloud, and replace colours that are difficult for them to differentiate between. They told us they “can’t function without it”. But, if we hadn’t asked them to bring their own device, we would most likely have asked them to use one of our Macs which Dolphin Supernova isn’t compatible with. In that situation, we’d have missed out on seeing our service in a realistic context.  

3. Send digital consent forms

We sent out digital consent forms through Consent Kit before the sessions so that participants could take their time reading them with their assisted technology and understanding what they were signing up for. We knew that paper forms would likely be more time-consuming and less preferable. We also couldn’t anticipate what problems there may be with talking through and then signing digitally in the sessions so it felt important to sort out consent beforehand. 

 4. Talk about travel arrangements  

If you ask visually impaired participants to get to a venue, find out how they plan to get there and whether they’d like you to meet them off public transport. Paul met one of our participants at Manchester Victoria station. She’d never been to Manchester on her own before and told us she found big cities a bit overwhelming. They navigated the short walk to Federation House together and the chat on the way worked as an extra warm up to the session.
 

5. Allow for extra time

Factor in extra time for practicalities like travellingaccessing the building and keep in mind that participants might not instantly feel comfortable in an unfamiliar venue so your introduction may take a little longer while you help them to relax. 

A participantpersonal device may take longer to load or update than you’d expect tooOne of the participants we met had specialist screen reader equipment that took a little while to set up on their mobile phone. Around half way through the session, they felt that because they were using the zoom so much, it would be easier for them to switch to a desktop device – they said this is what they would have done at home. Changing over and setting up again also took a little extra time. Seeing this sort of thing is really insightful though, so scheduling extra time means you won’t be tempted to feel like it’s an inconvenience. 

 

6. Go off script – you might learn more

Sometimes the thing you’re testing just won’t meet a participant’s accessibility needs and as demoralising as that is, it’s better to see those problems early. So, as with any usability testing, be prepared to change direction if a participant is struggling with a task because you’re still likely to learn a lot. 

We often found that participants used the service in ways we hadn’t anticipated so if an accessibility issue came up it made sense to discuss straight away, learn from it, and then move back to the script. For example, one of the participants we spoke to zoomed into pages by default. A lot of what we discussed in the session wasn’t in our discussion guide, but we were still getting useful insights. 

Testing with people with other types of access issues

So far, we’ve only run sessions with people who are visually impaired. Of course, there are many more types of vulnerable user and testing with a range of needs is important. This is a good start though.  

If you’ve tested your product or service with people who are visually or hearing impaired, or have a motor or cognitive disability, we’d like to find out what considerations you had before running your sessions. Share it in a comment below or tweet @CoopDigital. We’ll keep it in mind.  

Catherine Malpass 
Lead user researcher 

Co-op Insurance: Usability testing with people who are visually impaired

This is a guest post about Co-op Insurance and their website, co-opinsurance.co.uk. The author is Paul Braddock, a user experience designer who works on it.

In the summer, we blogged about how and why we asked AbilityNet to carry out an accessibility audit on the Co-op Insurance website. The post explained the content, design and technical improvements we made off the back of it. To continue our work around better accessibility, the Insurance design team recently did usability testing with visually impaired users. 

In this post we share what we learnt from the testing and how we’re making improvements. 

What we tested

The Insurance team is responsible for co-opinsurance.co.uk. This includes managing the product information and financial promotions for each type of insurance. Buying journeys begin on our site but once a user chooses ‘Get a quote’, their online journey passes over to a partner’s site.

We can’t necessarily fix the accessibility issues we identify on a partner sites, but we can influence them. We’re actually in the process of creating a set of accessibility guidelines that cover our expectations of our partners.

Catherine Malpass from the Co-op Digital team and Louisa Robinson from Insurance ran the usability sessions. We focussed the testing on the travel section of the website including the buying journey. We wanted to look at how easily visually impaired users could:

  • navigate the journey
  • understand information – particularly in tables
  • interact with a pop up

We kept what we’d learnt from the audit in mind when we were considering what to test. 

Positive things that came out of the testing

During the testing, we heard positive feedback about:

  • the in-page navigation and clear labelling which helped users read and identify content quickly. One participant said it’s “fairly easy to find your way around and there’s a decent menu I can use to navigate to other insurance products.”
  • the colours on the homepage because – along with icons – they help users differentiate between the 2 products. “I like that the colours for car and home insurance are different,” said one participant. “I like having the icons next to the product names because they make it obvious and easier to navigate.”
  • the consistency of the page layout. A participant said that “the pages are similar all the way through so you can memorise where things like the next and back button are.”

Areas that need more work 

However, the testing also showed us that some features weren’t compatible with screen readers. We noted them along with recommendations for how to improve them. 

Things we’ve iterated on already include:

  1. How a screen reader reads out the prices in tables. We’ve changed the aria labels so that monetary values are read out how we’d naturally say them, for example, “thirty-three pounds eighty-four” instead of “pound symbol three three full stop eight four”. We don’t feel we should be asking people with visual impairments to work harder to use our service and we think that making this change will reduce some of the cognitive load. 
  2. How well we use alternative text (alt text). Testing threw up instances where images were tagged with the type of product or policy they were there to support. We’ve changed them so they fulfil their role of describing the content of the image. This makes the service more inclusive. 
  3. Making images clickable. The screen grab of our travel product page below shows 3 insurance products (multi-trip annual, single trip and backpacker). Each has an image, the name of the product with a link that takes them to a more detailed product page, and a line of copy to help the user decide if it’s suitable for their needs. Testing showed us that when the user zooms in on the page (common for someone who is visually impaired), or if they’re using a screen reader, the link is difficult to navigate to and then difficult to access. There was an expectation that images should be clickable, so we’ve now made each image clickable which makes the information quicker to find. 

The image shows a screen grab of our homepage below shows 3 insurance products (multi-trip annual, single trip and backpacker). Each has an image, the name of the product with a link that takes them to a more detailed product page, and a line of copy to help the user decide if it’s suitable for their needs.

Things in the backlog we hope to complete before Christmas include:

  1. How a screen reader reads icons in tables. At the moment it reads “tick” or “cross” but we’ve added aria labels so tick symbols will read as “included”, and crosses as “not included” on our next release.
  2. Test alternatives to the pop up. We saw the screen reader struggle and the participants become confused with a pop up on the single trip online journey, shown in the screen grab below. We’ll be looking at how we can give users the same information in a more accessible way. For example, we may embed the content at different points in the journey instead. 

Screen grab show a pop up prompting the user to upgrade to an annual multi-trip policy. the pop up hides much of the content on the webpage.

Things we’re encouraging our third-party partners to look into include:

  1. The live chat feature.  This feature wasn’t compatible with screen readers so thinking about how to improve it or even considering alternative ways to communicate with users instantly is one of our recommendations. At the moment, the feature also covers up content on the page so we recommend looking into how to help the user feel more in control – this might mean giving an option to remove / minimise /block the live chat. 
  2. How we present information. In the testing we saw users become a bit overwhelmed when comparing information. We recommend a review of how we display content when comparing price and cover in insurance tiers.
  3. The postcode finder. Right now, when a user starts to type in a postcode, the screen reader repeats “there are zero results for this postcode” until the field is complete. This makes it difficult for users to hear – and check – which letter or number they’ve just typed. We recommend looking into how this can be improved.

Carrying on testing, iterating, improving and influencing

Accessibility should be a consideration right from the start when we design products and services. At Co-op Insurance there’s a lot linked to our site that we cannot control but we can influence. We’ll continue to test with people with access needs and we’ll keep trying to improve the experience for everyone so it’s as inclusive as possible. 

We’ll also share our research findings, audit feedback and blog posts with our external insurance partners to help raise awareness of the importance of accessibility.

Paul Braddock
UX Designer from Co-op Insurance

An accessibility audit for the Co-op Insurance website

This is a guest post about co-opinsurance.co.uk – a product developed by a team within Co-op Insurance. The author is Paul Braddock, an interaction designer who works on it.

There are a lot of reasons for checking and improving how accessible co-opinsurance.co.uk is. In the crudest terms, it makes good business sense: the more people who don’t find it frustrating to use, the more potential customers we have. 

But the purpose of accessible design is far more than making a sale. 

AbilityNet estimate there are 19.1 million people in the UK who may have physical, cognitive, visual or hearing impairments that could affect how they interact with the world online. Equality is one of Co-op’s values and it states all members should have the opportunity to be involved. Being inclusive is part of what we do at Co-op and it’s what we strive for in our design.

With this in mind we commissioned a technical accessibility audit of the site. This post is about the recommendations made, how we’re tackling them and the effect we hope setting a standard will have on our partners.

Defining the scope

Our data analyst Nick Jones looked at the site’s traffic and identified the most common user journeys we see on co-opinsurance.co.uk He also pulled out our most frequently used page templates so that if one of those wasn’t accessible, fixing it would mean we could fix a lot relatively quickly.  

We worked on 10 sample website pages with AbilityNet who would be checking to see if the pages comply with the W3C Web Content Accessibility Guidelines version 2.0 (WCAG 2.0). To get the most value from the audit testing was carried out using JAWS for desktop and Talkback for Android, across all major browsers including Chrome, IE11 and Firefox.

Issues identified

Across the 10 pages, AbilityNet found 18 issues which would affect people who use assistive technology to navigate our website. They estimate 3.8 million people in the UK use assistive technology such as screen readers. They also identified issues that would impact 2.3 million people in the UK who may have difficulty seeing the screen. 

Of the 18 issues, they deemed 3 to be ‘high priority’ because aria labels were not in place so screen readers would not read out:

  1. Icons in tables.
  2. Dropdown options in our live chat feature.
  3. Our sticky ‘Live chat’ button.  

Here’s an example of a table we use on the site. 

insurance-travel-tableThe ticks and crosses are the icons that weren’t announced to users. For example, the ticks and crosses in the table shows that platinum multi-trip insurance includes cruise cover but bronze, silver and gold don’t. However, a screen reader would have announced, “platinum blank column 5”. Not only are the icons not compatible with screen readers, we hadn’t made the information available elsewhere on the page. 

Here’s a screenshot of issue 2: live chat dropdown options.

insurance-yd-chat-dropdown

The live chat window has a drop down so that users can indicate what they’d like help with. But screen readers don’t announce it, so users are at risk of not knowing what the options are. This would have a major impact on our users who are dependent on using live chat as a preferred method of contact.

And below is how the sticky live chat button looks (issue 3).

insurance-car-chat

With our live chat feature, neither the label or the fact it is a button is announced by a screen reader. Which means that screen reader users may not know that the button and method of contact exists.

How we’re fixing them

AbilityNet also gave recommendations on how to fix the issues they identified. Our content, design and developer teams are now in the process of fixing the 18 issues that were identified and taking what we learnt from the audit and applying the fixes across the whole of co-opinsurance.co.uk 

The content team were able to fix their issues straight away, as only minor tweaks to aria labels where required for certain products. James Martin has development fixes in progress and these changes will form part of a future code release. We’ve also been speaking with the external team who built our live chat and to make sure the problems that were identified are prioritised for their future releases.

Hoping to influence good behaviour

The audit was just for co-opinsurance.co.uk – that’s what we own and manage. However, our ‘quote and buy’ journeys are owned and managed by our underwriting partners so once a user clicks ‘get a quote’, their online journey passes over to a partner’s site.

Just like the issues that were identified with our live chat, we can’t necessarily fix them but we can influence them. We are therefore in the process of creating a ‘standard’, similar to a set of guidelines, that would cover our expectations and best practices when it comes to accessibility for our partners. This could eventually be fed into our Design system if we believe it brings value to other areas of the Co-op.

We recognise that inclusive design is a process so we are taking additional steps in our ways of working to make sure that we don’t exclude people when they come to our website:

  • by including accessibility checks in our quality assurance process when publishing new content or doing development improvements
  • using open source tools such as Accessibility Insights and Lighthouse to check co-opinsurance.co.uk on a quarterly basis
  • recruiting Co-op members with accessibility issues for our user research – if you would like to get involved email: gidigital@co-opinsurance.co.uk

Paul Braddock
Designer from Co-op Insurance