Accessibility: which Paralympics sites passed the test?
More than one billion people (nearly one-seventh of the population) worldwide live with some form of disability, according to the WHO/World Bank World Report on Disability.
Whether you look at it from an ethical, legal or commercial standpoint, that’s a lot of people who might struggle to use your website/mobile site/app due to problems with sight, hearing, cognitive, motor skills or physical disability.
The W3C’s Web Content Accessibility Guidelines (WCAG) 2.0 – which forms the basis for most regulations, guidelines and tests – are eight years old this December. The scope of these guidelines is currently under review, of particular interest is the task force that is considering revisions for mobile accessibility… as we will see below, mobile is different.
There’s been no Eureka moment for web accessibility akin to mobilegeddon, where everyone woke up (in fear) to the importance of mobile web.
What will it take?
There are plenty of (mobile) websites that should be leading accessibility by example:
In this column we will focus on the last two of these groups, and run some them through some automated tests on their Paralympic homepages (leaving out the sponsors).
If the results of these automated tests are to be believed (there can be issues with automated tools, including false positives) then it seems that some organizations…
…take web accessibility more seriously than others:
We’re not pointing the finger, we’re simply highlighting the importance of testing the accessibility of your website. And yes, we have run the same tests on ClickZ and it is clear there are improvements to be made here as well.
It is clear when you study the BBC’s Mobile Accessibility Guidelines, arguably the most useful resource on mobile accessibility, that the BBC has made accessibility a priority.
There’s a myth that WCAG2 only applies to people with visual impairment and/or people using screen readers (browsers that read website text and commands aloud).
That’s wrong. The WCAG2 principles and guidelines also applies to hearing, cognitive, motor skills and physical disability. But there are some gaps in its scope that it plans to address through the following task forces:
WCAG2 sets three levels of accessibility, as Marco Zehe, senior platform engineer and evangelist, in Mozilla’s accessibility team, explains:
WCAG has three levels of success:
Level A, which is the basic level everyone should aim for. This includes most screen readers, contrast, keyboard, and other accessibility criteria everyone should meet in an ideal world. This goes for desktop and mobile.
Level AA, which is all of A, but includes higher level things such as subtitling video content etc.
Level AAA, which is the absolute Olympic Gold of accessibility. This, for example, includes alternatives in simple language, videos translated into the sign language of the respective spoken language etc.
A is the bare minimum, AA should be strived for in many cases, too, and AAA is an absolute 5 star rating.
The place to start with accessibility is testing. There are three stages of accessibility testing:
Some tools are better than others: more up-to-date (check for date of release when choosing one), less false positives and easier to understand.
They don’t tend to offer benchmarks or overall performance scores. This means you need to do a comparative study of rival sites to ascertain you performance against your peers (see our Paralympics test below). And some only provide little in the way of recommendations to address the errors.
No test claims to be definitive or a substitute for manual testing. But they’re a good start and a good tool to assist with manual testing.
It’s a good idea to use a number of tools. These four were recommended by accessibility practitioners and used in our Paralympics test:
The following table shows the results of our test on the international Paralympics sites and those of the national broadcasters, using the selected automated tools.
For each test the three best performers are shaded in green, the worst in red. N.B. Results have not been adjusted for false positives.
|Paralympics sites of the top performing countries tested with accessibility tools|
|Key: the three best performing webpages are shaded in green; the worst in red.||@Andy_Favell|
There are two major problems with automated testing tools:
This is why manual accessibility testing is important.
Alan Smith, a global accessibility consultant, with Humana Healthcare and a participant in the W3C Mobile Accessibility Task Force:
“Web and mobile web should be [approached/tested] separately. Web on a mobile screen and mobile apps are two different mobile experiences as well.
None of the automated tools check mobile apps or even check responsive design pages on multiple devices.”
When testing mobile apps using the device screen reader (VoiceOver on iOS and Talkback on Android) the biggest issues tend to be:
Alan Smith rattled off a lengthy list of issues that automated tools are unlikely to spot. These have been paraphrased.
Automated testing only finds 20% of the issues/violations and the rest are covered under manual testing with keyboards and screen readers.
Here are some things that automated testing will not find or will be unable to determine a violation without human assistance:
Ideally the web team has accessibility expertise as it is much easier to introduce measures during the development stage than to retrofit pre-launch.
There are also plenty of specialists and agencies who can offer assistance, but be sure to vet them well.
As Marco Zehe explains:
“Companies that need to fulfil something like Section 508 or the UK equivalent, should consider bringing in an expert. Otherwise, available testing tools will get them quite some way towards a goal. The most important thing is to not consider accessibility as an after-thought, but include it in every phase of the project upfront.
The expert should have a good reputation for completing web accessibility work. This should be implicit in their references – as you will find with consulting companies such as The Paciello Group, Deque Systems, SSB Bart Group and WebAIM.”
Testing by automated tools and expert accessibility practitioners should expose many of the issues that contravene WCAG and other best practice guidelines and regulations, but this does not guarantee your site or app will deliver a good user experience to people with disabilities.
There are four reasons for this:
User tests can occur in a variety of ways: on site, remotely, moderated, unmoderated etc.
For those companies interested in outsourcing disability user testing, the Access Works service from Knowbility – a non-profit accessibility consulting company based in Austin (TX) USA – looks worthy of consideration.
Access Works has a database of persons with disabilities who are available to do online, unmoderated testing of Web sites. These testers work from their own homes, using their own adaptive technologies.
The testing organization pays $75 (US) per tester, $50 of which Knowbility pays in turn to the tester. Tests are created and administered by UserZoom or Loop11 – which are charged on a case-by-case basis.
Tom Jewett, Knowbility:
“Testers access these through a personal Access-Works dashboard; they are identified to the testing organization only by a unique ID number, to preserve the privacy of their personal information.
The Access-Works database includes over 300 active potential testers. The majority of these are blind, which is also the most frequently-requested category. Others include low vision, motor skill impairments, hearing disabilities, and cognitive or neurological impairments; some testers may have multiple disabilities.
Two-thirds of the registered testers live in the United States; the rest are mostly in Australia, Canada, India, and the UK. Knowbility can also provide custom tester recruitment based either on location or on disability profile, through accessibility organizations worldwide.”
From a Paralympics perspective, it is surprising that the organizers did not make the grant of broadcasting rights conditional on the provision of website that is accessible to people with a range of disabilities.
Ideally this should be a de facto provision in all contracts, but for a sporting event that promotes the achievements and rights of disabled people it is a glaring omission.
In addition to those experts referenced in this column, the author would particularly like to thank Robert Gaines, web and app developer, of RGaines Web Development for his help researching this column.
Here are the recent ones: